EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Marked by the diversity of initiatives linking science and art and by new presentation formats, the 15th Congress of the Network for Popularisation of Science and Technology in Latin America and the Caribbean (RedPOP) saw heated debates on science, culture, politics and society. Between 21st and 25th August, it brought together in Buenos Aires (Argentina) about 400 participants from 14 countries in order to share new visions, initiatives and research work in science communication. During the event, which included a vast cultural programme, a series of challenges were raised for the future
This article aims to present a critical analysis of the book entitled “Creative Research Communication ― Theory and Practice”, written by Clare Wilkinson and Emma Weitkamp (Manchester University Press, 2016). We aim to present the structure of the book, highlighting its strengths and successes. Although some chapters focus on the UK, the book offers a wide range of examples of practical activities for the communication of research of global interest and provides very useful tips. Ethical issues and the importance of evaluation, of how to do carry out such evaluation and dissemination, are also
The National Autonomous University of Mexico (UNAM) is one of the world's single largest employers of science communicators, with over 350,000 students and 40,000 staff. Its science communication activities include five museums (Universum, Museo de la Luz, the Geology Museum, Museo de la Medicina Mexicana and Musem of Geophysics), botanical gardens, as well as a wide range of cultural and outreach activities. It has several programmes for training professional science communicators. The science communication staff are spread across the campuses in Mexico City and four other cities, including
DATE:
TEAM MEMBERS:
Ana Claudia NepoteElaine Reynoso-Haynes
resourceprojectProfessional Development, Conferences, and Networks
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will develop and test intergenerational science media resources for parents that are participating in adult education programs and their young children. The materials will build on the research-based and successful children's television program, Fetch with Ruff Ruffman. The target audience includes parents enrolled in adult education programs who lack a high school diploma or are in English as a Second Language classes. These resources will support parents' engagement in science activities with their children both in the adult education settings as well as at home. Adult and family educators will receive professional development resources and training to support their integration of the parent/child activities. Project partners include the National Center for Families Learning, Kentucky Educational Television, and Alabama Public Television,
The goals of the Ruff Family Science project are to: (1) investigate adult education settings that feature an intergenerational learning model, in order to learn about the unique characteristics of adults and families who are enrolled in these programs; (2) examine the institutional circumstances and educator practices that support joint parent/child engagement in science; (3) iteratively develop new prototype resources meet the priorities and needs of families and educators involved in intergenerational education settings; and (4) develop the knowledge needed to create a fuller set of materials in the future that will motivate and support diverse, low-income parents to investigate science with their children. The research strategy is comprised of three main components: Phase 1: Needs Assessment: Determine key motivations and behaviors common to adult education students who are also parents; surface obstacles and assets inherent in these parents' current practices; and examine the needs and available resources for supplementing parents' current engagement in family science learning. Phase 2: Prototype Development: Iteratively develop two prototype Activity Sets, along with related educator supports and training materials, designed to promote joint parent-child engagement with English and Spanish-speaking families around physical science concepts. Phase 3: Prototype Field Test: Test how the two refined prototype Activity Sets work in different educational settings (adult education, parent education, and parent and child together time). Explore factors that support or impede effective implementation. Sources of data for the study include observations of adult and parent education classes using an expert interview protocol, focus groups, adult and family educator interviews, and parent surveys.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The subject of physics and all of its sub-disciplines are becoming more prevalent in the public press as the research results appear to be quite interesting and important. While the physics discipline has made a Nation-wide effort to acquaint the public with physics knowledge through informal education learning experiences for years, it has not been as successful as the community desires. Thus, this project is aimed to gather all of the informal and outreach physics education efforts that have been attempted in the hope of finding the best practices for learning physics concepts and practices. A compendium will be published to inform future opportunities on how to educate the public through informal and outreach mechanisms. This project is a collaboration between Michigan State University and the University of Colorado. The physics community has a long history of engaging audiences in informal education activities. Physics institutions that facilitate informal programs include university departments, national laboratories and centers, and professional societies and organizations. There is, however, no systemic understanding of how these programs are facilitated, nor an assessment of the collective impact that these programs have on participants. This project will address numerous research questions in the broad areas of Activity Detail, Structural Aspects, and Assessment. Further, their efforts will determine the "who, what, why, where and how" of informal physics offerings, focusing on their facilitation, impact on participants, and the academic and discipline-specific cultures from which these programs originate. The study has several definite research outcomes that will emerge from this methodology: 1) They will produce a survey of the informal efforts of university physics departments, national physics labs and national physics organizations, 2) They will develop a taxonomy of informal physics programs from which we can characterize the landscape of programs, and 3) by investigating both "successful" as well as "failed" or terminated programs, they will develop an understanding of the culture and resources needed to support outreach from these research findings. In addition, they will produce published works that can be utilized by informal practitioners and administrators in physics to examine current programs and guide the development of new programs. With regards to the research questions and framework, the overarching and driving question for this research project is: "What is the landscape of informal physics learning, specifically, of those programs in the United States facilitated by physicists and physics students at academic institutions, national labs and by national physics organizations?" This study will provide a robust understanding of the state of informal physics programs and outreach by physicists in the United States today. Findings will inform practitioners and administrators as to how best to support and design informal physics programming. The results will also have broad implications for other discipline-specific informal STEM programming. The primary data collection methods will be a nationwide survey and interviews with a large sample of informal practitioners from the physics community. Site visits will be conducted with a subset of these programs in order to observe programs in action and to glean insights from university participants, community partners, public, and K-12 audiences.
DATE:
-
TEAM MEMBERS:
Kathleen HinkoNoah Finkelstein
resourceprojectProfessional Development, Conferences, and Networks
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects.
The specific areas of study are:
a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI.
b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research.
c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement.
d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations.
Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Over the seven years prior to this award, the principal investigator from George Mason University and a national team of scientists, professional societies, science communication researchers, and broadcast meteorologists have been engaged in an effort to include in TV and other weather broadcasts information about current research on the interactions of climate and weather. A Climate Matters network has been established that involves 350 weathercasters at 218 stations, in 119 media markets, nationwide. A particular focus of the initiative has been to help the public become more familiar with the science behind how their local weather and its trends are related to the dynamics of the climate. Many communities nationwide are engaged in deliberations about how to understand, plan for, and adapt to the potential impacts of changes in their weather on important factors pertaining to their economy and well-being, such as natural resources, natural disasters, agriculture, industry, and health. The goal of this continuing project is to expand the quantity and nature of the coverage of such information into the news segments of local news media. By stimulating local reporting on climate impacts and their relationships to personal and community-wide decision-making, this project will potentially help millions of Americans better understand and respond to critical factors that are affecting their lives. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project involves five inter-related, complementary activities: (1) Knowledge building through formative research and process evaluation, specifically in-depth interviews and random sample surveys of journalists in each of the participating journalism professional societies; (2) Recruiting 400 news directors, producers, reporters and additional weathercasters into the Climate Matters network; (3) Providing climate reporting training and professional development to members of the network; (4) Producing and distributing Climate Matters reporting packages to all members of the network on a near-weekly basis; and (5) Evaluating the impacts of the climate reporting on public understanding of science.
DATE:
-
TEAM MEMBERS:
Edward MaibachSusan HassolBernadette PlackyRichard CraigTeresa Myers
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will derive a nationwide online coaching/mentoring program for out of school educators in rural settings. The program builds on a Noyce Foundation pilot project. The issue to be addressed is that educators in rural settings are challenged in a multitude of ways due to isolation. This project will try to find ways to alleviate some of the consequences of isolation through resource sharing, knowledge sharing, and unique techniques for communicating with students. Partners in this effort are the Maine Mathematics and Science Alliance, the National AfterSchool Association, Development Without Limits, and the Maine State Library.
By using widely-available technologies, this project will bring fully online instructional coaching in STEM to out-of-school educators who live too remotely to attend ongoing in-person workshops. The project team will achieve this by adapting a highly promising coaching program where groups of educators video-record their own work with youth, practice key skills, and meet regularly to discuss their work. The project will: (a) test technical challenges to achieve fully virtual implementation; (b) design and adapt a specific STEM-skill curriculum to align with different levels of need; (c) customize the model to work with rural librarians; and (d) integrate the work into existing state and national accreditation systems.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will conduct research designed to deepen our fundamental knowledge about culture, experience, and ecosystems cognition and to develop innovative practices and approaches to support learning about changing ecological systems and environmental decision making. Work on cultural differences in the production of complex systems knowledge is severely lacking. This gap in knowledge may contribute to the continued reproduction of inequities in science education. More broadly findings from this project will have clear implications for theories of cognitive development, especially those pertaining to how knowledge is shaped by culture and experience. Focusing on ecosystems may represent an opportunity to not only increase engagement and achievement in science among non-dominant communities and Native youth specifically, but also advance effective learning for all communities. The primary deliverables for the project are conference presentations and research publications. However, the project will also develop additional resources freely available to researchers, educators, and the general public. These will include summer curricular materials and teaching tools, professional development workshops, practitioner briefs about research findings that can be used in professional development workshops and shared share more broadly, and evaluation reports.
A deeper understanding of cultural influences on conceptions of the natural world can serve to advance the educational needs of children, including children from diverse linguistic and cultural backgrounds. Project research will include two interrelated series of studies designed to expand knowledge about human cognition of complex ecosystems and the affordances of informal STEM learning environments in developing and supporting the critical 21st century skill of ecological systems level reasoning. The first consists of a series of experiments focused on ecological cognition and the role of humans in nature. The second consists of design-based research interventions in informal settings, summer workshops for youth and the communities, focused on ecological systems level thinking and socio-environmental decision making. The project will recruit and engage both child and adult participants from two broad cultural communities, Native Americans and European Americans living in urban and suburban communities, in part because it affords a sharp test of human-nature relations. Sampling from two different urban communities will avoid simple Native-non-Native comparative binaries and to conduct Native-to-Native comparative analysis. Based on results from this, the project will result in: 1) foundational knowledge about human learning and reasoning and ecosystems and environmental decision making, 2) culturally responsive models of learning and practice about complex ecosystems for indoors and outdoors informal learning environments, and 3) insights about research-practice-community partnerships. One important objective of the research is to broaden participation and close opportunity gaps for under-represented groups in STEM fields broadly and more specifically for Indigenous people. Members of Indigenous communities, who provide strong role models for other aspiring scholars, will be involved as postdoctoral fellows, research assistants and graduate fellows.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert