IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
This RAPID award is made by the AISL program in the Division of Research on Learning in the Directorate for Education and Human Resources, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. COVID-19 presents a national threat to the health of children and families, presenting serious implications for the mental and physical health of children. This project addresses two critical aspects of the impact on COVID-19 on families: (a) the large-scale shift to at-home learning based on nationwide school closures and (b) the critical need for families to understand the basic science of virus transmission and prevention. To address these needs, the project team will develop a series of STEM activities for families with children in grades K-6 that make use of items readily available in most households. The activities help children and their families learn about viruses, virus transmission, and virus prevention while also developing other STEM-skills, particularly related to engineering design. Importantly, the project team also considers the emotional well-being of children and families during the disruption of the COVID-19 pandemic. Led by researchers from Indiana University and Binghamton University, and experts in educational resource development from Science Friday (a non-profit organization dedicated to increasing the public's access to science and scientific information through podcasts, digital videos, original web articles, and educational resources for teachers and informal educators) the project is further supported by partnerships with the New York Hall of Science, Amazeum (AR), the Gulf of Maine Research Institute (ME), The Tech Museum of Innovation (CA), the Indiana State Museum, and Kopernik Observatory Science Center (NY). The activities will be shared with families through live-streamed web sessions that introduce the activity, give tips to adults for facilitation, share a bit on related STEM careers and engage the audience in dialog about the activity and their current experiences. Versions of the sessions that are recorded will be edited and include closed-captioning and subtitles in multiple languages before being posted on platforms such as YouTube.
This project uses a design-based research approach to investigate strategies for enabling families to actively engage with STEM while home and away from their traditional institutions during a period of crisis. The research components focus on:
Engagement: How do families engage in the activity tasks, in terms of processes, practices, and use of resources? Who participated, why did they choose to participate and how did they engage (including modification of activities)? What barriers prevented interested families from completing activities?
Impact: How did the activities change participants? feelings of: a) efficacy around STEM and b) connectedness/ isolation, during extended school closures?
The Activities: Which activities had the greatest uptake? How many activity ideas were submitted by those outside of the team? What was the age/content focus of each of these activities?
The researchers will analyze social media data (including data on resource downloads and use of tracked links, YouTube and Facebook views, comment threads during livestreams and Likes/Shares/Follows across social media sites) to refine and improve the activities and programming as well as learn about the ways families are engaging in the activities. The researchers will solicit survey responses from website visitors to gather more information on participants, why they participated, how they engaged and how the activities impacted participants? efficacy around STEM and their feelings of connectedness or isolation. The researchers will also ask participants to submit images, videos and text that describes what they are making and their process along the way. Analysis of this data would lead to insights on how children and families use STEM language and practices; how children and families ask questions and use COVID-19-related and other information as part of their design work; and how ideas are formed, shaped and refined as families engage in design and making. While the project focuses on a unique opportunity to collect data on family STEM engagement as families respond to disruptions from the COVID-19 pandemic, this project and its findings will provide a knowledge base that can be utilized to inform future responses to national emergencies, other work aimed at promoting family learning at home, and approaches to supporting children in open-ended problem solving.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This year marks the 50th anniversary of the founding of the Exploratorium, the self-described "museum of science, art and human perception," in San Francisco, California and the 10th anniversary of the launching of the National Research Council/National Academy of Sciences, Engineering and Medicine report Learning Science in Informal Environments: People, Places and Pursuits. The moment offered me an opportunity to reflect on my own professional journey, which began at the Exploratorium, coincided with a growth spurt of field knowledge-building and has included experiences that inform how I
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
This report presents the findings from the summative evaluation of the Multi-Site Public Engagement with Science project (MSPES), funded by an NSF AISL award. MSPES aimed to bring together public audiences and professional scientists through “Building with Biology” programming - public events and forums centered on the topic of synthetic biology. The goal was to promote meaningful, two-way dialogs around this area of science, which is rapidly advancing and raising interesting social and ethical questions. The project team sought to move beyond a traditional "public understanding of science"
Transforming Communities provides an overview of the agency mission, vision, goals, and objectives, and includes highlights of IMLS initiatives and projects.
DATE:
TEAM MEMBERS:
Institute of Museum and Library Services
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
STEM Pathways is a collaboration between five Minnesota informal STEM (science, technology, engineering, and mathematics) education organizations—The Bakken Museum, Bell Museum of Natural History, Minnesota Zoo, STARBASE Minnesota, and The Works Museum—working with Minneapolis Public Schools (MPS) and advised by the Minnesota Department of Education. STEM Pathways (logo shown in Figure 1) aims to provide a deliberate and connected series of meaningful in-school and out-of-school STEM learning experiences to strengthen outcomes for students, build the foundation for a local ecosystem of STEM
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
In this article, science center and museum professionals from around the world share ways that they are engaging visitors in hands-on innovation. Work from the following organizations are discussed: Exploratorium, Discovery Center of Idaho, Lawrence Hall of Science, Iridescent, Conner Prairie Interactive History Park, Ideum, Discovery Place, Ontario Science Centre, Bootheel Youth Museum, Science Centre Singapore, Children's Museum of Phoenix, Discovery Museums (Acton, MA), Discovery Center of Springfield, Missouri, Museum of Science, Boston, Questacon--The National Science and Technology