As part of the public impacts evaluation work conducted for the Explore Science: Earth & Space activity toolkits developed and created through the NASA-funded Space and Earth Informal STEM education (SEISE) project, this summative evaluation study of the toolkits was designed to address and answer questions regarding the number and range of audiences reached by the project, visitor engagement, relevance, science identity, and their understanding around NASA’s Science Mission Directorate (SMD) content areas (astrophysics, planetary science, heliophysics, Earth science). The results are based on
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions
The National Building Museum (NBM) contracted RK&A, Inc. to conduct a summative evaluation of the Why Engineering? distance learning program. The goal of the evaluation was to assess program operations and explore the extent to which the program achieved its intended outcomes for students and teachers.
How did we approach this study?
RK&A used three methodologies for the study: online program observations; student assessments administered immediately after the program; and telephone interviews with teachers. Observations were primarily used to gain a holistic understanding of how the
RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
Informal STEM education (ISE) organizations, especially museums, have used evaluation productively but unevenly. We argue that advancing evaluation in ISE requires that evaluation capacity building (ECB) broadens to include not only professional evaluators but also other professionals such as educators, exhibit developers, activity facilitators, and institutional leaders. We identify four categories of evaluation capacity: evaluation skill and knowledge, use of evaluation, organizational systems related to conducting or integrating evaluation, and values related to evaluation. We studied a
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
This poster was presented at the 2019 AISL PI Meeting, and describes the the ongoing research questions and goals of the Ute STEM Project, which explores the integration of the traditional ecological knowledge (TEK) of the Ute Indians of Colorado and Utah and Western science, technology, engineering and math (STEM).
This guide describes what took place during NYSCI’s Big Data for Little Kids workshop series, Museum Makers: Designing With Data. In addition to detailed outlines of the activities implemented during the program, this guide includes a glossary of recurrent terms and resources used throughout the workshops.
In 2017, as part of a National Science Foundation funded project, the New York Hall of Science (NYSCI) set out to teach Big Data concepts to children ages 4 – 8 years old. NYSCI developed and piloted an after-school program for families to utilize the data cycle as a method of informed
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [apprentices]. During the sixth and final regional workshop in Minneapolis, MN, the NFB operated two different programs simultaneously: one program for youth and a second program for their parents/caregivers. A third program, for the Science Museum of Minnesota staff, was conducted earlier to prepare the museum staff to assist with the youth program
This poster was presented as part of the 2019 AISL PI Meeting. In this project, the New York Hall of Science, in collaboration with the Amazeum (Bentonville, AR), the Tech (San Jose, CA), and the Creativity Labs (Indiana University), is conducting a design-based research study to develop evidence-based guidance about how museums can use narratives to create more equitable and effective engineering experiences for girls. Through iterative activity development, the project team is exploring ways of using narrative elements (such as characters, settings, and problem frames) to communicate a story