In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The SciGirls in Space: Exploring the Moon, Mars and NASA Careers Implementation Evaluation Report focuses on the STEM outreach component of the project for 15 girl-serving organizations who used research-based gender equitable and culturally responsive instructional strategies,NASA-aligned media and STEM activities with a focus on integrating of NASA women role models.
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus
My Sky is a NASA funded project, which developed a traveling exhibition on astronomy. Boston Children’s Museum (BCM) created the exhibition in collaboration with the Smithsonian Astrophysical Observatory (SAO). Formative and remedial evaluations were conducted at BCM while the summative evaluation took place at the first two venues following BCM: Stepping Stones Museum for Children (Stepping Stones) in Norwalk, CT and The Providence Children’s Museum (PCM) in Providence, RI. Formative evaluation of the My Sky exhibit was conducted between April 2013 and June 2014 to ensure that the components
The impact of four half-hour science programs aired on commercial children's radio was assessed by Dr. Barbara Flagg of Multimedia Research in a causal-comparative between-groups study with prebroadcast and postbroadcast questionnaires. Of 253 fourth graders, 34% listened to one or more shows of the Kinetic City Super Crew series. Significantly more girls listened than boys. Listeners and Non-listeners did not differ on background variables of ethnic status, science attitudes, science reading and television viewing, and participation in seven of eight common at-home science activities
Magnolia Consulting, LLC conducted a formative and summative evaluation to examine public perceptions of the utility and quality of two labs/exhibits within the North Carolina Museum of Natural Sciences Natural World Investigate Lab, Biofuels and Science of Scent. Appendix includes survey.
DATE:
TEAM MEMBERS:
North Carolina State Museum of Natural ScienceMary Styers
Evaluators sought to determine impact on math attitude and content knowledge of students (3rd - 6th grade), and math literacy workers (high school and college students), based on pre-post testing and observation of YPP after school programs, in which college and high school students teach math games to elementary and middle school students in marginalized and vulnerable communities. The study focused on the Chicago YPP site, 1 of 7 in the YPP national network. Increases in math attitude scores were not statistically significant, however in some instances evaluators found significant increases
DATE:
TEAM MEMBERS:
Norman LedermanYoung People's Project, Inc.
This summative evaluation of the exhibition Robots & Us was designed to investigate how visitor audiences used and experienced this exhibition in relation to the project’s objectives and challenges. Visitors’ expectations and perceptions in relation to the project’s content goals prompted the summative evaluation to focus on specific challenges including: attitudes and perceptions about technology, connections between robots and people, appeal to a broad audience, and reactions to specific exhibits.
DATE:
TEAM MEMBERS:
Jeff HaywardJolene HartScience Museum of Minnesota