In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
This project includes the development of a toolkit of new hands-on facilitated museum activities, and a mobile app with both app-based activities and do-it-yourself (DIY) activities. This evaluation report focuses on the formative evaluation of three app activities that are being added to the DIY app series.
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
WGBH received funding to develop and create NOVA Labs, an online environment that provides teen audiences with an online research lab, educational content, and the opportunity to engage with authentic data, tools, and processes to investigate scientific questions. This work has begun with the development of a first pilot lab, called The Sun Lab. NOVA Education created and launched this lab in early summer 2012. Examining the site in its pilot form, the Lifelong Learning Group (LLG) engaged in a formative evaluation to support refinements and improvements in the design of subsequent NOVA Lab
NOVA Labs (www.pbs.org/nova/labs) is a web-based platform designed for use by educators, students, and teens to engage learners with authentic data, processes, and tools of working scientists. The present evaluation study sought to investigate the outcomes achieved by users of the third NOVA Labs platform developed: Cloud Lab. The intended outcomes identified for student users were that they would: • Be able to successfully work with the real data provided in the Cloud Lab; • Demonstrate ability to interpret and use scientific data and tools; • Engage with real scientific data through the
In 2011, the Space Science Institute (SSI) engaged Insight Evaluation Services (IES) to conduct a summative evaluation of an online, multi-user space science game called MyStar. The game, which was developed with funding from the National Aeronautics and Space Administration (NASA), was designed to introduce late middle school-early high school students to the basic concepts of stellar and planetary evolution. IES assessed the effectiveness of MyStar in meeting specific learning goals, including in particular (1) The galaxy has “habitable zones” where planetary formation and/or life is more
This report presents the results of a front-end evaluation with Saint Louis Science Center visitors on the topics of Mars, Mars exploration, engineering, and robotics. This work was conducted by the Research & Evaluation Department of the Saint Louis Science Center. This front-end study was designed to inform the content development of the Bridging Earth and Mars (BEAM) exhibition, which is being developed by the Saint Louis Science Center with the support of funding from NASA. The main objective of the evaluation was to gather information from Science Center visitors about their familiarity