In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
Exploration Place, with funding from the National Aeronautics and Space Administration (NASA), contracted RK&A to conduct a summative evaluation of Design Build Fly, an exhibition and program series that explores what happens behind-the-scenes in Wichita’s aircraft plants. The goals of the study were to identify how visitors use the exhibition, explore what meaning visitors make from Design Build Fly, and understand to what extent visitors’ meaning-making aligns with intended outcomes.
How did we approach this study? RK&A conducted timing and tracking observations of visitors to the
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
This poster, which was presented at the Association of Science and Technology Centers Annual Conference on October 22, 2017, compares and contrasts evaluation findings across components of the Beyond Spaceship Earth project at The Children's Museum of Indianapolis. The project focuses on educating families and students about life and work aboard the International Space Station and generating interest in STEM topics and careers. Project components reviewed include an exhibit, a space object theater, and workshop-style programs focused on engineering and robotics for both families and school
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
Pacific Science Center (Science Center) has been a pillar of science education programming in Seattle, Washington since 1962. Through interactive exhibits, planetarium shows, IMAX movies and outreach, the Science Center works to inspire a lifelong interest in science, math and technology. In 2010, the Science Center joined forces with the National Aeronautics and Space Administration (NASA) through NASA Now: Using Current Data, Planetarium Technology and Youth Career Development to Connect People to the Universe. NASA Now was designed to increase the awareness, knowledge and understanding of
Summative Evaluation of the Science on a Sphere exhibit at the Denver Museum of Nature & Science. The evaluation looks at the effectiveness of two topics; Earth Systems and Comparative Planetology using Docent lead facilitation, a scripted show, and data sets running in auto-mode (with no recorded narration).