As part of the public impacts evaluation work conducted for the Explore Science: Earth & Space activity toolkits developed and created through the NASA-funded Space and Earth Informal STEM education (SEISE) project, this summative evaluation study of the toolkits was designed to address and answer questions regarding the number and range of audiences reached by the project, visitor engagement, relevance, science identity, and their understanding around NASA’s Science Mission Directorate (SMD) content areas (astrophysics, planetary science, heliophysics, Earth science). The results are based on
Science centers such as museums and planetariums have used stereoscopic (“three-dimensional”) films to draw interest from and educate their visitors for decades. Despite the fact that most adults who are finished with their formal education get their science knowledge from such free-choice learning settings very little is known about the effect of stereoscopic film presentation on their science learning. We explored this issue by designing a quasi-experimental field trial with a short film about the shape of the Milky Way galaxy. The film was produced based on a set of stereoscopic design
DATE:
TEAM MEMBERS:
Aaron PriceHee-Sun LeeMark SubbaRaoEvan KasalJulieta Aguilera
In the From Project Mercury to Planet Mars project, the Museum of Science is partnering with national leaders to create two resources, each geared to a different style of learner, that strengthen engineering education and immersive experiences in the nation’s informal education environment. The Museum of Science is collaborating with the Smithsonian National Air and Space Museum and Albert Einstein Planetarium in Washington D.C., the Clark Planetarium in Salt Lake City, Utah, the Adventure Science Center and Sudekum Planetarium in Nashville, Tennessee, and the Tech Museum of Innovation in San Jose, California. Through the development of a Planetarium show engaging audiences in the excitement of a human journey to Mars, and a large-scale engineering design challenge activity that allows participants to create design solutions to a Mars exploration challenge, the goal of From Project Mercury to Planet Mars is to increase student and public awareness of human space exploration and inspire the next generation of engineers and scientists. Planetarium show viewers are expected to demonstrate an increased appreciation and interest in future activities in engineering and science, and learn about the technical challenges of space exploration. Design challenge participants are expected to actively engage in the engineering design process and in engineering habits of mind.
The Museum of Science, Boston led the From Project Mercury to Planet Mars: Introducing Engineering and Inspiring Youth through Humanity’s Greatest Adventure project (FPMPM) as a way to produce and share high-quality informal engineering education opportunities about the topic of human space travel to Mars. The grant involved the creation of two products that address human space travel to Mars: an immersive full-dome planetarium show and a hands-on engineering design challenge. To evaluate the grant work, the Research & Evaluation Department at the Museum of Science, Boston conducted a
DATE:
TEAM MEMBERS:
Annette SawyerKatie ToddLeigh Ann MesitiAlex LussenhopKeith Allison
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The team of Associated Universities Inc. (AUI), Michigan State University (MSU), California Academy of Science (the Academy), Astronomical Society of the Pacific (ASP), and Association of Universities for Research in Astronomy (AURA), will bring together experts in astronomy, STEM education, and planetarium show production. This work will tell the story of the people and places that make "big astronomy" possible, particularly the search for exoplanets and understanding of how planets form. The show and related materials will be presented in dozens of venues around the USA and internationally. Through a planetarium show and learning experiences that extend beyond the theater, the team will take visitors to extreme sites of the NSF ground-based observatories on the mountains of Chile and meet the diverse people who enable amazing discoveries in astronomy. In addition, the project develops the Dome+ model, which ensures engagement does not end with the planetarium. Dome+ will include additional content, weekly virtual sessions with STEM professionals, and a suite of closely linked outreach activities. Dome+ will serve as a model to extend engagement and increase the impact of future planetarium shows. Project goals include 1) increasing awareness of the research in astronomy being made at the NSF-funded observatories in Chile, 2) increasing awareness and interest in diverse STEM career opportunities at large observatories and related institutions in the USA, 3) increasing knowledge of science enabled by big observatories, 4) increasing Latinx perceptions as someone who can have a career at a major observatory, and 5) developing the Dome+ model and identify best practices for implementation. Iterative and summative evaluation of the project by collaborators at MSU will address four main questions: How does the Dome+ model affect visitors' perceptions of diversity of careers in STEM? How does the Dome+ model affect visitors' interest and understanding of Chile as an ideal observing location for astronomy? How does the Dome+ model support visitors' interest and understanding of the science of exoplanets? How do planetariums implement Dome+, and how does implementation affect the outcomes for visitors? The impact assessment component of this project takes places in four phases. The goals of the first phase are to leverage the expertise of the research team to inform the creation of the planetarium show and to set up a robust research agenda to be achieved in Years 2-4 of the project. The goals of the second phase are to collect preliminary data from visitors on their responses to planetarium show content and to use this information to advise on edits to the show and to develop the content and format of the web-portal and educational materials. The goal of the third phase is to then collect data on how effectively the technology-rich environments of the three components of the Dome+ model (planetarium show, web-portal, educational materials) work in concert to reach the intended goals of changing visitors' perceptions of diversity in STEM, engaging visitors with astronomy content on exoplanets, and exposing visitors to the wonders of astronomy research in Chile. The goal of the fourth phase is to perform data analysis, synthesize findings and make recommendations for future implementations of the Dome+ model for practitioners. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
This study explored how different presentations of an object in deep space affect understanding, engagement, and aesthetic appreciation. A total of n = 2,502 respondents to an online survey were randomly assigned to one of 11 versions of Cassiopeia A, comprising 6 images and 5 videos ranging from 3s to approximately 1min. Participants responded to intial items regarding what the image looked like, the aesthetic appeal of the image, perceptions of understanding, and how much the participant wanted to learn more. After the image was identified, participants indicated the extent to which the
DATE:
TEAM MEMBERS:
Lisa SmithKimberly ArcandRandall SmithJay BookbinderJeffrey Smith
This is a book review of "Cosmos and the Rhetoric of Popular Science" by K. Shroeder Sorensen. Shroeder Sorensen analyses in depth the close relationship of the TV-series Cosmos [1980] with the popular culture, in its broadest sense, at the time of its release. The novel application of Fantasy-Theme analysis to the rhetorical vision of the series reveals how it is the product of a very careful and successful design. The book also compares the original series with its 2014 reboot Cosmos: A Spacetime Odyssey [2014].
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will advance knowledge in the design of interest triggers for science in immersive digital simulation learning games. When learners are interested in a topic, it can have a profound impact on the quality of their learning. Although much is known about how informal learning experiences can promote interest in STEM, much less research has addressed links between technology use and interest development. This Exploratory Pathways project will investigate (1) the impact of entertainment technology use by middle school learners on STEM interest development, (2) the design of interactive educational technologies created specifically to trigger interest in astronomy, and (3) informal learning resources for sustained interaction with STEM content over time. In particular, learners will have the opportunity to interactively explore the scientific consequences of considering alternative versions of Earth via "What if?" questions, such as "What if the earth had no moon?" or "What if the earth were twice its current size?". While using the simulations, learners will be invited to make observations and propose scientific explanations for what they see as different. Given recent discoveries of potentially habitable worlds throughout the Galaxy, such questions have high relevance to public discourse around space exploration, conditions necessary for life, and the long-term future of the human race. Studies will occur across three informal learning settings: museum exhibits, afterschool programs, and summer camps, and are driven by the following research questions: What technology-based triggers of interest have the strongest influence on interest? Which contextual factors are most important for supporting long-term interest development? And, what kinds of technology-based triggers are most effective for learners from audiences who are underrepresented in STEM? This research will result in an empirically tested approach for cultivating interest that will allow educators to leverage the "What if?" pedagogy in their own work, as well as downloadable materials suitable for use in both informal and formal learning settings.
Planned studies will identify features that are effective in triggering interest, with an emphasis on groups underrepresented in STEM, and elaborate on the importance of engaging learners in explanatory dialogues and in service of interest development. It is hypothesized that interacting in such novel ways can act as a trigger for interest in astronomy, physics, and potentially other areas of STEM. Design iterations will also investigate different forms of learning supports, such as guidance from facilitators, collaboration, and automated guidance available within the simulations, and identify how features vary with respect to learning contexts. Data collected will include interview and survey data to track interest development, measures of knowledge in astronomy and physics, and log files of simulation use to better understand how behaviors in the simulations align with stated interests. Results of the studies will advance the theoretical understanding of interest development and its relationship to interactive experiences, and will also have practical implications for the deployment of technology in informal settings by identifying features critical for triggering the interest of middle school learners. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
H Chad LaneJorge Perez-GallegoNeil Comins