In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This project includes the development of a toolkit of new hands-on facilitated museum activities, and a mobile app with both app-based activities and do-it-yourself (DIY) activities. This evaluation report focuses on the formative evaluation of three app activities that are being added to the DIY app series.
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will advance knowledge in the design of interest triggers for science in immersive digital simulation learning games. When learners are interested in a topic, it can have a profound impact on the quality of their learning. Although much is known about how informal learning experiences can promote interest in STEM, much less research has addressed links between technology use and interest development. This Exploratory Pathways project will investigate (1) the impact of entertainment technology use by middle school learners on STEM interest development, (2) the design of interactive educational technologies created specifically to trigger interest in astronomy, and (3) informal learning resources for sustained interaction with STEM content over time. In particular, learners will have the opportunity to interactively explore the scientific consequences of considering alternative versions of Earth via "What if?" questions, such as "What if the earth had no moon?" or "What if the earth were twice its current size?". While using the simulations, learners will be invited to make observations and propose scientific explanations for what they see as different. Given recent discoveries of potentially habitable worlds throughout the Galaxy, such questions have high relevance to public discourse around space exploration, conditions necessary for life, and the long-term future of the human race. Studies will occur across three informal learning settings: museum exhibits, afterschool programs, and summer camps, and are driven by the following research questions: What technology-based triggers of interest have the strongest influence on interest? Which contextual factors are most important for supporting long-term interest development? And, what kinds of technology-based triggers are most effective for learners from audiences who are underrepresented in STEM? This research will result in an empirically tested approach for cultivating interest that will allow educators to leverage the "What if?" pedagogy in their own work, as well as downloadable materials suitable for use in both informal and formal learning settings.
Planned studies will identify features that are effective in triggering interest, with an emphasis on groups underrepresented in STEM, and elaborate on the importance of engaging learners in explanatory dialogues and in service of interest development. It is hypothesized that interacting in such novel ways can act as a trigger for interest in astronomy, physics, and potentially other areas of STEM. Design iterations will also investigate different forms of learning supports, such as guidance from facilitators, collaboration, and automated guidance available within the simulations, and identify how features vary with respect to learning contexts. Data collected will include interview and survey data to track interest development, measures of knowledge in astronomy and physics, and log files of simulation use to better understand how behaviors in the simulations align with stated interests. Results of the studies will advance the theoretical understanding of interest development and its relationship to interactive experiences, and will also have practical implications for the deployment of technology in informal settings by identifying features critical for triggering the interest of middle school learners. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
H Chad LaneJorge Perez-GallegoNeil Comins
Great Lakes Science Center (GLSC), home of the NASA Glenn Visitor Center, is dedicated to sharing NASA content to inform, engage, and inspire students, educators, and the public. To further this goal, GLSC will develop a digital experience focused on collaboration and teamwork, emphasizing the benefits of a systems approach to STEM challenges. At the recently, fully renovated NASA Glenn Visitor Center, GLSC visitors will embark on an exciting mission of discovery, working in teams to collect real data from NASA objects and experiences. Mobile devices will become scientific tools as students, teachers, and families take measurements, access interviews with NASA scientists, analyze results from Glenn Research Center (GRC) test facilities, and link to NASA resources to assemble mission-critical information. This initiative will provide experiences that demonstrate how knowledge and practice can be intertwined, a concept at the core of the Next Generation Science Standards. GLSC’s digital missions will engage students and families in STEM topics through the excitement of space exploration. In addition, this project has the potential to inform the design of future networked visitor experiences in science centers, museums and other visitor attractions.
Researchers at the American Association of Variable Star Observers, the Living Laboratory at the Boston Museum of Science, and the Adler Planetarium are studying stereoscopic (three-dimensional or 3D) visualizations so that this emerging viewing technology has an empirical basis upon which educators can build more effective informal learning experiences that promote learning and interest in science by the public. The project's research questions are: How do viewers perceive 3D visualizations compared to 2D visualizations? What do viewers learn about highly spatial scientific concepts embedded in 3D compared to 2D visualizations? How are viewers\' perceptions and learning associated with individual characteristics such as age, gender, and spatial cognition ability? Project personnel are conducting randomized, experimental mixed-methods research studies on 400 children and 1,000 adults in museum settings to compare their cognitive processing and learning after viewing two-dimensional and three-dimensional static and dynamic images of astronomical objects such as colliding galaxies. An independent evaluator is (1) collecting data on museum workers' and visitors' perceived value of 3D viewing technology within museums and planetariums and (2) establishing a preliminary collection of best practices for using 3D viewing technology based on input from museum staff and visitors, and technology creators. Spatial thinking is important for learning many domains of science. The findings produced by the Two Eyes, 3D project will researchers' understanding about the advantages and disadvantages of using stereoscopic technology to promote learning of highly spatial science concepts. The findings will help educators teach science in stereoscopic ways that mitigate problems associated with using traditional 2D materials for teaching spatial concepts and processes in a variety of educational settings and science content areas, including astronomy.
WGBH received funding to develop and create NOVA Labs, an online environment that provides teen audiences with an online research lab, educational content, and the opportunity to engage with authentic data, tools, and processes to investigate scientific questions. This work has begun with the development of a first pilot lab, called The Sun Lab. NOVA Education created and launched this lab in early summer 2012. Examining the site in its pilot form, the Lifelong Learning Group (LLG) engaged in a formative evaluation to support refinements and improvements in the design of subsequent NOVA Lab
NOVA Labs (www.pbs.org/nova/labs) is a web-based platform designed for use by educators, students, and teens to engage learners with authentic data, processes, and tools of working scientists. The present evaluation study sought to investigate the outcomes achieved by users of the third NOVA Labs platform developed: Cloud Lab. The intended outcomes identified for student users were that they would: • Be able to successfully work with the real data provided in the Cloud Lab; • Demonstrate ability to interpret and use scientific data and tools; • Engage with real scientific data through the
NOVA Labs (pbs.org/nova/labs) is a free digital platform that engages teens and lifelong learners in activities and games that foster authentic scientific exploration. From building RNA molecules and designing renewable energy systems to tracking cloud movements and learning cybersecurity strategies, NOVA Labs participants can take part in real-world investigations by visualizing, analyzing, and playing with the same data that scientists use. Each Lab focuses on a different area of active research. But all of them illustrate key concepts with engaging and informative videos, and guide participants as they answer scientific questions or design solutions to current problems. Supporting pages on each Lab site explain the purpose and functions of the Lab, help teachers incorporate it into their classrooms, foster collaboration between users, and help users make connections to the broader world of STEM. Users are encouraged to explore potential career paths through “Meet the Scientists” profiles, and to obtain information about local and national STEM resources.
Virtual Missions and Exoplanets (vMAX) will develop and test a three-dimensional, virtual world environment that will engage middle school students and educators from high-poverty schools in NASA-related exoplanet mission simulations. The Patricia and Phillip Frost Museum of Science will serve as the lead institution, in partnership with the following institutions: U.S. Space and Rocket Center, New York Hall of Science, Chabot Space & Science Center, and Sci-Port: Louisiana¹s Science Center; Aimee Weber Studios will be responsible for virtual exhibit fabrication, and WestEd will serve as the project¹s formative and summative evaluator. The overall goal of the project is to create a NASA resource on exoplanet astronomy that will engage students, educators, and the general public in NASA¹s search for worlds beyond our own. The project aims to increase underserved students¹ engagement in STEM, knowledge of exoplanet missions, and awareness of NASA-related careers; and advance the growing body of knowledge on the use of virtual world technologies to provide opportunities for students to participate in NASA Mission-related science teaching and learning. The project will result in the development of vMAX world, a virtual world with simulations related to exoplanet astronomy designed for use as the core content of a 30-hour out-of-school learning experience for middle school students. An Educator Implementation Guide will be developed and made available online for download by secondary school teachers and science museum educators. In addition, an interactive, multiuser exhibit kiosk, utilizing the simulations created for vMAX world, will be developed and made available to interested Visitor Centers, museums and planetariums.
Mission to Mars engages 6th-8th grade students in the science, engineering and careers related to Mars exploration. The program is led by the Museum of Science and Industry, Chicago, and includes as partners Challenger Learning Centers in Woodstock, IL, Normal IL and three NASA Centers (Jet Propulsion Laboratory, Marshall Space Flight Center, and Johnson Space Center). The project aims to:
Link, via videoconference, urban and rural middle school students from low income communities in an exploration of space science
Develop and launch programs that showcase NASA Center research
Enrich middle school curricula and promote learning about NASA’s space missions with experiences that inspire youth to pursue in NASA-related STEM careers.
Programs and products produced include:
3 videoconference program scenarios that highlight research being conducted at NASA Centers
Pre- and post-event curriculum materials designed for middle school classrooms
Teacher professional development workshops
Communication support for NASA professionals
iPad apps utilized during the program
Since the program launched five years ago, Mission to Mars has served 7,676 students. MSI seeks to provide opportunities for all learners, and works to remove barriers to participation in high-quality science learning experiences. Mission to Mars allows MSI to engage more Chicago Public Schools (where 86% of students are economically disadvantaged) in real and relevant science experiences that may lead to STEM careers.
As MSI’s CP4SMP grant comes to an end, the Museum has committed to continued delivery of the program through 2 Mission to Mars Learning Labs, offered to 6-8th grade school groups visiting on field trips. Live videoconferencing with JPL and Johnson will occur during roughly half of the sessions. Our Challenger Learning Center partners will integrate Mission to Mars activities, materials and iPad apps into their own Mars-themed programs. Together these efforts extend the transformative hands-on science experiences developed under the Mission to Mars grant to a whole new audience of middle school students and teachers.