This report is the summative evaluation of Moon Adventure Game. The Moon Adventure Game is a challenge-based immersive game, inspired by “escape room” experiences, which asks visitors to take on activities to help them think about what people might need to live and work on the Moon.
The Lineage project was a collaboration between Twin Cities Public Television and the Smithsonian’s National Museum of Natural History. The project included creation of a feature-length video program, a Virtual Reality game, and a set of hands-on activities designed for use by multigenerational audiences—all of which were incorporated as part of a series of seven Fossil Festival events at museums and other sites around the United States. This report presents findings from a set of external evaluation studies that examined impacts on families who participated in Fossil Festival events as well
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). Additional partner institutions were the ECHO Lake Aquarium and Science Center (ECHO), Lawrence Hall of Science (LHS) at the University of California, Berkeley, and Audience Viewpoints Consulting (AVC). The summative evaluation study was
The University of California, Davis Tahoe Environmental Research Center (TERC), UC Davis W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES), ECHO Lake Aquarium and Science Center (ECHO), UC Berkeley Lawrence Hall of Science (LHS), and the Institute for Learning Innovation (ILI) will study how 3-D visualizations can most effectively be used to improve general public understanding of freshwater lake ecosystems and Earth science processes through the use of immersive three-dimensional (3-D) visualizations of lake and watershed processes, supplemented by tabletop science activity stations. Two iconic lakes will be the focus of this study: Lake Tahoe in California and Nevada, and Lake Champlain in Vermont and New York, with products readily transferable to other freshwater systems and education venues. The PI will aggregate and share knowledge about how to effectively utilize 3-D technologies and scientific data to support learning from immersive 3-D visualizations, and how other hands-on materials can be combined to most effectively support visitor learning about physical, biological and geochemical processes and systems. The project will be structured to iteratively test, design, and implement 3-D visualizations in both concurrent and staggered development. The public will be engaged in the science behind water quality and ecosystem health; lake formation; lake foodwebs; weather and climate; and the role and impact of people on the ecosystem. A suite of publicly available learning resources will be designed and developed on freshwater ecosystems, including immersive 3-D visualizations; portable science stations with multimedia; a facilitator's guide for docent training; and a Developer's Manual to allow future informal science education venues. Project partners are organized into five teams: 1) Content Preparation and Review: prepare and author content including writing of storyboards, narratives, and activities; 2) 3-D Scientific Visualizations: create visualization products using spatial data; 3) Science Station: plan, design, and produce hands-on materials; 4) Website and Multimedia: produce a dissemination strategy for professional and public audiences; 4) Evaluation: conduct front-end, formative, and summative evaluation of both the 3-D visualizations and science activity stations. The summative evaluation will utilize a mixed methods approach, using both qualitative and quantitative methods, and will include focus groups, semi-structured interviews, web surveys, and in-depth interviews. Leveraging 3-D tools, high-quality visual displays, hands-on activities, and multimedia resources, university-based scientists will work collaboratively with informal science education professionals to extend the project's reach and impact to an audience of 400,000 visitors, including families, youth, school field trip groups, and tourists. The project will implement, evaluate, and disseminate knowledge of how 3-D visualizations and technologies can be designed and configured to effectively support visitor engagement and learning about physical, biological and geochemical processes and systems, and will evaluate how these technologies can be transferred more broadly to other informal science venues and schools for future career and workforce development in these critical STEM areas.
The Children’s Museum developed From the Blue Planet to the Red Planet: Exploring Planetary Science to provide opportunities for students in grades 4 through 8, teachers, and families to learn about Mars exploration. The Museum partnered with the Connecticut Center for Advanced Technology (CCAT) on four teacher professional development modules related to aspects of planetary science: soil and plant study, air pressure, robotic exploration, and the comparison of Mars and Earth. Teachers who attended free workshops could bring students to the Museum for classroom and planetarium experiences. The Museum received support from Central Connecticut State University and technical advice from Phoenix Project scientists at JPL. The Museum created a timeline of Mars exploration history with video clips of milestones and an accompanying quiz kiosk. CCAT created virtual Mars drive-through experiences with which visitors could explore the planet. The Travelers ScienceDome Planetarium staff wrote, directed, and animated a full-dome planetarium program about the future study of Mars that was finished in December 2012. For over two years the Museum has sponsored free, monthly Mars Madness programs during which the general public can visit the exhibit, see a Mars-related planetarium program, and test out some of the hands-on activities developed for the school groups. The Museum hoped to reach a diverse audience, especially, those people who might otherwise not afford admission. We have produced four teacher professional development guides with hands-on activities, an exhibit for our facility, a dedicated website, and a planetarium program.
The Climate Change Toolkit includes a suite of resources that address the science behind climate change while encouraging participants to take action to reduce the effects of climate change. Each resource has been designed to be low cost and easy for educators to reproduce. Contents of the Toolkit include: (1) Ten Hands-on Cart Activities - These hands-on, cart-type science activities for families in an informal education setting or for children in an afterschool setting, engage participants with the science of climate change. The activities are divided into two categories, those that address the science behind climate change, and those that address how individual choices affect the rate of climate change. (2) Four Portable Self-Guided Exhibits Kits - These self-guided science kits use four hands-on activities per kit to explore how climate change is affecting the forest, ocean, urban, and atmosphere environments. Each kit can be packaged in a small bag or box and bundled together with an activity map box for check-out by families in an informal education setting. (3) Public Presentation - CO2 and You is a twenty-minute presentation that provides the option of using interactive clickers to introduce the science behind how fossil fuel consumption leads to climate change. The interactive presentation also explores how simple energy choices can have a positive effect on the climate. (4) Museum Field Trip Program - The Power the Future field trip uses an interactive diagram to explain how carbon based fossil fuels such as coal emit carbon dioxide and contribute to climate change. The program then discusses the need to transition away from carbon based energy sources such as fossil fuels to those that do not emit carbon dioxide, such as wind power. The second section of the program guides visitors through a hands-on inquiry activity where they explore their own windmills.
DATE:
TEAM MEMBERS:
Charlie TrautmannKatie LevedahlAlberto López
IDSolutions, in partnership with the National Association of Health Education Centers (NAHEC) and eight NAHEC member organizations will develop an original project to provide informal science education experiences to children, families and the local community via visual communications' technology. This initiative includes building a technical infrastructure that will connect participating Health Education Centers. It will expand beyond the installation of a network and will focus the bulk of its energy on the technology's application -- generating inquiry-based science experiences through active engagement with content that originates from remote locations. Through the creation of an Interactive Videoconferencing Programming Collaborative (IVPC), IDSolutions, NAHEC, and NAHEC Members will produce and disseminate to our target audience of school-age children, families, community groups and teachers, a high volume of science-related programming. The core content of the initial set of programs will be extracted from one of the nation's most popular life science traveling exhibits called "Grossology." These distance-learning programs will originate from a central "studio" location and will be available during the day, after school, on weekends, during summer breaks and holidays. Supporting this effort will be Advanced Animations (designers of "Grossology" and "Experience Science!"), a science education consulting company.
The Shared Signing Science Planning Project will develop a prototype of a web-based Signing Science Pictionary. The prototype will be piloted to families and caretakers of deaf and hard of hearing children to study the feasibility and effectiveness of the learning technology and identify the activities that are most effective in helping deaf children learn life science at informal science centers. The project team will also compile a dictionary of science terms with the intention of including the terms in a full version of the Pictionary. The final Pictionary will be comprehensive; including scientific terms from life, physical, Earth, and space science and will be presented in animated sign language accompanied by written explanations and pictorial illustrations. The project will also produce a video guide with a description of activities that parents can implement with their children. The planning project will result in a prototype with 100 life science terms of species found at the three informal science centers the children and parents will visit to test the prototype. These informal sites are hands-on and exploratory featuring marine organisms and a range of terrestrial flora and fauna to touch and interact with. To prepare for the site visits, parents and caretakers of deaf or hard of hearing children will be taught how to use the Pictionary with children through a Flash-based movie that introduces the interactive features and assists the parents in engaging with their children in three activities using the signing scientific vocabulary. The preparatory vocabulary work with the parents and children will lay the educational foundation for the visits to the informal science education sites. Families will test the initial project prototypes with deaf children using a control group for comparison. Pre-tests will be used to assess childrens' vocabulary before use of the Pictionary. Follow up tests will test knowledge of the new words and will include field observations of children in museums, zoos, and farms, where the new terms will come to life in corresponding exhibits. The results of the ongoing evaluation will be compiled into a guide for other developers of similar materials for the deaf community, and will impact the development of the final project. The project will broaden participation of an underserved audience in STEM learning and generate new knowledge about how to effectively integrate emerging learning technologies into exhibits and programs for deaf learners.The project team includes TERC and Vcom3D and collaborators from Gallaudet University Regional Center at Northern Essex Community College, the College of the Holy Cross, and the Learning Center for Deaf Children. Participating informal science education institutions are represented by the EcoTarium, Davis' Farmland, and the Stone Zoo. These partnerships provide the necessary expertise and support for the proposed project to have significant impact on advancing STEM learning in informal settings for children with hearing disabilities through the use of assistive learning technologies.
A team of researchers and practitioners developed a museum program to coach families in the skills of scientific inquiry at interactive exhibits. The program was inspired by the increasing focus on scientific inquiry in schools and the growing number of open-ended exhibit designs in science museums. The development process involved major decisions in two arenas: which inquiry skills to teach, and what pedagogical strategies to use to teach them. After many rounds of refinement based on evaluation with families, the final program, called Inquiry Games, improved visitors' inquiry behavior in