The Lineage project was a collaboration between Twin Cities Public Television and the Smithsonian’s National Museum of Natural History. The project included creation of a feature-length video program, a Virtual Reality game, and a set of hands-on activities designed for use by multigenerational audiences—all of which were incorporated as part of a series of seven Fossil Festival events at museums and other sites around the United States. This report presents findings from a set of external evaluation studies that examined impacts on families who participated in Fossil Festival events as well
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). Additional partner institutions were the ECHO Lake Aquarium and Science Center (ECHO), Lawrence Hall of Science (LHS) at the University of California, Berkeley, and Audience Viewpoints Consulting (AVC). The summative evaluation study was
The University of California, Davis Tahoe Environmental Research Center (TERC), UC Davis W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES), ECHO Lake Aquarium and Science Center (ECHO), UC Berkeley Lawrence Hall of Science (LHS), and the Institute for Learning Innovation (ILI) will study how 3-D visualizations can most effectively be used to improve general public understanding of freshwater lake ecosystems and Earth science processes through the use of immersive three-dimensional (3-D) visualizations of lake and watershed processes, supplemented by tabletop science activity stations. Two iconic lakes will be the focus of this study: Lake Tahoe in California and Nevada, and Lake Champlain in Vermont and New York, with products readily transferable to other freshwater systems and education venues. The PI will aggregate and share knowledge about how to effectively utilize 3-D technologies and scientific data to support learning from immersive 3-D visualizations, and how other hands-on materials can be combined to most effectively support visitor learning about physical, biological and geochemical processes and systems. The project will be structured to iteratively test, design, and implement 3-D visualizations in both concurrent and staggered development. The public will be engaged in the science behind water quality and ecosystem health; lake formation; lake foodwebs; weather and climate; and the role and impact of people on the ecosystem. A suite of publicly available learning resources will be designed and developed on freshwater ecosystems, including immersive 3-D visualizations; portable science stations with multimedia; a facilitator's guide for docent training; and a Developer's Manual to allow future informal science education venues. Project partners are organized into five teams: 1) Content Preparation and Review: prepare and author content including writing of storyboards, narratives, and activities; 2) 3-D Scientific Visualizations: create visualization products using spatial data; 3) Science Station: plan, design, and produce hands-on materials; 4) Website and Multimedia: produce a dissemination strategy for professional and public audiences; 4) Evaluation: conduct front-end, formative, and summative evaluation of both the 3-D visualizations and science activity stations. The summative evaluation will utilize a mixed methods approach, using both qualitative and quantitative methods, and will include focus groups, semi-structured interviews, web surveys, and in-depth interviews. Leveraging 3-D tools, high-quality visual displays, hands-on activities, and multimedia resources, university-based scientists will work collaboratively with informal science education professionals to extend the project's reach and impact to an audience of 400,000 visitors, including families, youth, school field trip groups, and tourists. The project will implement, evaluate, and disseminate knowledge of how 3-D visualizations and technologies can be designed and configured to effectively support visitor engagement and learning about physical, biological and geochemical processes and systems, and will evaluate how these technologies can be transferred more broadly to other informal science venues and schools for future career and workforce development in these critical STEM areas.
In partnership with the University of Pennsylvania's Graduate School of Education, The Franklin Institute Science Museum will develop, test, and pilot an exportable and replicable cyberlearning exhibit using two cutting edge technologies: Augmented Reality (AR) and Virtual Reality (VR). The exhibit's conceptualization is anchored in the learning research vision of the NSF-funded workshop Cyberinfrastructure for Education and Learning for the Future (Computing Research Association, 2005). The incorporation of VR and AR technologies into the Franklin Institute's electricity and Earth science exhibits is an innovation of traditional approaches to hands-on learning and will improve the quality of the learning experience for the primary audience of families with children and elementary school groups. The project has implications for future exhibit development and more broadly, will provide new research on learning on how to incorporate cyberlearning efforts into traditional exhibits. Fifteen participating exhibit developers across the ISE field will assist in the evaluation of the new exhibit; receive training on the design and development of VR and AR exhibits for their institutions; and receive full access to the exhibit's new software for implementation at their informal learning sites. The technology applications will be developed by Carnegie Mellon University's Entertainment Technology Center--leaders in the field in Virtual Reality design and development. Front-end and formative evaluation will be overseen internally by the Franklin Institute. The Institute for Learning Innovation will conduct the summative evaluation. Research will be conducted by the University of Pennsylvania's Graduate School of Education on the effects of AR and VR technologies on exhibit learning.
This report includes six separate formative evaluations conducted to inform the design and development of the deliverables for the 3D Visualization Tools for Enhancing Awareness, Understanding and Stewardship of Freshwater Ecosystems project. Deliverables were tested with both students and general visitor groups, with a focus on groups including late elementary and middle school children. Many different components were tested, including prototype versions of 3D visualizations, high-tech interactive experiences, apps on tablets and phones, and table top exhibits. Results are reported in each of
The National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). The purpose of the evaluation was to gather feedback from museum professionals and the general public about the proposed 3D visualization project and its related components. Additionally, the study aimed to assess the current understanding
DATE:
TEAM MEMBERS:
University of California, DavisSteven Yalowitz
The Children’s Museum developed From the Blue Planet to the Red Planet: Exploring Planetary Science to provide opportunities for students in grades 4 through 8, teachers, and families to learn about Mars exploration. The Museum partnered with the Connecticut Center for Advanced Technology (CCAT) on four teacher professional development modules related to aspects of planetary science: soil and plant study, air pressure, robotic exploration, and the comparison of Mars and Earth. Teachers who attended free workshops could bring students to the Museum for classroom and planetarium experiences. The Museum received support from Central Connecticut State University and technical advice from Phoenix Project scientists at JPL. The Museum created a timeline of Mars exploration history with video clips of milestones and an accompanying quiz kiosk. CCAT created virtual Mars drive-through experiences with which visitors could explore the planet. The Travelers ScienceDome Planetarium staff wrote, directed, and animated a full-dome planetarium program about the future study of Mars that was finished in December 2012. For over two years the Museum has sponsored free, monthly Mars Madness programs during which the general public can visit the exhibit, see a Mars-related planetarium program, and test out some of the hands-on activities developed for the school groups. The Museum hoped to reach a diverse audience, especially, those people who might otherwise not afford admission. We have produced four teacher professional development guides with hands-on activities, an exhibit for our facility, a dedicated website, and a planetarium program.
The overarching purpose of the Climate Literacy Zoo Education Network is to develop and evaluate a new approach to climate change education that connects zoo visitors to polar animals currently endangered by climate change, leveraging the associative and affective pathways known to dominate decision-making. Utilizing a polar theme, the partnership brings together a strong multidisciplinary team that includes the Chicago Zoological Society of Brookfield, IL, leading a geographically distributed consortium of nine partners: Columbus Zoo & Aquarium, OH; Como Zoo & Conservatory, St. Paul, MN; Indianapolis Zoo, IN; Louisville Zoological Garden, KY; Oregon Zoo, Portland, OR; Pittsburgh Zoo & PPG Aquarium, PA; Roger Williams Park Zoo, Providence, RI; Toledo Zoological Gardens, OH, and the organization Polar Bears International. The partnership leadership includes the Learning Sciences Research Institute at the University of Illinois at Chicago, and the Earth System Science Center at Pennsylvania State University. The partnership is joined by experts in conservation psychology and an external advisory board. The primary stakeholders are the diverse 13 million annual visitors to the nine partner zoos. Additional stakeholders include zoo docents, interpreters and educators, as well as the partnership technical team in the fields of learning innovations, technological tools, research review and education practice. The core goals of the planning phase are to a) develop and extend the strong multidisciplinary partnership, b) conduct research needed to understand the preconceptions, attitudes, beliefs, and learning modes of zoo visitors regarding climate change; and c) identify and prototype innovative learning environments and tools. Internal and external evaluations will be conducted by Facet Innovations of Seattle, WA. Activities to achieve these goals include assessments and stakeholder workshops to inventory potential resources at zoos; surveys of zoo visitors to examine demographic, socioeconomic, and technology access parameters of zoo visitors and their existing opinions; and initial development and testing of participatory, experiential activities and technological tools to facilitate learning about the complex system principles underlying the climate system. The long-term vision centers on the development of a network of U.S. zoos, in partnership with climate change domain scientists, learning scientists, conservation psychologists, and other stakeholders, serving as a sustainable infrastructure to investigate strategies designed to foster changes in public attitudes, understandings, and behavior surrounding climate change.
PERG conducted the formative and summative evaluations of Windows on Earth, a project led by the Center for Earth and Space Science Education (CESSE) at TERC. The project included numerous partners and contributors who focused on the development of the Windows on Earth software, exhibit and website, as well as four museums who participated in the development and evaluation process: Boston's Museum of Science, (MOS), the Smithsonian Air and Space Museum, (A&S), the St. Louis Science Center (SLSC), and the Montshire Museum of Science (MM) in Vermont. The project also coordinated some programming
DATE:
TEAM MEMBERS:
Judah LeblangJoan KarpTERC IncJodi Sandler
This document outlines front-end and formative evaluation findings including baseline use; improving attraction and holding power and interactions; and improving interfaces. While we found that people like the globe and will stay and interact especially with the redesigned kiosk, there is still room for improvement in support for information transfer and meaning generation, as well as opportunities for retaining user choice and control while adding usability features such as narration.
DATE:
TEAM MEMBERS:
Shawn RoweKatie StoferCéleste BarthelNancee HunterHatfield Marine Science Center