This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Lineage project was a collaboration between Twin Cities Public Television and the Smithsonian’s National Museum of Natural History. The project included creation of a feature-length video program, a Virtual Reality game, and a set of hands-on activities designed for use by multigenerational audiences—all of which were incorporated as part of a series of seven Fossil Festival events at museums and other sites around the United States. This report presents findings from a set of external evaluation studies that examined impacts on families who participated in Fossil Festival events as well
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The proposed project broadens the utility of Public Participation in Scientific Research (PPSR) approaches, which include citizen science, to support new angles in informal learning. It also extends previous work on interactive data visualizations in museums to encompass an element of active contribution to scientific data. To achieve these goals, this project will develop and research U!Scientist (pronounced `You, Scientist!')--a novel approach to using citizen science and learning research-based technology to engage museum visitors in learning about the process of science, shaping attitudes towards science, and science identity development. Through the U!Scientist multi-touch tabletop exhibit, visitors will: (1) interact with scientific data, (2) provide interpretations of data for direct use by scientists, (3) make statements based on evidence, and (4) visualize how their data classifications contribute to globe-spanning research projects. Visitors will also get to experience the process of science, gaining efficacy and confidence through these carefully designed interactions. This project brings together Zooniverse, experts in interactive design and learning based on large data visualizations in museums, and leaders in visitor experience and learning in science museums. Over fifty thousand museum visitors are expected to interact annually with U!Scientist through this effort. This impact will be multiplied by packaging the open-source platform so that others can easily instantiate U!Scientist at their institution.
The U!Scientist exhibit development process will follow rapid iterations of design, implementation, and revision driven by evaluation of experiences with museum visitors. It will involve close collaboration between specialists in computer science, human-computer interaction and educational design, informal science learning experts, and museum practitioners. The summative evaluation will be based on shadowing observations, U!Scientist and Zooniverse.org logfiles (i.e., automated collection of user behavior metrics), and surveys. Three key questions will be addressed through this effort: Q1) Will visitors participate in PPSR activities (via the U!Scientist touch table exhibit) on the museum floor, despite all the distractions and other learning opportunities competing for their attention? If so, who engages, for how long, and in what group configurations? Q2) If visitors do participate, will they re-engage with the content after the museum visit (i.e., continue on to Zooniverse.org)? Q3) Does engaging in PPSR via the touch table exhibit--with or without continued engagement in Zooniverse.org after the museum visit--lead to learning gains, improved understanding of the nature of science, improved attitudes towards science, and/or science identity development?
The Exploratorium’s livestream of the August 2017 Total Solar Eclipse reached over 63 million people. Live programs in English and Spanish provided an informal learning experience outside the museum. Over 2.75 million people viewed on-demand videos on eclipse science. Sixty major media providers rebroadcast the livestream telescope feed.
Edu, Inc. conducted a summative evaluation of the NASA-funded project. The study reveals that the Exploratorium successfully disseminated eclipse science and STEM content through media channels and a mobile app, delivering a museum experience to online
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
The Environmental Scientist-in-Residence Program will leverage NOAA s scientific assets and personnel by combining them with the creativity and educational knowledge of the pioneer hands-on science center. To do this, the program will embed NOAA scientists in a public education laboratory at the Exploratorium. Working closely with youth Explainers, exhibit developers, and Web and interactive media producers at the Exploratorium, NOAA scientists will share instruments, data, and their professional expertise with a variety of public audiences inside the museum and on the Web. At the same time the scientists will gain valuable skills in informal science communication and education. Through cutting-edge iPad displays, screen-based visualizations, data-enriched maps and sensor displays, and innovative interactions with visitors on the museum floor, this learning laboratory will enable NOAA scientists and Exploratorium staff to investigate new hands-on techniques for engaging the public in NOAA s environmental research and monitoring efforts.
Focusing on climate change and its impact on coastal zones and marine life, Visualizing Change will build educator capacity in the aquarium community and informal science education field. Building on NOAA datasets and visualizations, we will provide interpreters with strategic framing communication tools and training using the best available social and cognitive research so that they can become effective climate change educators. Objectives are to (1) Develop and test four exemplary interpretive "visual narratives" that integrate research-based strategic communication with NOAA data visualization resources; (2) Test the application of the visual narratives in a variety of geographic regions, institution types (aquarium, science center, etc.), and using multiple technology platforms (Science on a Sphere, Magic Planet portable globe display, iPad/tablets, and video walls); (3) Build a professional development program for climate change interpretation with data visualization; and (4) Leverage existing networks for dissemination and peer support.
National Science Foundation (NSF) awarded an Informal Science Education (ISE) grant, since renamed Advancing Informal STEM Learning (AISL) to a group of institutions led by two of the University of California, Davis’s centers: the Tahoe Environmental Research Center (TERC) and the W.M. Keck Center for Active Visualization in Earth Sciences (KeckCAVES). Additional partner institutions were the ECHO Lake Aquarium and Science Center (ECHO), Lawrence Hall of Science (LHS) at the University of California, Berkeley, and Audience Viewpoints Consulting (AVC). The summative evaluation study was
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. How can we come to terms with the complex social impact of new cutting-edge fields like synthetic biology, robotics, genetics and
machine learning? In order to manage these transformative changes, people not only need to understand science and technology, but also to actively participate in shaping a world where our ability to control the building blocks of life and cognition is vastly expanded. The Transmedia Museum will use the interactive, engaging nature of
Great Lakes Science Center (GLSC), home of the NASA Glenn Visitor Center, is dedicated to sharing NASA content to inform, engage, and inspire students, educators, and the public. To further this goal, GLSC will develop a digital experience focused on collaboration and teamwork, emphasizing the benefits of a systems approach to STEM challenges. At the recently, fully renovated NASA Glenn Visitor Center, GLSC visitors will embark on an exciting mission of discovery, working in teams to collect real data from NASA objects and experiences. Mobile devices will become scientific tools as students, teachers, and families take measurements, access interviews with NASA scientists, analyze results from Glenn Research Center (GRC) test facilities, and link to NASA resources to assemble mission-critical information. This initiative will provide experiences that demonstrate how knowledge and practice can be intertwined, a concept at the core of the Next Generation Science Standards. GLSC’s digital missions will engage students and families in STEM topics through the excitement of space exploration. In addition, this project has the potential to inform the design of future networked visitor experiences in science centers, museums and other visitor attractions.