This article addresses some of the challenges faced when attempting to evaluate the long-term impact of informal science learning interventions. To contribute to the methodological development of informal science learning research, we critically examine (Falk and Needham (2011) Journal of Research in Science Teaching, 48: 1–12.) study of the California Science Center's long-term impact on the Los Angeles population's understanding, attitude and interest in science. This study has been put forward as a good model of long-term impact evaluation for other researchers and informal science learning
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly
Campaigns by zoos, aquariums, and other civil society organizations are an important tool for promoting social changes that benefit the environment. Here, we evaluate a global biodiversity education campaign's impact through a repeated-measures survey of nearly 5000 visitors to 20 zoos and aquariums located in 14 countries. By comparing visitors’ pre- and post-visit responses combined across respondents, we found significant aggregate improvements in their biodiversity understanding and their knowledge of actions to help protect biodiversity. Respondents who reported seeing the education
The Tech Museum of Innovation (The Tech) in San Jose, California proposes to partner with NOAA to integrate Science On a Sphere (SOS) into The Tech's Exploration gallery and to facilitate the development of informal and formal learning programs. Exhibits and programs at The Tech focus on the integration of emerging technologies into hands-on visitor experiences. In 2004, The Tech partnered with NOAA, the Maryland Science Center (MSC), and a consortium of national science centers to explore the potential and effectiveness of SOS as a method of engaging and informing the general public about NOAA-related sciences. Initial testing of SOS at the Maryland Science Center revealed that SOS is a visually compelling and engaging medium for conveying complex scientific information to museum visitors. Ninety-eight percent of visitors tested regarded a facilitated SOS program as a good or excellent experience with strong visitor retention suggesting the potential of SOS as a compelling visitor tool. However, when the experience was not facilitated this retention dropped dramatically. Support from NOAA will enable The Tech to test SOS and NOAA data in a number of formats to determine the most effective ways to utilize this incredible technology. The results of this evaluation will be shared with other museums using SOS to improve its reach in teaching informal audiences and promoting interest in both STEM content and NOAA research. The SOS exhibit will bring together scientists, technologists, informal education specialists, and young users to unlock the educational potential of NOAA's datasets and further NOAA's educational plan. Hands-on experiences using SOS will engage visitors in meaningful explorations of NOAA data. The Tech Museum will make SOS accessible to people of all ages, backgrounds, and educational levels. All panel text, audio, and captions will be presented in both English and Spanish to allow greater accessibility for local audiences. SOS will provide the programming platform upon which to explore the educational opportunities of this gallery as it illustrates how data collected with remote sensing technologies is helping us understand and make predictions about our dynamic environment and the future of our planet. SOS will illustrate how these data collecting technologies assist us in developing our knowledge about our planet and its solar system.
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.
To promote ocean and climate change literacy that addresses the needs of the Gulf of Mexico region, six aquariums based on the Gulf are partnering to educate the communities on both risks and ways to contribute locally to sustainability. The aquariums are combining community outreach programs, stewardship promotion, social networking and workshops for non-formal educators to reach broad audiences throughout the Gulf in Florida, Mississippi, Alabama, Louisiana, Texas and Mexico. Each partner is developing content that emphasizes local ecosystems and consequences of climate change, tailoring stewardship activities to address them. Over five years, the aquariums will reach out to diverse audiences in their communities, which have populations that total over five million people. With evaluated programs, exhibits, and websites in place, the partners will be able to continue building stewardship and educating their communities after the award ends.
Through the Planet Earth Decision Theater project, the Science Museum of Minnesota and its partners will upgrade the museums current SOS exhibit with new SOS learning experiences, produce for the SOS community a new SOS film about the role of humans as the dominant agents of global change and two new presenter-led SOS programs based on the film with one version utilizing an audience feedback mechanism called iClickers. SMM also will complement its Planet Earth Decision Theater and the Maryland Science Center s SOS exhibit with the addition of Rain Table (a new interactive scientific visualization platform) at both locations to further reinforce the Anthropocene messages of the new SOS film and programs. SMM will conduct extensive evaluations of the new SOS film, programs and Rain Tables. SMM s partners on this project include the NOAA Environmental Visualization Lab, University of Minnesota's National Center for Earth-surface Dynamics, University of Minnesota's Antarctic Geospatial Information Center, University of Minnesota's Institute on the Environment, Maryland Science Center, Oregon Museum of Science and Industry, Institute for Learning Innovation, George Mason University s Center for Climate Change Communication, and the Electronic Visualization Laboratory at University of Illinois-Chicago.
Constructivist education theory postulates (Fosnot, 1996; Hein, 1998) that visitors learn actively and create their own meanings as they interact with the world. This raises challenges for visitor studies, since it may be difficult to plan a reasonable evaluation strategy for exhibitions if visitors’ actions and outcomes cannot be determined in advance. Constructivist theory also requires an appropriate evaluation approach (Hein, 1997). This paper illustrates the use of a combination of methodologies that allow visitors’ meanings and activities to emerge as they visit an interactive, non
DATE:
TEAM MEMBERS:
Elsa BaileyKerry BronnenkantJudith KelleyGeorge HeinMuseum of Science, Boston
The Experiment Benches at Science Museum of Minnesota are a series of multiple-outcome participatory exhibits located within the Experiment Gallery. Designed to give visitors a large degree of control over their learning while promoting and guiding meaningful scientific thought, they provide an opportunity for visitors to create and set their own experiments in order to explore a given phenomenon or topic. As such, they are designed o be responsive to a visitor's curiosity, allowing them to follow a personally directed inquiry.
The purpose of this summative evaluation project was to
The summative evaluation focuses on two project components: (1) an IMAX® Dome film, titled Coral Reef Adventure, and (2) an associated interactive exhibit, titled Weird, Wild and Underwater, intended to be displayed in museum and science center lobbies. The general goals for the summative evaluation study were to assess the appeal of "Coral Reef Adventure" film and the lobby exhibit; acquisition of scientific knowledge and understanding as related to the project’s learning goals and understanding of film topics; and the impact that the exhibit has on viewers of the film. A separate-sample
Educators have been increasingly interested in teaching mathematics in informal settings. However, there is little research on the actual learning outcomes of out-of-school mathematics instruction or the role of interest in explaining the outcomes. In this study, 793 12-year-old pupils were taken into a science center mathematics exhibition in Latvia and Sweden, measuring their prior knowledge of the contents of the exhibition, general cognitive competences and individual interest in school mathematics before the visit, and their situational interest and learning outcomes after the exhibition
DATE:
TEAM MEMBERS:
Mari-Pauliina VainikainenHannu SalmiHelena Thuneberg