King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
This article addresses some of the challenges faced when attempting to evaluate the long-term impact of informal science learning interventions. To contribute to the methodological development of informal science learning research, we critically examine (Falk and Needham (2011) Journal of Research in Science Teaching, 48: 1–12.) study of the California Science Center's long-term impact on the Los Angeles population's understanding, attitude and interest in science. This study has been put forward as a good model of long-term impact evaluation for other researchers and informal science learning
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly
Since 2000, the UK government has funded surveys aimed at understanding the UK public's attitudes toward science, scientists, and science policy. Known as the Public Attitudes to Science series, these surveys and their predecessors have long been used in UK science communication policy, practice, and scholarship as a source of authoritative knowledge about science-related attitudes and behaviors. Given their importance and the significant public funding investment they represent, detailed academic scrutiny of the studies is needed. In this essay, we critically review the most recently
Campaigns by zoos, aquariums, and other civil society organizations are an important tool for promoting social changes that benefit the environment. Here, we evaluate a global biodiversity education campaign's impact through a repeated-measures survey of nearly 5000 visitors to 20 zoos and aquariums located in 14 countries. By comparing visitors’ pre- and post-visit responses combined across respondents, we found significant aggregate improvements in their biodiversity understanding and their knowledge of actions to help protect biodiversity. Respondents who reported seeing the education
Scientific institutions are increasingly embracing values of inclusivity and public engagement, but how do these two dimensions intersect? Science festivals have rapidly expanded in recent years as an outgrowth of these values, aiming to engage and educate the public about scientific topics and research. While resources invested in public engagement by scientists, universities, and governments are admirable in principle; this study indicates that their ambition to broaden the reach of science may be going unrealized in practice. Using data from three major UK science festivals, we demonstrate
The Tech Museum of Innovation (The Tech) in San Jose, California proposes to partner with NOAA to integrate Science On a Sphere (SOS) into The Tech's Exploration gallery and to facilitate the development of informal and formal learning programs. Exhibits and programs at The Tech focus on the integration of emerging technologies into hands-on visitor experiences. In 2004, The Tech partnered with NOAA, the Maryland Science Center (MSC), and a consortium of national science centers to explore the potential and effectiveness of SOS as a method of engaging and informing the general public about NOAA-related sciences. Initial testing of SOS at the Maryland Science Center revealed that SOS is a visually compelling and engaging medium for conveying complex scientific information to museum visitors. Ninety-eight percent of visitors tested regarded a facilitated SOS program as a good or excellent experience with strong visitor retention suggesting the potential of SOS as a compelling visitor tool. However, when the experience was not facilitated this retention dropped dramatically. Support from NOAA will enable The Tech to test SOS and NOAA data in a number of formats to determine the most effective ways to utilize this incredible technology. The results of this evaluation will be shared with other museums using SOS to improve its reach in teaching informal audiences and promoting interest in both STEM content and NOAA research. The SOS exhibit will bring together scientists, technologists, informal education specialists, and young users to unlock the educational potential of NOAA's datasets and further NOAA's educational plan. Hands-on experiences using SOS will engage visitors in meaningful explorations of NOAA data. The Tech Museum will make SOS accessible to people of all ages, backgrounds, and educational levels. All panel text, audio, and captions will be presented in both English and Spanish to allow greater accessibility for local audiences. SOS will provide the programming platform upon which to explore the educational opportunities of this gallery as it illustrates how data collected with remote sensing technologies is helping us understand and make predictions about our dynamic environment and the future of our planet. SOS will illustrate how these data collecting technologies assist us in developing our knowledge about our planet and its solar system.
Using the relative strengths of each museum, the Science On a Sphere Partnership between the Maryland Science Center and the Science Museum of Minnesota has developed two complementary exhibit approaches to Science On a Sphere (SOS). Audiences interacting with SOS are able to observe global connections in geophysical phenomena not possible with any two dimensional representation of the Earth. The goal of the project is for museum visitors, particularly underserved audiences, to comprehend how human activities are influencing global processes now and might do so in the future. The project also tests new partnership models for working with NOAA and other science research organizations to broaden the educational impact on all groups.
The primary goal of MAST-3 is to increase the diversity of students, particularly those from underrepresented groups, electing careers in NOAA related marine sciences. This is done through a multidisciplinary program that engages students in NOAA-related marine research, and explores marine policy, the heritage of African Americans and Native Americans in the coastal environment, and seamanship. MAST students use the Chesapeake Bay to understand efforts to protect, restore and manage the use of coastal and ocean resources through an ecosystem approach to management. To do this, Hampton University has formed partnerships with various NOAA labs/sites, several university laboratories, the USEPA, various museums, the Chesapeake Bay Foundation, and the menhaden fishing industry.
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus
A majority of Americans rely on general outlets for science news but more say specialty sources get the facts right about science. This report presents findings from a survey conducted among a nationally representative sample of 4000+ adults from May 30-June 12, 2017. The survey asked about a range of issues from how the public encounters science news and assesses what and who to trust to other ways that people engage with science information in everyday life, including participation in citizen science research projects, hobbies, and consumption of entertainment programming built around
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.