King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
This article addresses some of the challenges faced when attempting to evaluate the long-term impact of informal science learning interventions. To contribute to the methodological development of informal science learning research, we critically examine (Falk and Needham (2011) Journal of Research in Science Teaching, 48: 1–12.) study of the California Science Center's long-term impact on the Los Angeles population's understanding, attitude and interest in science. This study has been put forward as a good model of long-term impact evaluation for other researchers and informal science learning
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly
Since 2000, the UK government has funded surveys aimed at understanding the UK public's attitudes toward science, scientists, and science policy. Known as the Public Attitudes to Science series, these surveys and their predecessors have long been used in UK science communication policy, practice, and scholarship as a source of authoritative knowledge about science-related attitudes and behaviors. Given their importance and the significant public funding investment they represent, detailed academic scrutiny of the studies is needed. In this essay, we critically review the most recently
Scientific institutions are increasingly embracing values of inclusivity and public engagement, but how do these two dimensions intersect? Science festivals have rapidly expanded in recent years as an outgrowth of these values, aiming to engage and educate the public about scientific topics and research. While resources invested in public engagement by scientists, universities, and governments are admirable in principle; this study indicates that their ambition to broaden the reach of science may be going unrealized in practice. Using data from three major UK science festivals, we demonstrate
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus
The cyberlearning community in the United States brings computer scientists and learning scientists together to design and study innovative learning technologies. The Cyberlearning Community Report: The State of Cyberlearning and the Future of Learning With Technology highlights examples of the exciting work our community is engaged in as we integrate the latest innovations in learning science and computer science into new research designs and methods. This work is also driving the need for new learning sciences in areas such as embodied cognition, identity, and affect, and requires advances
A majority of Americans rely on general outlets for science news but more say specialty sources get the facts right about science. This report presents findings from a survey conducted among a nationally representative sample of 4000+ adults from May 30-June 12, 2017. The survey asked about a range of issues from how the public encounters science news and assesses what and who to trust to other ways that people engage with science information in everyday life, including participation in citizen science research projects, hobbies, and consumption of entertainment programming built around
Citizen science is public participation in research and scientific endeavors. Different models are proliferating across various disciplines. Citizens volunteer as data collectors in science projects, collaborate with scientific experts on research design, and actively lead and carry out research. The last form of citizen science, in which citizens exert a high degree of control and ownership over scientific activities, tends to be action-oriented, with research conducted to support interventional activities or policy change. We call this form community citizen science, and it can be of
DATE:
TEAM MEMBERS:
Ramya ChariLuke MatthewsMarjory BlumenthalAmanda EdelmanTherese Jones
This project is developing and implementing a strong environmental literacy and science education program to accompany NOAA's Science on a Sphere (SOS) at The National Maritime Center's Nauticus museum. The program will use the SOS as a focal point to support learning about global oceanic and atmospheric circulations and their effect on local environments. The team is creating real-time global displays of environmental phenomena for the SOS from the expansive University of Wisconsin environmental satellite database. Computer visualization systems and user-driven interactive displays will allow viewers to move from global scale to regional and local scale in order to explore specific features of the phenomena being visualized and to understand them in greater detail. The displays will be integrated with high quality education materials that are aligned with national standards and specifically address the NOAA Education Strategic Plan. The teaming of the University of Wisconsin, Hampton University, and the National Maritime Center offers the opportunity to expose students from ethnic minority groups to various NOAA career paths and help produce graduates with solid technical backgrounds.
The Orlando Science Center has assembled a project team to create a unique environmental science learning tool: THE GLOBAL DECISION ROOM. Founded on, and enhancing, the Science On a Sphere (SOS) digital globe, the Global Decision Room is an interactive theatre that puts visitors in the role of being decision makers on behalf of the behavior of large populations on the planet. The results of global decisions relating to the environment are seen played out on SOS. The interactive strategy that is created for the Global Decision Room will be flexible and well integrated into the SOS software platform, making it possible to design other educational story scenarios that can use the same system. The Global Decision Room is designed as a multi-use, high impact, exciting content delivery platform. This proposal is based on a well developed initial educational premise, but the resulting construction of the Global Decision Room will be the perfect environment for other educational topics of interest to NOAA s outreach strategy. As new datasets become available in the future, new interactive stories will be developed for the Global Decision Room. The Orlando project brings with it significant additional funding from the Department of Education, the Department of Energy, the Orlando Utilities Commission, and the Florida Hydrogen Initiative, which will greatly leverage the funding from NOAA. Partners in the project include a strong technical team from the University of Central Florida and the Florida Solar Energy Center, interactive digital media experts from the Institute for Simulation and Training, the creative design team "i.d.e.a.s." located at Disney-MGM Studios, and the XhibitNet interactive multimedia design team.
This project aims to develop and implement residential and non-residential science camp and summer camp programs and related activities to over 1500 youth and teachers from 8 elementary and middle schools. NOAA's Multicultural Education for Resource Issues Threatening Oceans (MERITO) program will serve as a key outreach mechanism to reach underserved youth and their families. The proposed project will utilize existing ocean educational materials, including those developed by NOAA, in experiential learning programs for youth through Camp SEA (Science, Education, Adventure) Lab. The two major goals of the project are: (1) to develop and implement marine-oriented outdoor science and summer camps in close collaboration with the Monterey Bay National Marine Sanctuary, resulting in an effective model for dissemination of the Ocean Literacy Essential Principles and Fundamental Concepts to large numbers of youth and their teachers; and 2) to develop a model and a feasibility plan to implement the program across a broader geographical area, e.g. through other National Marine Sanctuaries.