The broad purpose of this project is to contribute to capacity-building efforts—to strengthen the evaluation of programs and learning experiences in informal science education (ISE). We focus on improving the quality of summative evaluations, which have been called upon to inform decision-making and practice, contribute knowledge to the field, and help make the case for the value of informal learning. We previously developed a framework that synthesizes key elements of a high-quality summative evaluation. The framework has three dimensions: (a) examine the underlying rationale of the program, exhibition, experience, or intervention being evaluated; (b) balance methodological rigor with sensitivity to the informal context; and (c) prioritize uses of the evaluation by addressing stakeholders’ needs. Evaluators may draw on all three dimensions to provide summary judgments on the value of what was evaluated. We extend our work in two ways: (1) Examine how the framework could be used as a guiding lens for planning or conducting future or current summative evaluations. We will work with partners in informal science institutions to support and document their evaluation activities along the dimensions of evaluation quality, with the intent of improving the framework and creating concrete exemplars of its application in practice. (2) Conceptualize alternative models for enhancing professional training in ISE evaluation. We will research current programs and practices for building technical evaluation capacity, looking for promising and innovative approaches that include apprenticeship or “hands-on” experiences. This 18-month project (January 2015 through June 2016) is funded by the Gordon and Betty Moore Foundation.
This monograph has been created by the TEAMS (Traveling Exhibits At Museums of Science) Collaborative, a group of seven small U.S. science centers, to share experiences, observations, and lessons learned with the broader science museum field. Our intention is to help others who might be interested in forming a collaborative to work though some key issues, most of which have to do with the relationships between collaborative members, rather than more technical matters. We hope that this will provide a vision for others as to how collaboration among science centers can work. The monograph looks
DATE:
TEAM MEMBERS:
Charles TrautmannMark St. JohnDavid Goudy
This research was commissioned to explore visitors’ experiences in When the Dinosaurs Were Gone (later titled "When Crocodiles Ruled", a temporary exhibition at the Science Museum of Minnesota. As a summative evaluation, the research sought to address several issues and objectives: 1. overall impressions of the exhibition — visitors’ ratings of enjoyment, interest in the information, what they liked most, and what changes they would suggest (or not want) for a traveling version of this exhibit; 2. extent of use of the exhibition — amount of time spent in the exhibition and the extent to which
DATE:
TEAM MEMBERS:
People Places & Design ResearchScience Museum of MinnesotaJolene Hart
This summative evaluation of the exhibition Robots & Us was designed to investigate how visitor audiences used and experienced this exhibition in relation to the project’s objectives and challenges. Visitors’ expectations and perceptions in relation to the project’s content goals prompted the summative evaluation to focus on specific challenges including: attitudes and perceptions about technology, connections between robots and people, appeal to a broad audience, and reactions to specific exhibits.
DATE:
TEAM MEMBERS:
Jeff HaywardJolene HartScience Museum of Minnesota
The TEAMS Collaborative received three separate rounds of funding from the National Science Foundation; Inverness Research served as the external evaluator to the project for all three rounds of funding. This summative report details the return on NSF's long-term investment in the TEAMS Collaborative. It outlines the overall contributions of the project to participating museums, individual staff at those museums, and to the larger field of informal science education institutions. It also summarizes the ways in which the TEAMS Collaborative was able to effectively capitalize on NSF's investment
Researchers at the U.C. Davis will carry out observations of museum visitors to plan for a study of how visualizations affect visitors of an Earth Sciences exhibit using 3D technology. The researchers will be able to conduct an experimental study about how much participants in an education center learn from the model of earthquakes and of a model of the Lake Tahoe basin. The researchers will conduct a quasi-experiment of a sample of 100 visitors to the center at Lake Tahoe to study their experience with visualization and learning of science. The funding for this phase of the project will include the development of audience surveys, conducting focus groups to develop types of feedback, train staff to conduct data collection, and to conduct a literature review of technology visualization.
The Huntington asked Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation to study the impact of Plants are up to Something, a National Science Foundation (NSF)-funded exhibition in the Rose Hills Foundation Conservatory for Botanical Science. The study was specifically designed to examine visitors’ behavior in the exhibition, including engagement with science; understanding of the overall exhibition message; and understanding of and attitudes toward plants. RK&A conducted the first summative evaluation of Plants are up to Something in 2006 and it revealed findings worthy of
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Huntington Library, Art Collections, and Botanical Gardens
resourceevaluationProfessional Development, Conferences, and Networks
Children’s Discovery Museum of San Jose (CDM) contracted Randi Korn & Associates, Inc. (RK&A) to study the professional development component of Mammoth Discovery!, a NSF-funded project. The professional development part of the project convened a group of museum professionals (cohort participants) from select children’s museums to participate in several workshops, developed and conducted by CDM staff, and gatherings at a number of Association of Children’s Museums (ACM) conferences. RK&A conducted the evaluation to measure the impact of these experiences on the professional practice of cohort
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Children's Discovery Museum of San Jose
This report details the findings from an exploratory research study conducted by the Research and Evaluation Department at the Museum of Science, Boston about this exhibition, which came to be known as Provocative Questions (PQ). This investigation was guided by the following questions: 1. Will visitors engage in socio-scientific argumentation in an un-facilitated exhibit space, and are they aware that they are doing so? 2. How do the un-facilitated exhibits impact visitors’ socio-scientific argumentation skills? For the exploratory research study, visitors were cued to use the exhibits and
A range of sources support science learning, including the formal education system, libraries, museums, nature and Science Centers, aquariums and zoos, botanical gardens and arboretums, television programs, film and video, newspapers, radio, books and magazines, the Internet, community and health organizations, environmental organizations, and conversations with friends and family. This study examined the impact of one single part of this infrastructure, a Science Center. This study asked two questions. First, who in Los Angeles (L.A.) has visited the California Science Center and what factors
Researching Visual Arts Education in Museums and Galleries brings together case studies from Europe, Asia and North America, in a way that will lay a foundation for international co-operation in the future development and communication of practice-based research. The research in each of the cases directly stems from educational practice in very particular contexts, indicating at once the variety and detail of practitioners' concerns and their common interests.
Historically, most of the focus of science education has been on pre-college and college level schooling. Although some of the public's interest and knowledge about science is unquestionably shaped by compulsory schooling, given that the average adult spends only a fraction of their life participating in some kind of formal schooling, we argue that the contribution of school-based science learning to the long-term public understanding of science is limited, particularly for the majority of Americans who do not go on to post-secondary schooling. This article shows that the majority of the