This report presents findings of a summative evaluation by Randi Korn & Associates, Inc. (RK&A) of the Extreme Zone section in the Ecosystems exhibition, a project funded by the National Science Foundation at the California Science Center in Los Angeles. RK&A conducted in-depth interviews with adult, drop-in visitors to examine the degree to which the Extreme Zone meets its educational objectives: one sample was interviewed prior to entering the Ecosystems exhibition and a separate sample was interviewed after experiencing the exhibition. RK&A scored interviewees' responses using a rubric to
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.California Science Center
Three Big Back Yard (BBY) evaluations were carried out during the summer of 2006. A timing and tracking study was conducted to understand how visitors utilized and interacted with the various components of the Big Back Yard. A total of 101 visitors were observed. Exit interviews were carried out with 96 visitors as they left the BBY. The exit interviews provided an understanding of visitors' motivations for visiting the BBY, what they knew about the BBY before they visited, and their experience with the golf course's content. A lobby interview was conducted with 160 visitors as they left the
DATE:
TEAM MEMBERS:
Amy Grack NelsonBeth JanetskiLevi WeinhagenScience Museum of Minnesota
During Fall 2008, the Science Museum of Minnesota's outreach staff visited schools throughout northern Minnesota to deliver the Energy Connections program. A summative evaluation was carried out to gauge the impact the program had on students' understanding of three of the program's key learning goals. As a result of participating in the Energy Connections program, students will learn that electrical energy can be generated from a variety of sources, which can be either renewable or non-renewable, and can have different environmental consequences/impact. People influence what decisions are
DATE:
TEAM MEMBERS:
Amy Grack NelsonClaire PhilippeScience Museum of Minnesota
The Conservation Trust of Puerto Rico collaborated with RK&A to study the impact of its Citizen Science program, a NSF-funded project designed to involve local Spanish-speaking citizens in scientific research that contributes to growing knowledge about the Trust's biodiversity and land management efforts. The Citizen Science program underwent formative evaluation in 2009 and summative evaluation in 2010. Summative evaluation is discussed here. Summative evaluation was guided by four impacts developed using NSF's Framework for Evaluating Impacts of Informal Science Education Projects. These
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Conservation Trust of Puerto Rico
During the summer of 2007, the Science Museum of Minnesota carried out a summative evaluation of the Kitty Andersen Youth Science Center's Park Crew program. The purpose of the evaluation was to understand how the youth staff implemented activities in the museum's Big Back Yard and what they learned about earth-surface processes, teaching others, and STEM careers. A mixed-methods design was used to gather evaluative data. Data collection methods included observations of youth presenting activities to visitors and pre- and post-interviews with the youth. A total of 11 youth (sophomore through
MinnAqua, a program of the Minnesota Department of Natural Resource's Division of Fish and Wildlife, strives to educate Minnesota's youth about angling and aquatics and increase their interest and participation in angling. A summative evaluation was carried out to examine the effectiveness of MinnAqua clinics in terms of two evaluation questions: (a) To what extent are MinnAqua clinics meeting their goals? and (b) To what extent does participation in MinnAqua clinics increase children's knowledge of angling and aquatic resources as identified by the MinnAqua key concepts? To answer these
DATE:
TEAM MEMBERS:
Amy Grack NelsonMinnesota Department of Natural Resources
This report reviews the findings from The Botany of Desire summative evaluation as supported by the responses of the adult audience that viewed and gave feedback on the PBS version of the program when viewed at home. The evaluation examined the appeal, clarity, and educational impact of the program, focusing on the goals identified in the project's grant proposal to the Informal Science Education (ISE) division of the National Science Foundation (NSF), which provided funding for both The Botany of Desire project and the independent evaluation. These goals focused on educating Viewers about
DATE:
TEAM MEMBERS:
Valerie Knight-WilliamsKikim MediaDivan Williams Jr.Eveen ChanOra GrinbergTal SraboyantsDavid Tower
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This formative evaluation report summarizes the extent to which the Aquarium has made progress toward these goals in the first year of the project and provides an information base for identifying opportunities to strengthen
WHAT IS RIVERWEBS? RiverWebs is an educational documentary film about river food webs and recent pioneering reearch that has explored their relationships to forest food webs, produced for PBS broadcast and DVD distribution RiverWebs uses a dramatic true story shared by several ecologists to engage viewers in the life and science of river ecosystems, and in the scientific process itself RiverWebs used a filmmaking approach that was very collaborative with scientists and included complete transparency, cooperative development, and a content standards and accuracy committee to engage scientists
Overarching evaluation questions focus on continuous improvement, the degree to which the Salmon Camp project achieves its objectives with regards to students' skills and attitudes, as well as implementation and outcome questions. Evaluation activities are designed to probe five major areas: 1. Student Knowledge and Skills. To what extent do students gain experience with digital tools, field research, and workplace skills? 2. Student Attitudes. How are students' attitudes and self-efficacy as science students changing with involvement in Salmon Camp? How are career interests changing or
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
Overarching evaluation questions focus on continuous improvement, the degree to which the Salmon Camp project achieves it's objectives with regards to students' skills and attitudes, as well as implementation and outcome questions. Evaluation activities are designed to probe five major areas: 1. Student Knowledge and Skills. To what extent do students gain experience with digital tools, field research, and workplace skills? 2. Student Attitudes. How are students' attitudes and self-efficacy as science students changing with involvement in Salmon Camp? How are career interests changing or
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
KQED's QUEST is a multi-year, multiple-media project seeking to influence the Bay Area's discussions about and activities related to science, the environment, and nature, with a particularly local focus. Rockman et al (REA), a San Francisco-based research and evaluation organization, conducted an evaluation of QUEST programming and activities over the course of several years. The evaluation examined general QUEST audiences, formal and informal educators' use of QUEST, and KQED's development and maintenance of a partnership among a number of Bay Area science and environmental organizations. The
DATE:
TEAM MEMBERS:
Elizabeth BandyMonnette FungKQED Northern California Public Media