Three Big Back Yard (BBY) evaluations were carried out during the summer of 2006. A timing and tracking study was conducted to understand how visitors utilized and interacted with the various components of the Big Back Yard. A total of 101 visitors were observed. Exit interviews were carried out with 96 visitors as they left the BBY. The exit interviews provided an understanding of visitors' motivations for visiting the BBY, what they knew about the BBY before they visited, and their experience with the golf course's content. A lobby interview was conducted with 160 visitors as they left the
DATE:
TEAM MEMBERS:
Amy Grack NelsonBeth JanetskiLevi WeinhagenScience Museum of Minnesota
During Fall 2008, the Science Museum of Minnesota's outreach staff visited schools throughout northern Minnesota to deliver the Energy Connections program. A summative evaluation was carried out to gauge the impact the program had on students' understanding of three of the program's key learning goals. As a result of participating in the Energy Connections program, students will learn that electrical energy can be generated from a variety of sources, which can be either renewable or non-renewable, and can have different environmental consequences/impact. People influence what decisions are
DATE:
TEAM MEMBERS:
Amy Grack NelsonClaire PhilippeScience Museum of Minnesota
During the summer of 2007, the Science Museum of Minnesota carried out a summative evaluation of the Kitty Andersen Youth Science Center's Park Crew program. The purpose of the evaluation was to understand how the youth staff implemented activities in the museum's Big Back Yard and what they learned about earth-surface processes, teaching others, and STEM careers. A mixed-methods design was used to gather evaluative data. Data collection methods included observations of youth presenting activities to visitors and pre- and post-interviews with the youth. A total of 11 youth (sophomore through
Starting in the summer of 2008, the DMNS enactor program began to be implemented throughout DMNS' diorama halls. Aligned with the 100th anniversary of the Museum, the enactor team began to portray turn-of-the-century characters to engage and educate visitors in the dioramas and permanent galleries.The Visitor Programs Department, who manage the enactor program, outlined several goals for the program in the diorama halls prior to the study: 1. To bring attention to the richness of the dioramas and to the individual objects/specimens within them. 2. To connect the visitors to those dioramas and
DATE:
TEAM MEMBERS:
Kathleen TinworthDenver Museum of Nature & Science
Listeners to The Really Big Questions (TRBQ) were asked to complete an online survey about their thoughts and experience with the program. Those interviewed cited that they valued the depth and thoughtfulness of the TRBQ programs and said they would like to see more programming produced. When asked, listeners reported that they would be willing to access programming via the Internet if it were not available by radio broadcast. They also reported that while they would like to see new programming as frequently as every week, they felt that quality and depth were more important than the number of
Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
Design Squad, produced by WGBH-Boston (http://www.wgbh.org), premiered on the Public Broadcasting Service in October 2009. Design Squad is a reality television series that encourages kids ages 9-12 years to “show off their smarts as they design and build working solutions for real-world clients—people who are hungry for clever ideas from a new generation of innovators.” Each season, the series culminates in a final episode when the top two scorers compete for a $10,000 college scholarship from the Intel Foundation. The underlying educational goals of Design Squad are to: (1) Increase students'
Edu, Inc. provided expertise and experience in user testing and evaluation of public outreach using new media for this project. In their role as advisor, Edu, Inc., observed that the website successfully satisfied the project goal of producing and testing five new models of interactive media and several feedback mechanisms to allow the public to register personal opinions on ethical scenarios regarding nanotechnology. The evaluators suggest that there is significant anecdotal evidence to recommend four practices tested by the web designers: 1. The potential of web comics as a media to present
DATE:
TEAM MEMBERS:
Douglas SpencerOregon Public BroadcastingJediah GrahamSusan Hibbard
Cracking the Maya Code is a one-hour PBS/NOVA adaptation of the two-hour feature documentary Breaking the Maya Code, based on the book of the same title by Michael D. Coe. Major funding for the project - which included website, eduational and outreach components - was provided by the National Science Foundation and the National Endowment for the Humanities. Knight Williams Research conducted a summative evaluation of Cracking the Maya Code. The evaluation examined the appeal, clarity, and educational impact of the program, focusing on educating Viewers about: The basic principles that underlie
SciGirls is a new weekly public television series produced by Twin Cities Public Television and supported by the National Science Foundation. Twelve half-hour animated and live action shows are accompanied by web and outreach activities in the fields of science, technology and engineering (STEM). Multimedia Research, an independent evaluation group, implemented a summative evaluation of SciGirls television programming with a rigorous randomized controlled trial design comparing treatment and control groups. Girls entering fifth grade were assigned randomly either to a treatment group (n = 42)
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
KQED's QUEST is a multi-year, multiple-media project seeking to influence the Bay Area's discussions about and activities related to science, the environment, and nature, with a particularly local focus. Rockman et al (REA), a San Francisco-based research and evaluation organization, conducted an evaluation of QUEST programming and activities over the course of several years. The evaluation examined general QUEST audiences, formal and informal educators' use of QUEST, and KQED's development and maintenance of a partnership among a number of Bay Area science and environmental organizations. The
DATE:
TEAM MEMBERS:
Elizabeth BandyMonnette FungKQED Northern California Public Media
Randi Korn & Associates, Inc. (RK&A) conducted a summative evaluation of the Gallery of California Art (Art Gallery) for the Oakland Museum of California (OMCA). The Art Gallery underwent an extensive reinstallation project, funded in part by a grant from The James Irvine Foundation. The OMCA Art Gallery reinstallation project focused on four goals: create a more welcoming, comfortable and lively Gallery of California; foster intergenerational learning; attract and engage an ethnically diverse community; and foster a personal connection between art and the visitor. The summative evaluation
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Oakland Museum of California