User Experience Research Consulting (UXR) conducted a summative evaluation of the NSF-ISE funded project, STEPS (Science Theater Education Programming System). The STEPS project brought together a network of informal science educators and contractors to create an interactive museum theater authoring and presentation system to increase educational capacity for small and large museums across the country. The software package includes an authoring tool for the creation of multimedia science theater productions; a presentation player for displaying the shows to audiences in museum theaters
DATE:
TEAM MEMBERS:
Jes A. KoepflerUniversity of Colorado, Denver
This study was conducted to document how members of the Design Challenges team currently assist visitors as they engage in engineering design activities as a way of informing the practices of informal technology education at the Museum of Science about the types of scaffolds and supports visitors need when engaging in future engineering design labs in exhibitions. To collect data for this study, educators from the Design Challenges team were observed as they helped visitors complete the Solar Cars activity in Investigate! The Solar Cars activity was not designed as an engineering design lab
MinnAqua, a program of the Minnesota Department of Natural Resource's Division of Fish and Wildlife, strives to educate Minnesota's youth about angling and aquatics and increase their interest and participation in angling. A summative evaluation was carried out to examine the effectiveness of MinnAqua clinics in terms of two evaluation questions: (a) To what extent are MinnAqua clinics meeting their goals? and (b) To what extent does participation in MinnAqua clinics increase children's knowledge of angling and aquatic resources as identified by the MinnAqua key concepts? To answer these
DATE:
TEAM MEMBERS:
Amy Grack NelsonMinnesota Department of Natural Resources
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This formative evaluation report summarizes the extent to which the Aquarium has made progress toward these goals in the first year of the project and provides an information base for identifying opportunities to strengthen
Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
Design Squad, produced by WGBH-Boston (http://www.wgbh.org), premiered on the Public Broadcasting Service in October 2009. Design Squad is a reality television series that encourages kids ages 9-12 years to “show off their smarts as they design and build working solutions for real-world clients—people who are hungry for clever ideas from a new generation of innovators.” Each season, the series culminates in a final episode when the top two scorers compete for a $10,000 college scholarship from the Intel Foundation. The underlying educational goals of Design Squad are to: (1) Increase students'
This report summarizes results from an evaluation of Design Squad's Season 2 Activity Guide and accompanying television shows in middle school classroom settings.
The Solomon R. Guggenheim Museum contracted RK&A for the 2006-2010 study The Art of Problem Solving (APS). The APS study was the second of two studies funded by the U.S. Department of Education's Arts in Education Model Development and Dissemination (AEMDD) grant (the former being the 2003-2005 study Teaching Literacy Through Art) that examined the Guggenheim's long-standing teaching artist in residency program Learning Through Art (LTA). The APS study was designed specifically to determine the effectiveness of the LTA program in teaching problem-solving skills. The APS study measured both
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Solomon R. Guggenheim Museum
SciGirls is a new weekly public television series produced by Twin Cities Public Television and supported by the National Science Foundation. Twelve half-hour animated and live action shows are accompanied by web and outreach activities in the fields of science, technology and engineering (STEM). Multimedia Research, an independent evaluation group, implemented a summative evaluation of SciGirls television programming with a rigorous randomized controlled trial design comparing treatment and control groups. Girls entering fifth grade were assigned randomly either to a treatment group (n = 42)
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
With funding from Atlantic Philanthropies, the Museum of the City of New York (MCNY) contracted Randi Korn & Associates, Inc. (RK&A) to evaluate the Traveling Through Time (TTT) program, a 90-minute fieldtrip program facilitated by museum educators that explores the early history of New York City through objects and inquiry. The study explores whether and to what extent the TTT program affects students' attitudes about history and history museums, history knowledge, and history-related skills. In the last 30 years, there has been little rigorous research that investigates the outcomes
DATE:
TEAM MEMBERS:
Randi Korn & Associates Inc.Museum of the City of New York
In Spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health Program (P2H). The Museum designed P2H, a three-year program funded by the Colorado Health Foundation, to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. This evaluation report offers the findings of the baseline process evaluation and climate assessment, which will serve as a foundation for future evaluation efforts. Using various
DATE:
TEAM MEMBERS:
JVA Consulting, LLCDenver Museum of Nature & Science
Although there is a significant literature documenting the strength of informal science experiences in controlled or specialized settings, such as museums and science-focused youth programs it is not yet clear how best to regularly provide such opportunities in typical after-school programs--ones not established or specifically supported to test or implement grant-funded curricula or STEM approaches under specialized conditions. What's more, the majority of the 6.5 million children enrolled in after-school programs participate in typical programs. This study addressed this gap in the