User Experience Research Consulting (UXR) conducted a summative evaluation of the NSF-ISE funded project, STEPS (Science Theater Education Programming System). The STEPS project brought together a network of informal science educators and contractors to create an interactive museum theater authoring and presentation system to increase educational capacity for small and large museums across the country. The software package includes an authoring tool for the creation of multimedia science theater productions; a presentation player for displaying the shows to audiences in museum theaters
DATE:
TEAM MEMBERS:
Jes A. KoepflerUniversity of Colorado, Denver
Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
Design Squad, produced by WGBH-Boston (http://www.wgbh.org), premiered on the Public Broadcasting Service in October 2009. Design Squad is a reality television series that encourages kids ages 9-12 years to “show off their smarts as they design and build working solutions for real-world clients—people who are hungry for clever ideas from a new generation of innovators.” Each season, the series culminates in a final episode when the top two scorers compete for a $10,000 college scholarship from the Intel Foundation. The underlying educational goals of Design Squad are to: (1) Increase students'
SciGirls is a new weekly public television series produced by Twin Cities Public Television and supported by the National Science Foundation. Twelve half-hour animated and live action shows are accompanied by web and outreach activities in the fields of science, technology and engineering (STEM). Multimedia Research, an independent evaluation group, implemented a summative evaluation of SciGirls television programming with a rigorous randomized controlled trial design comparing treatment and control groups. Girls entering fifth grade were assigned randomly either to a treatment group (n = 42)
DATE:
TEAM MEMBERS:
Barbara FlaggTwin Cities Public Television
Although there is a significant literature documenting the strength of informal science experiences in controlled or specialized settings, such as museums and science-focused youth programs it is not yet clear how best to regularly provide such opportunities in typical after-school programs--ones not established or specifically supported to test or implement grant-funded curricula or STEM approaches under specialized conditions. What's more, the majority of the 6.5 million children enrolled in after-school programs participate in typical programs. This study addressed this gap in the
In summary, this Planning Grant has demonstrated that the Fusion Science Theater mode successfully uses the dramatic structure of a play to create an investigative, participatory theater event that conveys science information, concepts, and methodology in a way that is engaging to children and attractive to parents and educators. The model can be transferred to others both by teaching others to develop their own shows and by training undergraduates to perform FST shows that have already been created. Finally, significant achievements have occurred in publicizing the model and in recruiting
DATE:
TEAM MEMBERS:
Joanne CantorMadison Area Technical College
In late spring 2010, Goodman Research Group, Inc. (GRG) was contracted by the Museum of Science, Boston, to conduct an outcomes evaluation of their educational live performance, The Amazing Nano Brothers Juggling Show (ANB). The show presents scientific concepts about atoms and nano science in a highly entertaining and engaging performance. The evaluation focused on the learning outcomes of children, adults, and middle school students. The goal of this evaluation was to examine the effectiveness of the show in increasing audiences' knowledge of and interest in nano science and nanotechnology
DATE:
TEAM MEMBERS:
Rachel SchechterMuseum of ScienceMolly PriedemanIrene GoodmanCarol Lynn Alpert
Listening to the River (LTTR) is a watershed science education project funded by the National Science Foundation. Its aims are to deliver education experiences in the local area, Traverse City, Michigan, and also to develop a model that could be replicated in other locations. Inverness Research was contracted by the Listening to the River project to conduct both formative and summative evaluations. Our work began in 2005 when the project received a planning grant, and continued through the life of the project. Primarily through interviews and product reviews, along with some direct program
DATE:
TEAM MEMBERS:
Mark St. JohnHeather MitchellDawn RoblesElizabeth HorschLaura StokesLand Information Access Assocation
The Wildlife Conservation Society (WCS) contracted Randi Korn & Associates, Inc. (RK&A) to evaluate its new exhibition, Madagascar!, located at the Bronx Zoo. Madagascar! showcases the wildlife and landscapes of the world's fourth largest island. Built in the historic Lion House, the exhibit transformed the interior, while preserving the historic building's Beaux-Arts beauty. The exhibit offers opportunities to see the island through the eyes of a conservationist at various interactive stations. RK&A worked with WCS to clarify its goals and objectives for Madagascar!. and to identify criteria
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Wildlife Conservation Society
"Evolution in Action: Isolation and Speciation in the Lower Congo" is a 9-minute documentary about a team of researchers working to understand what is driving the rapid evolution and speciation of fishes in the Lower Congo River. The evaluation was designed to probe the following: 1) Connection and Interest in the science content 2) Connections between the scientific story and other topics of personal interest 3) Implications of the multilingual versions for disseminating science to the public and to science educators The participants included international education students who work in
DATE:
TEAM MEMBERS:
Maritza MacdonaldAmerican Museum Natural History
The Learning Places evaluation went beyond the traditional approach of determining how well the project met its goals. In addition to that approach, we identified grounded theory. Five areas of theory and related hypotheses emerged: STEM learning, agents of change, teens as designers, community partner engagement and national collaboration. Each is described in detail in the full report, along with findings related to each of the project goals.
Veridian inSight performed an evaluation study in fall of 2009 to evaluate the effectiveness of an online training developed as an outreach component of the FETCH! with Ruff Ruffman series (http://pbskids.org/fetch/). The FETCH! Hands-On Science Training was designed for anyone who wants to lead science activities with elementary-age kids (including after-school providers, teachers, camp counselors, librarians, museum staff, parents, and others). The goals of the evaluation study were to assess the extent to which the FETCH! training was successful at:· Preparing afterschool educators