One way to ensure that an evaluation has "utility" is to use a participatory evaluation approach where the evaluator partners with primary users to carry out various phases of an evaluation. This article provides a case study of how participatory evaluation was used in an out-of-school youth development and employment program at the Science Museum of Minnesota's Kitty Andersen Youth Science Center. Youth staff participated in a series of evaluation workshops where they learned about evaluation, made their own meaning of evaluation data, generated recommendations to improve their museum work
The Science Museum of Minnesota conducted a study to find out how many visitors stopped at the Science on a Sphere (SOS) exhibit during their visit to the museum, visitors' prior knowledge of SOS, and why a visitor might chose not to visit SOS. A total of 189 visitors were interviewed. Findings included: - Groups of adults and children were more likely to visit SOS than groups composed of adults only. - Most visitors just happened across the exhibit during their visit rather than sought it out. - Of the visitors who did not stop at SOS, few were familiar with the exhibit. - Both visitors who
Front-end and formative evaluation of the Science Museum of Minnesota's Invention, Design, Engineering, and Art (IDEA) Cooperative youth development program was carried out from June 2008 - May 2009. The front-end and formative evaluation activities were guided by four overarching questions. 1. To what extent are youth able to apply IT and engineering process skills to design challenges? Can they come up with multiple solutions to challenges? Are they persistent problem solvers? 2. To what extent does the program provide youth with the necessary resources to help youth prepare for both
DATE:
TEAM MEMBERS:
Amy Grack NelsonMelissa FitzenbergerKathleen MillerClaire Phillippe
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a team experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative high school team, called the Invention Crew. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA Coop
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a teamâs experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative middle school team, called the Design Team. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA
Goodman Research Group, Inc. (GRG) conducted summative evaluation of the Journey to Planet Earth: The State of the Ocean's Animals project. GRG has served as external evaluator for Journey to Planet Earth since 1999. Journey to Planet Earth is a PBS series that explores the fragile relationship between people and the world they inhabit. The most recent evaluation included two components: 1) a viewer study of the Ocean's Animals episode in the series (hosted and narrated by Matt Damon), and 2) an evaluation of the outreach initiative that complemented the series. The broad goal of the
DATE:
TEAM MEMBERS:
Marianne McPhersonElizabeth BachrachIrene F GoodmanScreenscope, Inc.American Association for the Advancement of Science
Goodman Research Group, Inc. (GRG) conducted front-end evaluation of New Earth Explorers, a four-part science documentary series developed by Earth Images Foundation. The project's goal was to create a series that would target prime time PBS viewers with an aim to present information about earth science and relevant current research in a way that is engaging for viewers. In addition to the series, the project intended to develop related outreach with the intent of increasing STEM learning and promoting an understanding and appreciation of the earth sciences as an interesting field and
Goodman Research Group, Inc. (GRG) conducted a summative evaluation of the second season of NOVA scienceNOW, the PBS series that explores cutting-edge scientific and technological innovation in real time. (GRG also served as the external evaluator for NOVA scienceNOW during Season One). In addition to the television series, WGBH-TV developed a companion website, a series of high school classroom activities, and a Science Cafe outreach initiative, designed to discuss, in non-academic environments, the latest developments in science. The Season Two evaluation included: 1) a viewer study
This report is the third annual report summarizing data collected about the overall impact of the Saint Louis Science Center's educational programs on participants.
In MIT’s NSF-funded Terrascope Youth Radio (TYR) program, urban youth, many from groups historically underrepresented in the sciences, worked as paid interns who received training in radio production, reporting and writing stories with scientific content and audio storytelling to create environmentally oriented audio pieces that were engaging and relevant to their own and their peers’ lives. Teen interns participated between July 2008 and Autumn 2012. TYR’s goals were to improve a broad audience of teens’ engagement with, knowledge of, and attitudes about science, technology, engineering, and
The Westside Science Club (WSSC) is an out-of-school time opportunity that brings participant-directed STEM activities to under-resourced late-elementary and middle school students in low-income housing units in Los Angeles. WSSC and CCI Solar began a collaboration in 2012 with funding from the NSF to connect research scientists from Caltech with the underserved youth in the club. Another community partner, Wildwood School, provided high school students to act as near-peer mentors for the club members. CCI Solar's research on the efficient and economical conversion of solar energy into stored chemical fuel provides an entry point for informal science education activities designed to introduce pre-high school participants to basic chemistry and related STEM concepts such as physics and plant biology. Activities were largely student driven, though lessons were developed by the team of facilitators including the club's founder Ben Dickow, Wildwood teacher Levi Simons, and students, post-docs, and staff from Caltech. Each lesson was tied to CCI Solar's research through a mind-map of related chemistry concepts. The activities were mostly intended to be "maker-type" experiences that allowed the club members to follow their own interests and questions. Caltech students and postdocs from CCI Solar helped deliver activities while honing their science communication skills with the young WSSC audience. The team is currently adapting the model of this successful collaboration to develop another science club in a different Los Angeles community. Two-years of lessons developed from this project, an evaluation of the project by Kimberly Burtnyk of Science for Society, and a model on how to replicate such a program are available in the project final report below. This was a two-year pilot program that was completed in July 2014.
What motivates kids to take multiple programs at the Minnesota Zoo? What makes Minnesota Zoo programs so comfortable and engaging that some kids just keep coming back? How do these experiences support kids’ interest in animals and wildlife conservation? The Minnesota Zoo (MN Zoo) offers over a dozen educational programs for youth tailored to encourage exploration of “what makes the MN Zoo tick.” After 10 years of programming for hundreds of youth, a cluster of youth return again and again to learn more about animal care, wild wildlife conservation, zoo work, and volunteer opportunities