The Institute for Learning Innovation (ILI) conducted a summative evaluation of the NSF-ISE funded project, WolfQuest. WolfQuest is an educational video game, downloadable free of charge, developed by Eduweb (Educational Web Adventures, Inc.) and the Minnesota Zoo. WolfQuest intends to increase the knowledge of, interest in, and attitudes towards wolves and wolf habitats in children ages 9 to 15. This evaluation report synthesizes key analysis and findings from data based on a web survey of players, in-depth phone interviews of players, and content analysis of the game conversation forums
The evaluation was guided by four major questions: 1) How has math education changed at the afterschool programs sites over the course of the project? 2) Have children's experiences of informal math changed over the course of the project? 3) How have program staff changed in relation to math education? and 4) How is Mixing in Math being sustained at the program sites and disseminated to other programs and sites? Staff, program, and organizational factors all played a strong role in supporting high quality implementation of Mixing in Math. Mixing in Math was most successful where the
DATE:
TEAM MEMBERS:
Beth MillerTERC Inc.Kristin Lewis-Warner
RK&A was contracted by the Museum of the City of New York (MCNY) in New York City to conduct a program evaluation of its school programs. Specifically, the study explores the degree to which three school programs Traveling through Time, Leave it to the Beavers, and The Grid meet their objectives and reveals strengths and weaknesses of the programming. RK&A designed the program evaluation of MCNY school programs to use evaluation as a learning tool rather than a judgment tool. The evaluation took a close look at how the programs are implemented to make program improvements. The process began
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Museum of the City of New York
The goal of a two-year SEPA grant, Phase II of a collaboration between Columbia University (CU) and the New York Hall of Science (NYHoS), was to enhance science teaching and learning through the use of portable laboratories and hands-on modules to study biotechnology and microscopy in middle and secondary school classes. Four multi-day workshops were held at the NYHoS to train teachers to use the portable laboratory kits. The primary goals of this evaluation are to assess: 1) the workshops' value for teaching the hands-on kit curriculum, 2) teachers' perception of the portable laboratories'
DATE:
TEAM MEMBERS:
Ellen GiustiNew York Hall of Science
Columbia University Materials Research Science and Engineering Center (MRSEC) and New York Hall of Science (NYHOS) partnered to create Research and Rolling Exhibits (RARE). The project's goal is to showcase current research in science and make it accessible to the general public. Five Wondercarts were created over three years, from 2005 through 2008, highlighting topical scientific research and its relevance to the museum's target audience. The carts were programmed to engage families in conversation, letting their interest determine the direction of activities. In this manner Wondercarts
DATE:
TEAM MEMBERS:
Ellen GiustiNew York Hall of ScienceKathleen Condon
Liberty Science Center (LSC) received National Science Foundation (NSF) funding to develop, install and evaluate a 12,800-square foot, two-story permanent exhibition about skyscrapers. Skyscraper! is meant to showcase the architectural design and engineering, physics, and urban-related environmental science of skyscrapers. The Institute for Learning Innovation (ILI), a Maryland-based research and evaluation organization that focuses on lifelong learning in informal or free-choice settings, was contracted to conduct the summative exhibition evaluation. The purpose of the summative evaluation
DATE:
TEAM MEMBERS:
Kerry BronnenkantLiberty Science CenterClaudia Figueiredo
Introduction The American Anthropological Association contracted with Minda Borun, Museum Solutions, to conduct a summative evaluation of the website http://www.understandingrace.com/ developed by s2n Media in connection with the Race exhibit. The exhibit, created by the AAA and the Science Museum of Minnesota, will travel to museums around the country. The website complements the exhibit and also stands on its own as a rich resource on the subject of race and human variation. The summative evaluation is based on an online survey. The link was posted on the website and data was collected using
DATE:
TEAM MEMBERS:
Minda BorunAmerican Anthropological Association
To define the most effective format for the new SCIGIRLS television series, we commissioned Barbara Flagg of Multimedia Research to conduct a series of focus groups to evaluate sample SCIGIRLS TV videos. She presented a video of three girls who explore the wetlands in North Carolina. We created two versions of this video - one 10 minutes long, the other 18 minutes. The results demonstrated that a longer format is more appealing, as it allows the relationships among the girls in the video to unfold, permits viewers to get to know more about them, and allows their science activities to unfold in
The Natural History Museum of Los Angeles County contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation to inform the reinstallation of the Ancient Latin America Hall. The study was conducted to examine visitors' experiences in the current exhibition, the nature of their connection with the objects on view, and their needs and preferences for interpretation. In-depth interviews were conducted with 20 English-speaking and 20 Spanish-speaking visitor groups, using a quota sampling method. Visitors were intercepted as they exited the current Ancient Latin America Hall
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
resourceevaluationMuseum and Science Center Exhibits
The Natural History Museum of Los Angeles County contracted Randi Korn & Associates, Inc. (RK&A) to conduct concept testing to inform the reinstallation of the Cenozoic/Age of Mammals Hall. The study was designed to examine visitors' perceptions and understanding of potential content, including their engagement with and knowledge of fossils, in general, and fossil mammals, in particular, and their familiarity with climate change. Open-ended, in-depth interviews were conducted with a random sample of English- and Spanish-speaking drop-in Museum visitors as they entered the existing Cenozoic/Age
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
Chicago Children's Museum (CCM) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Skyline a National Science Foundation-funded exhibition designed to facilitate family learning of Science, Technology, Engineering, and Math (STEM) concepts relevant to building stable structures. RK&A conducted all three phases of evaluation for Skyline front-end, formative, and summative; select findings from the summative evaluation are presented here. Skyline's target audience is families with children between the ages of 5 and 10 years of age. RK&A conducted 100 observations of children in the
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Chicago Children's Museum
The Space Science Institute (SSI) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate its traveling exhibition Giant Worlds. The evaluation documents the scope of Giant Worlds' impact and effectiveness for its target audience, children 8 to 13 years. Other specific objectives were to investigate how children interact with visitors and staff, to understand whether children felt like scientists or explorers, and to understand the extent to which children learned the exhibition's big ideas, such as giant planets were instrumental in the formation of Earth. Data were collected from
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Space Science Institute