The Institute for Learning Innovation (ILI) conducted a summative evaluation of the NSF-ISE funded project, WolfQuest. WolfQuest is an educational video game, downloadable free of charge, developed by Eduweb (Educational Web Adventures, Inc.) and the Minnesota Zoo. WolfQuest intends to increase the knowledge of, interest in, and attitudes towards wolves and wolf habitats in children ages 9 to 15. This evaluation report synthesizes key analysis and findings from data based on a web survey of players, in-depth phone interviews of players, and content analysis of the game conversation forums
The evaluation was guided by four major questions: 1) How has math education changed at the afterschool programs sites over the course of the project? 2) Have children's experiences of informal math changed over the course of the project? 3) How have program staff changed in relation to math education? and 4) How is Mixing in Math being sustained at the program sites and disseminated to other programs and sites? Staff, program, and organizational factors all played a strong role in supporting high quality implementation of Mixing in Math. Mixing in Math was most successful where the
DATE:
TEAM MEMBERS:
Beth MillerTERC Inc.Kristin Lewis-Warner
RK&A was contracted by the Museum of the City of New York (MCNY) in New York City to conduct a program evaluation of its school programs. Specifically, the study explores the degree to which three school programs Traveling through Time, Leave it to the Beavers, and The Grid meet their objectives and reveals strengths and weaknesses of the programming. RK&A designed the program evaluation of MCNY school programs to use evaluation as a learning tool rather than a judgment tool. The evaluation took a close look at how the programs are implemented to make program improvements. The process began
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Museum of the City of New York
Columbia University Materials Research Science and Engineering Center (MRSEC) and New York Hall of Science (NYHOS) partnered to create Research and Rolling Exhibits (RARE). The project's goal is to showcase current research in science and make it accessible to the general public. Five Wondercarts were created over three years, from 2005 through 2008, highlighting topical scientific research and its relevance to the museum's target audience. The carts were programmed to engage families in conversation, letting their interest determine the direction of activities. In this manner Wondercarts
DATE:
TEAM MEMBERS:
Ellen GiustiNew York Hall of ScienceKathleen Condon
Liberty Science Center (LSC) received National Science Foundation (NSF) funding to develop, install and evaluate a 12,800-square foot, two-story permanent exhibition about skyscrapers. Skyscraper! is meant to showcase the architectural design and engineering, physics, and urban-related environmental science of skyscrapers. The Institute for Learning Innovation (ILI), a Maryland-based research and evaluation organization that focuses on lifelong learning in informal or free-choice settings, was contracted to conduct the summative exhibition evaluation. The purpose of the summative evaluation
DATE:
TEAM MEMBERS:
Kerry BronnenkantLiberty Science CenterClaudia Figueiredo
To define the most effective format for the new SCIGIRLS television series, we commissioned Barbara Flagg of Multimedia Research to conduct a series of focus groups to evaluate sample SCIGIRLS TV videos. She presented a video of three girls who explore the wetlands in North Carolina. We created two versions of this video - one 10 minutes long, the other 18 minutes. The results demonstrated that a longer format is more appealing, as it allows the relationships among the girls in the video to unfold, permits viewers to get to know more about them, and allows their science activities to unfold in
The Natural History Museum of Los Angeles County contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation to inform the reinstallation of the Ancient Latin America Hall. The study was conducted to examine visitors' experiences in the current exhibition, the nature of their connection with the objects on view, and their needs and preferences for interpretation. In-depth interviews were conducted with 20 English-speaking and 20 Spanish-speaking visitor groups, using a quota sampling method. Visitors were intercepted as they exited the current Ancient Latin America Hall
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
resourceevaluationMuseum and Science Center Exhibits
The Natural History Museum of Los Angeles County contracted Randi Korn & Associates, Inc. (RK&A) to conduct concept testing to inform the reinstallation of the Cenozoic/Age of Mammals Hall. The study was designed to examine visitors' perceptions and understanding of potential content, including their engagement with and knowledge of fossils, in general, and fossil mammals, in particular, and their familiarity with climate change. Open-ended, in-depth interviews were conducted with a random sample of English- and Spanish-speaking drop-in Museum visitors as they entered the existing Cenozoic/Age
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
Bill Nye the Science Guy is a widely-viewed, children's television series on science. Designed for eight-to-ten year olds, this series is shown in late afternoons Monday through Friday on PBS stations and on commercial television over the weekends. Rockman et al, an independent research group in San Francisco, was contracted by KCTS, Seattle, WA, to undertake an evaluation of the Bill Nye the Science Guy television series. The evaluation was charged with exploring the impact of the series on children at home, in school, and in other settings where children can watch television. Both the
DATE:
TEAM MEMBERS:
Rockman et alKCTS
resourceevaluationMuseum and Science Center Exhibits
Children's Museum of Houston (CMH) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Cyberchase: The Chase is On!--a National Science Foundation-funded exhibition designed to facilitate children's development of mathematical strategies and build their confidence in using these strategies in daily life. The exhibition used the popular children's television show, Cyberchase, as a vehicle to facilitate this learning. CMH identified the exhibition's target audience as children between the ages of 5 and 10 years, with an emphasis on children 7 years and older. To document the
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Children's Museum of Houston
Chicago Children's Museum (CCM) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Skyline a National Science Foundation-funded exhibition designed to facilitate family learning of Science, Technology, Engineering, and Math (STEM) concepts relevant to building stable structures. RK&A conducted all three phases of evaluation for Skyline front-end, formative, and summative; select findings from the summative evaluation are presented here. Skyline's target audience is families with children between the ages of 5 and 10 years of age. RK&A conducted 100 observations of children in the
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Chicago Children's Museum
The Space Science Institute (SSI) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate its traveling exhibition Giant Worlds. The evaluation documents the scope of Giant Worlds' impact and effectiveness for its target audience, children 8 to 13 years. Other specific objectives were to investigate how children interact with visitors and staff, to understand whether children felt like scientists or explorers, and to understand the extent to which children learned the exhibition's big ideas, such as giant planets were instrumental in the formation of Earth. Data were collected from
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Space Science Institute