This Handbook is geared to the experienced researcher who is a novice evaluator. It orients the researcher to evaluation practice, with an emphasis on the use of qualitative techniques to augment quantitative measures.
The March 12-13, 2007 workshop at NSF on informal science education evaluation brought together a distinguished group of experts to discuss how impact categories might be best applied to various types of informal learning projects. This publication is an outcome of that meeting. The authors have strived to make the sections as helpful as possible given the primary focus of this workshop on project impacts. It should be viewed as part of an ongoing process to improve the ways in which evaluation can most benefit ISE projects, NSF, and the field. The publication is intended to help those
Presentation slides on submitting competitive Advancing Informal STEM Learning (AISL) proposals, originally presented at the 2012 Association of Science-Technology Centers (ASTC) Annual Conference
The first phase of the evaluation, a front-end visitor study, assessing visitors' knowledge of and interest in space science and the cosmos, was conducted in May and June of 2000 at Boston's Museum of Science (MOS). The evaluation's second phase, a formative evaluation of the exhibition prototype, was completed in February of 2001 at the MOS. This summative report represents the third round of the evaluation process conducted by PERG, and is an evaluation of the current Cosmic Questions exhibition and related activities, based on data obtained by evaluators at two sites Boston's Museum of
DATE:
TEAM MEMBERS:
Joan KarpJudah LeblangSusan Baker CohenHarvard-Smithsonian Center for Astrophysics
PlanetMania is an iOS and Android mobile app game produced by Maryland Science Center and Eduweb, Inc. in 2012 to accompany the Center's latest permanent exhibit, entitled Life Beyond Earth. Multimedia Research carried out a summative evaluation of the PlanetMania app, focusing on the app's usage in the exhibit, appeal, value and learning outcomes. The evaluation is a pre-post quasi-experimental study in which a sample of 24 9-11 year olds were interviewed prior to and after experiencing the app and exhibit as well as observed during their exposure to the app and exhibit. The app game combines
PERG conducted the formative and summative evaluations of Windows on Earth, a project led by the Center for Earth and Space Science Education (CESSE) at TERC. The project included numerous partners and contributors who focused on the development of the Windows on Earth software, exhibit and website, as well as four museums who participated in the development and evaluation process: Boston's Museum of Science, (MOS), the Smithsonian Air and Space Museum, (A&S), the St. Louis Science Center (SLSC), and the Montshire Museum of Science (MM) in Vermont. The project also coordinated some programming
DATE:
TEAM MEMBERS:
Judah LeblangJoan KarpTERC IncJodi Sandler
Our Year 3 formative evaluation of Go Botany, a four-year NSF-funded project focused on botanical learning, centered on tracking the continued development and the launch of the Go Botany Simple Key, which contains botanical data on more than 1200 native plants in the New England region. The project is a collaboration between the New England Wild Flower Society and three partnering institutions: The Montshire Museum of Science in Norwich, VT; The Chewonki Foundation in Wiscasset, Maine; and the Yale Peabody Museum on Natural History in New Haven, CT. During Year 3, the Go Botany Simple Key was
DATE:
TEAM MEMBERS:
Judah LeblangNew England Wild Flower Society
In 2009, the Monterey Bay Aquarium began looking at new ways to interpret its Seafood Watch program. This nationwide conservation program strives to educate the public about the importance of buying sustainable seafood. As part of the program, the Aquarium publishes a printed pocket guide that lists the types of seafood consumers should buy and the types they should avoid. (For more information, visit www.seafoodwatch.org.) Over the years, several zoos, aquariums and museums that partner with the Aquarium have expressed interest in displaying an exhibit to encourage more of their visitors to
The summative evaluation of the National Science Foundation (NSF)-funded Geometry Playground traveling exhibition was a two-year naturalistic study to examine (a) the ways and extent to which the exhibition promoted the practice of spatial reasoning skills, and appreciation for geometry, and (b) its influence on museum professionals' thinking across three venues: the Exploratorium (San Francisco, CA), the Science Museum of Minnesota (St. Paul, MN), and the Don Harrington Discovery Center (Amarillo, TX). The study took place from December 2009 through November 2011 and included five site visits
The American Museum of Natural History (AMNH) received a NOAA-ELG grant for a three-year project, entitled Exploring Earth Systems: Expanding Data Visualizations Experiences for Museum Learners (or Data Visualizations). The project focuses on the development, testing, and distribution of Visualizations for the Earth and Bio content strands of the AMNH's Science Bulletins program. The Visualizations are short media pieces that use satellite data to tell the story of Earth processes on land, in the oceans, and in the atmosphere, with the larger goals of helping viewers to understand the dynamic
DATE:
TEAM MEMBERS:
Susan FoutzAmerican Museum of Natural History
The American Museum of Natural History (AMNH) received a NOAA-ELG grant for a three-year project, entitled Exploring Earth Systems: Expanding Data Visualizations Experiences for Museum Learners (or Data Visualizations). The project focuses on the development, testing, and distribution of Visualizations for the Earth and Bio content strands of the AMNH's Science Bulletins program. The Visualizations are short media pieces that use satellite data to tell the story of Earth processes on land, in the oceans, and in the atmosphere, with the larger goals of helping viewers to understand the dynamic
DATE:
TEAM MEMBERS:
Susan FoutzAmerican Museum of Natural History
This document outlines front-end and formative evaluation findings including baseline use; improving attraction and holding power and interactions; and improving interfaces. While we found that people like the globe and will stay and interact especially with the redesigned kiosk, there is still room for improvement in support for information transfer and meaning generation, as well as opportunities for retaining user choice and control while adding usability features such as narration.
DATE:
TEAM MEMBERS:
Shawn RoweKatie StoferCéleste BarthelNancee HunterHatfield Marine Science Center