The March 12-13, 2007 workshop at NSF on informal science education evaluation brought together a distinguished group of experts to discuss how impact categories might be best applied to various types of informal learning projects. This publication is an outcome of that meeting. The authors have strived to make the sections as helpful as possible given the primary focus of this workshop on project impacts. It should be viewed as part of an ongoing process to improve the ways in which evaluation can most benefit ISE projects, NSF, and the field. The publication is intended to help those
From May 1 to July 7 of 2008, volunteers had the opportunity to provide feedback on their volunteer experience and offer suggestions for improvement. The survey was a follow up to the May 2007 volunteer survey. The 2008 survey was initially only available as a web-based survey. Volunteers with email accounts were sent a link to the survey. A kiosk was also available in the volunteer check-in area for volunteers to complete the survey while at the museum. After the first month, the survey was made available in paper format in the volunteer break room to help increase the response rate. Paper
DATE:
TEAM MEMBERS:
Sarah CohnScience Museum of Minnesota
This study was designed to assess qualitative and quantitative impacts that the enactor program has on visitor experience at the Denver Museum of Nature and Science (DMNS), using two temporary exhibitions (Benjamin Franklin: In Search of a Better World and Titanic: The Artifact Exhibition) as examples. Of interest was capturing the unique visitor experience that enactors provide by combining visitor engagement, education and interaction. In turn, this affords opportunities to better consider enactor and/or theater-based programming for other areas of the Museum (temporary and permanent) in the
Although there is a significant literature documenting the strength of informal science experiences in controlled or specialized settings, such as museums and science-focused youth programs it is not yet clear how best to regularly provide such opportunities in typical after-school programs--ones not established or specifically supported to test or implement grant-funded curricula or STEM approaches under specialized conditions. What's more, the majority of the 6.5 million children enrolled in after-school programs participate in typical programs. This study addressed this gap in the
Chicago Children's Museum (CCM) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Skyline a National Science Foundation-funded exhibition designed to facilitate family learning of Science, Technology, Engineering, and Math (STEM) concepts relevant to building stable structures. RK&A conducted all three phases of evaluation for Skyline front-end, formative, and summative; select findings from the summative evaluation are presented here. Skyline's target audience is families with children between the ages of 5 and 10 years of age. RK&A conducted 100 observations of children in the
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Chicago Children's Museum
Rockman et al (REA) conducted an impact study of the educational, two-hour, television special, Exploring Time, and the value-add of its associated web site, www.exploringtime.org. The program's objective is to increase the public's understanding of change over time the multitude of changes that are occurring in the present, but at rates too slow or too fast to be seen. This evaluation explored the extent to which the programs and web site met this overall objective by looking at three impacts of the resources: (1) Comprehension of the program's content, (2) Knowledge and understanding gained
DATE:
TEAM MEMBERS:
Saul RockmanTwin Cities Public Television
This report highlights the findings from Inverness Research's summative study of the TEAMS III Collaborative. In particular, it highlights the lessons learned from a study to incorporate research on how to design exhibits that promote more effective conversations into the exhibit development process.
Most tabletop research presents findings from lab-based user studies, focusing on specific interaction techniques. This means we still know little about how these new interfaces perform in real life settings and how users appropriate them. This paper presents findings from a field study of an existing interactive table in a museum of natural history. Visitors were found to employ a wide variety of gestures for interacting; different interface elements invited different types of gesture. The analysis highlights challenges and design conflicts in the design of tabletop interfaces for public
SoundVision Productions is developing and distributing a series of ten, hour-long public radio documentaries that will explore the turbulent boundary between science and the humanities, capturing the present moment of tremendous scientific and scholarly ferment with the unique and intimate power of radio. By introducing the radio audience to the thoughts and voices of some of the world\'s most accomplished scientists, in conversations with the counterparts in the humanities, the series will look at recent developments in science including physics, molecular and cell biology, environmental science, cognitive psychology and neuroscience, and the multiple disciplines of the life sciences reflecting the increasingly subtle and widespread application of evolutionary theory. In each program, a careful account of new scientific ideas and discoveries will be placed within the context of historical and contemporary thought about the human and natural worlds. Barinetta Scott, the Executive Producer, has most recently been the Executive Producer for the highly regarded NSF funded NPR series, "The DNA Files." In developing this project, she will work closely with an advisory committee that includes: John Avise, Research Professor, Dept. of Genetics, University of Georgia Samuel Barondes, Professor and Director of the University of California San Francisco\'s Center for Neurobiology and Psychiatry Terrence Deacon, Associate Professor of Anthropology, Boston University Anne Foerst, Professor of Computer Science and Theology, St. Bonaventure University Ursula Goodenough, Dept. of Biology, Washington University, St. Louis William Irons, Professor of Anthropology, Northwestern University Gordon Kane, Professor of Physics, University of Michigan Jim Miller, Senior Program Associate for the AAAS Program of Dialogue Between Science and Religion W. Mark Richardson, Episcopal Priest, Associate Professor of Systematic Theology, General Theological Seminary Holmes Rolston, University Distinguished Professor in the Department of Philosophy, Colorado State University Michael Ruse, Professor of the Philosophy of Biology and Ethics, at Florida State University Mary Evelyn Tucker, Professor of Religion at Bucknell University Dorothy Wertz, Senior Scientist; Social Science, Ethics, and the Law; The Shriver Center.
FETCH with Ruff Ruffman is a daily half-hour PBS television series with accompanying Web and outreach activities targeted to 6- to 10-year olds. The program brings science learning to young children by uniquely blending live-action with animation, game show convention with reality programming, and humor with academics. The intended impacts are to 1) help the target audience develop interest, knowledge and skills necessary to do science; 2) train afterschool leaders to better facilitate science activities with kids; and 3) demonstrate how media can be used to teach substantive science and share the results of project evaluation with others in the field. The requested funds will allow the project to expand the science curriculum with 20 new half-hour episodes and expand the Web site, focusing on three new science themes that highlight topics of interest to this age group. The Web site will include four new science-based Web games that will allow kids to create and post content of their own design and contribute to nationwide data collection. A new FETCH Online Training resource will be created to help afterschool leaders to effectively engage in FETCH's hands-on science activities. American Institutes for Research (AIR) will conduct summative evaluation of the Online Training program.
In this article, Jenni Martin, Director of Education at Children's Discovery Museum of San Jose, describes how and why her team developed a new exhibit, "The Wonder Cabinet" for children ages 4 and under and accompanying adults. Martin outlines the design process associated with this exhibit, noting challenges and best practices.