Presented at the 2008 ISE PI Summit, this presentation from Alan Friedman introduces the Framework for Evaluating the Impacts of Informal science Education Projects.
The March 12-13, 2007 workshop at NSF on informal science education evaluation brought together a distinguished group of experts to discuss how impact categories might be best applied to various types of informal learning projects. This publication is an outcome of that meeting. The authors have strived to make the sections as helpful as possible given the primary focus of this workshop on project impacts. It should be viewed as part of an ongoing process to improve the ways in which evaluation can most benefit ISE projects, NSF, and the field. The publication is intended to help those
Bio Med Tech: Engineering for Your Health was a 2,750 square foot exhibition at the Great Lakes Science Center (GLSC) that dealt with issues related to biomedical technology. Partially funded by a grant from the National Institutes of Health Science Education Partnership Awards program (NIH/SEPA), the project was developed through a partnership between GLSC and Case Western Reserve University. The SEPA grant also funded a variety of programming activities, including informal Exploration Cart activities in the exhibition, presentations in the exhibition's theater space, and teacher training
Impact of GLC On Teachers Over the four years of the project, GLC worked with 171 teachers and 7schools. The program had a dramatically positive impact on the teachers involved. The GLC staff did an excellent job of establishing relationships with participating teachers, teaching them to use Lesson Study techniques and how to use the school garden as a resource for learning and creativity. As a result, teachers' overall attitudes towards teaching improved. Lessons became more flexible and useful across the curriculum. The teachers involved were seen by GLC staff to have made observable
DATE:
TEAM MEMBERS:
Minda BorunUniversity of California Botanical Garden
During 2005-2008, the Nanoscale Informal Science Education Network researched, designed, implemented, and evaluated public deliverables covering various aspects of nanoscience, nanotechnology, and nanoengineering. Working with four NISE Net museums, Multimedia Research used a web-based post-survey design to assess nanotechnology awareness in a sample of museum visitors exposed to nano-topic programs, exhibits, forums and activities (treatment group) compared with a sample of museum members who were not exposed to the deliverables (control group). Exposure to nano-topic deliverables appears to
IN 2005-2008, the Nanoscale Informal Science Education Network experimented with forum models designed to provide attendees with an opportunity to learn about and discuss the implications of nanotechnology on their lives, society and the environment. For this summative evaluation, the forum Nanotechnology in Health Care was implemented at three NISE Net museums and evaluated with a pre-post one-group design. The Nanotechnology in Health Care forum model is successful in positively influencing attendees' definition of nanotechnology; their awareness, assessment, and understanding of both the
From May 1 to July 7 of 2008, volunteers had the opportunity to provide feedback on their volunteer experience and offer suggestions for improvement. The survey was a follow up to the May 2007 volunteer survey. The 2008 survey was initially only available as a web-based survey. Volunteers with email accounts were sent a link to the survey. A kiosk was also available in the volunteer check-in area for volunteers to complete the survey while at the museum. After the first month, the survey was made available in paper format in the volunteer break room to help increase the response rate. Paper
DATE:
TEAM MEMBERS:
Sarah CohnScience Museum of Minnesota
In an effort to learn more about ways the Museum of Science can revise its existing comment card system so that it can better monitor the quality of the visitor experience, the Museum of Science Research and Evaluation Department, under the guidance of the Visitor Services division, set out to accomplish the following goals: Develop a detailed system for coding comments provided through the museum's existing electronic and physical comment cards; Determine the main visitor concerns that were expressed through the current comment card reporting system; and Explore how alternative sampling
During the summer of 2007, the Science Museum of Minnesota carried out a summative evaluation of the Kitty Andersen Youth Science Center's Park Crew program. The purpose of the evaluation was to understand how the youth staff implemented activities in the museum's Big Back Yard and what they learned about earth-surface processes, teaching others, and STEM careers. A mixed-methods design was used to gather evaluative data. Data collection methods included observations of youth presenting activities to visitors and pre- and post-interviews with the youth. A total of 11 youth (sophomore through
This study was designed to assess qualitative and quantitative impacts that the enactor program has on visitor experience at the Denver Museum of Nature and Science (DMNS), using two temporary exhibitions (Benjamin Franklin: In Search of a Better World and Titanic: The Artifact Exhibition) as examples. Of interest was capturing the unique visitor experience that enactors provide by combining visitor engagement, education and interaction. In turn, this affords opportunities to better consider enactor and/or theater-based programming for other areas of the Museum (temporary and permanent) in the
Although there is a significant literature documenting the strength of informal science experiences in controlled or specialized settings, such as museums and science-focused youth programs it is not yet clear how best to regularly provide such opportunities in typical after-school programs--ones not established or specifically supported to test or implement grant-funded curricula or STEM approaches under specialized conditions. What's more, the majority of the 6.5 million children enrolled in after-school programs participate in typical programs. This study addressed this gap in the
The evaluation was guided by four major questions: 1) How has math education changed at the afterschool programs sites over the course of the project? 2) Have children's experiences of informal math changed over the course of the project? 3) How have program staff changed in relation to math education? and 4) How is Mixing in Math being sustained at the program sites and disseminated to other programs and sites? Staff, program, and organizational factors all played a strong role in supporting high quality implementation of Mixing in Math. Mixing in Math was most successful where the
DATE:
TEAM MEMBERS:
Beth MillerTERC Inc.Kristin Lewis-Warner