In August 2009, the Program Evaluation and Research Group (PERG) at Lesley University contracted with the project's PI at the University of New Hampshire (UNH) to evaluate My Dome: Defining the Computational and Cognitive Potential of Real Time Interactive Simulations in an Immersive Dome Environment, an NSF funded grant. The project focuses on creating interactive experiences in immersive virtual environments, and builds off previous work the PI and co PIs have done in developing films and immersive experiences in domes and traveling domes. The project includes staff from the Carnegie Museum
The Natural History Museum of Los Angeles County (NHMLAC) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a hybrid evaluation that was both front-end evaluation and formative evaluation. NHMLAC created a full-size prototype of a portion of Nature Lab, an exhibition that prompts visitors to think about LA's urban nature and their connection to it, while highlighting the main idea that LA is a biodiversity hotspot. The prototype was installed in the space where the completed exhibition will live, and the evaluation explored visitors' responses to the proposed exhibition content and
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
This summative evaluation of Ocean Bound! was conducted by Serrell & Associates for the Sciencenter in Ithaca, NY. The main message of the exhibition was: What we do on land not only affects the local environment, it affects the ocean as well. A healthy watershed means a healthier ocean. Four methods were used to collect data: unobtrusive tracking; pre-visit interviews; post-visit questionnaires; and a post-visit activity. Visitor comments and feedback showed strong evidence of understanding the exhibition's main concepts and included references to specific content from 7 of the 11 exhibits
Goodman Research Group, Inc. (GRG) is serving as the external evaluator of the NSF-funded Science Festival Alliance (SFA), a collaborative started by the University of California San Diego, the MIT Museum (Cambridge), the University of California San Francisco, and The Franklin Institute (Philadelphia). The early focus of the SFA has been on helping establish and sustain science festivals in each of these four cities. The Alliance's long-term goal is to facilitate the creation of a growing network of festivals and a community of science festival practitioners. This report focuses on the
Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
The Nelson-Atkins Museum of Art's Mobile Guide program will offer visitors a new way to interact with the Museum's collections by creating audio and visual content that will be delivered through a mobile-optimized Web site (www.naguide.org). The program, available through a user's own mobile device or via iPod Touch players made available, reflects the Museum's commitment to digital interpretation and its larger goal of broadening public accessibility to its collections. This evaluation is part of the larger Mobile Guide project funded through an Engaging Communities grant awarded from the
The Yale Peabody Museum of Natural History asked Ellen Giusti to evaluate visitor learning in its temporary exhibition, Invasion of the Bloodsuckers: Bedbugs and Beyond! The exhibition, supported by a grant from the SEPA division of the National Institutes of Health, focuses on six blood-feeding species: bedbug, flea, head louse, pubic louse, mosquito and tick. The centerpieces of the exhibition are greatly enlarged, highly detailed models of the six organisms. A text panel with images and information accompanies each model. Two displays contain live animals mosquitos and bedbugs. An
DATE:
TEAM MEMBERS:
Ellen GiustiYale Peabody Museum of Natural History
The summative evaluation of the National Science Foundation (NSF)-funded Geometry Playground traveling exhibition was a two-year naturalistic study to examine (a) the ways and extent to which the exhibition promoted the practice of spatial reasoning skills, and appreciation for geometry, and (b) its influence on museum professionals' thinking across three venues: the Exploratorium (San Francisco, CA), the Science Museum of Minnesota (St. Paul, MN), and the Don Harrington Discovery Center (Amarillo, TX). The study took place from December 2009 through November 2011 and included five site visits
The Lost Ladybug Project is a citizen science project which, since its inception in 2008, has received contributions of over 13,000 images of ladybug specimens from citizen scientists in North America. Audiences impacted included adult participants (without children), families, and youth (5-12 years old) participating within classrooms or out-of-school groups. Summative evaluation, conducted in 2011, was guided by the following questions: -To what extent has the program achieved its intended science learning impacts? -How are learning outcomes different for different types of participants?
DATE:
TEAM MEMBERS:
Jessica SicklerTammy Messick CherryCornell University
The Firefly Watch project is a citizen science program where a network of volunteers across the country observe and collect data on fireflies. Participants are able to post their results to the project website, where they can share aspects of their own experiences and learn about sightings in other locations. To evaluate this program, a brief survey was conducted that probed for participant interactions with the program, learning due to project involvement and areas for potential project growth.The attached file includes slides from the PowerPoint presentation that outline the key findings
This Pathways Project connects rural, underserved youth and families in Eastern Washington and Northern Idaho to STEM concepts important in sustainable building design. The project is a collaboration of the Palouse Discovery Science Center (Pullman, WA), Washington State University and University of Idaho, working in partnership with rural community organizations and businesses. The deliverables include: 1) interactive exhibit prototype activities, 2) a team cooperative learning problem-solving challenge, and (3) take-home materials to encourage participants to use what they have learned to investigate ways to make their homes more energy-efficient and sustainable. The project introduces youth and families to the traditionally difficult physics concept of thermal energy, particularly as it relates to sustainable building design. Participants explore how building materials and their properties can be used to control all three types of heat transfer: conduction, convection, and radiation. The interactive exhibit prototypes are coupled with an Energy Efficient Engineering Challenge in which participants, working in cooperative learning teams, use information learned from the exhibit prototype activities to retrofit a model house, improving its energy efficiency. The project components are piloted at the Palouse Discovery Science Center, and then travel to three underserved rural/tribal communities in Northern Idaho and Eastern Washington. Front-end and formative evaluation studies will demonstrate whether this model advances participant understanding of and interest in STEM topics and careers. The project will yield information about ways that other ISE practitioners can effectively incorporate cooperative learning strategies in informal settings to improve the transferability of knowledge gained from exhibits to real-world problem-solving challenges, especially for rural and underserved audiences. This project will also provide the ISE field with: 1) a model for increasing the capacity of small, rural science centers to form collaborative regional networks that draw on previously unused resources in their communities and provide more effective outreach to the underrepresented populations they serve, and 2) a model for coupling cooperative learning with outreach exhibits, providing richer experiences of active engagement.
This broader implementation project will create a professional network of individuals and institutions increasing their capacity to develop, implement, and evaluate the impact of large scale community science festivals. The project builds on a previous award that supported the implementation of science festivals in Cambridge, MA; San Francisco, San Diego, and Philadelphia. Each festival reached 50-70,000 attendees, many of them families from low-income, ethnic communities. Festival organizers and participants include science center practitioners, Science, Technology, Engineering and Mathematics (STEM) researchers, STEM related businesses, public television STEM producers, universities, K-12 schools, and government and foundation stakeholders. The summative evaluation indicated significant impacts on participant's STEM interest, learning, and connections to STEM resources in their community. The number of science festivals across the country is increasing. Consequently this new project will create a professional network with numerous benefits to professionals in the Informal Science Education (ISE) field and other stakeholders including: timely access to information, knowledge and experience related to science festivals; rich relationships to draw on when facing challenges; credibility of the festival concept; ability to partner with multiple festivals and magnify the reach of existing ISE institutions and program; diffusion of knowledge and innovation; and collective intelligence and inclusive consultation. It is expected that the network will involve supporting approximately 50 science festivals during the grant period. A business plan will be developed for long term sustainability of the network and the subsequent growth of science festivals. This is a collaborative proposal with 4 project partners who have distinct roles in creating and sustaining the network: MIT, University of California at San Francisco, University of North Carolina/Morehead Planetarium and Science Center, and The Franklin Institute. MIT's project deliverables include hosting the central management and administrative functions of the network and providing conferences, workshops, individual mentoring of new science festival champions, maintaining the network website, etc. UCSF will develop tools, resources, and linkages to increase participation of scientists in festivals. UNC/Morehead Planetarium and Science Center will provide expertise in statewide festival organizing. The Franklin Institute will help network participants build capacity for engaging low-income families with programming examples, community asset analysis tools, and webinars. This multi-hub approach is a new innovative strategy for creating and sustaining the first ever professional network for science festival organizers. The project evaluation will focus on the network\'s vibrancy, connectivity and effect. Network vibrancy impact data will be collected on how members share goals, enhance leadership, and expand geographic and model diversity. Network connectivity evaluation will study the strength and growth of the relationships within the SFA network. Network effects will study the ways the Science Festival Alliance (SFA) network is achieving science festival organizational capacity looking at increases in the number of science festivals, geographic spread, science festival innovations, and the presence of a SFA sustainability plan. This project will add new knowledge about the impact of networks on the development and impact of science festivals throughout the country.