This Handbook is geared to the experienced researcher who is a novice evaluator. It orients the researcher to evaluation practice, with an emphasis on the use of qualitative techniques to augment quantitative measures.
The March 12-13, 2007 workshop at NSF on informal science education evaluation brought together a distinguished group of experts to discuss how impact categories might be best applied to various types of informal learning projects. This publication is an outcome of that meeting. The authors have strived to make the sections as helpful as possible given the primary focus of this workshop on project impacts. It should be viewed as part of an ongoing process to improve the ways in which evaluation can most benefit ISE projects, NSF, and the field. The publication is intended to help those
Presentation slides on submitting competitive Advancing Informal STEM Learning (AISL) proposals, originally presented at the 2012 Association of Science-Technology Centers (ASTC) Annual Conference
In October 2009, the Tennessee Aquarium began an ambitious program, Connecting Tennessee to the World Ocean (CTWO), funded by a grant from the National Oceanic and Atmospheric Administration. CTWO consists of several individual projects, all intended to increase the ocean literacy of Aquarium audiences and to promote their adoption of an ocean stewardship ethic. This evaluation report summarizes the extent to which the Aquarium accomplished these goals over the 3-year project period. The five project components and their key associated evaluation findings follow. 1. Classroom-based activities
The InformalScience.org web site is a resource for researchers working in the field of informal science and provides access to information linking researchers with one another and to member-contributed resources. Through use of the web site resources such as member projects, publications, and evaluation reports, users have opportunities to develop social and human capital. This report analyzes the value of InformalScience.org in supporting participants in the community as they navigate and advance the changing field of informal science education (ISE) research. In addition, we identify
In an effort to prepare female high school students for a college curriculum and achieve gender parity in the engineering industry, WGBH has developed an initiative entitled, Engineer Your Life (EYL). The initiative is targeted toward female high school students, career counselors/educators, and professional engineers. It is designed to: 1) increase these target audiences' understanding of engineering, 2) inspire young women to explore engineering as a career option and 3) help adults encourage young women to investigate engineering opportunities. One component of this initiative involves
The Take Two Institutional Research Study was an ethnographic case study of the contributions of Web 2.0 philosophy and technologies to museum practice and staff development at the Museum of Life and Science in Durham, North Carolina. It used a naturalistic methodology to investigate staff members' relationships with each other and their publics as the Museum developed and embraced a philosophy of Web 2.0 experimentation, shared authority, and co-creation. An important element in developing Web 2.0 culture at the Museum of Life and Science was leadership that encouraged experimentation and
The National Science Foundation has provided funding through NSF-ISE# 0946691 to support the DISCUSS Colloquium, a seed initiative to nurture a shared Digital Immersive Giant Screen Specifications (DIGSS) for STEM learning film production at a scale and quality that is sustainable in the informal science education (ISE) community. It is anticipated that when such specifications are adopted and published, equipment manufacturers and show producers will be better able to raise capital based on the scale of the network and their need for replacement equipment and new films. Researchers from ILI
DATE:
TEAM MEMBERS:
John FraserWhite Oak InstituteVictor YoccoSarah Gruber
Led by KQED in Northern California, a network of seven public media organizations around the country joined to form the QUEST Regional Hubs Collaborative project. Funded with grants from the National Science Foundation (NSF) and the Corporation for Public Broadcasting (CPB), this project aimed to achieve the adaptation of a successful cross-platform media production model and the creation of a content-sharing collaborative. Rockman et al (REA), an educational research and evaluation firm in San Francisco, served as the external evaluator to document the development of both the regional
The National Science Foundation provided funding through NSF-ISE# 0946691 to support the Digital Immersive Screen Colloquium for Unified Standards and Specifications (DISCUSS), a seed initiative to nurture a shared Digital Immersive Giant Screen Specifications (DIGSS) for STEM learning film production at a scale and quality that is sustainable in the informal science education (ISE) community. The DISCUSS initiative engaged technical experts from across the GS community in concert with the Giant Screen Cinema Association (GSCA) and developed a first draft specification that was presented to
The Institute for Learning Innovation (ILI) conducted a study to examine the impact of an information campaign presented at the 2010 Giant-Screen Cinema Association Annual Conference and Trade Show in Chattanooga, TN. The purpose of the study was to determine if changes in Conference attendees' awareness and attitudes towards the Digital Immersive Giant-Screen Specifications (DIGSS) could be attributed to the information campaign. Data were collected using an online questionnaire containing 11 "post/retrospective-pre"" items exploring the level of knowledge and attitude Conference attendees
DATE:
TEAM MEMBERS:
John FraserWhite Oak InstituteVictor Yocco
ExhibitFiles is an online community of exhibit practitioners developed by the Association of Science-Technology Centers (ASTC) with funding from the National Science Foundation (NSF). The website, which opened on April 26, 2007, provides an infrastructure for sharing and building knowledge about exhibition development and design practices. The purpose of this summative evaluation was to provide information to stakeholding groups about the worth of the site and requirements for sustainability resources after NSF funding ends. The two overarching questions explored by the evaluation were: 1. In
DATE:
TEAM MEMBERS:
Carey TisdalAssociation of Science-Technology Centers