One way to ensure that an evaluation has "utility" is to use a participatory evaluation approach where the evaluator partners with primary users to carry out various phases of an evaluation. This article provides a case study of how participatory evaluation was used in an out-of-school youth development and employment program at the Science Museum of Minnesota's Kitty Andersen Youth Science Center. Youth staff participated in a series of evaluation workshops where they learned about evaluation, made their own meaning of evaluation data, generated recommendations to improve their museum work
Front-end and formative evaluation of the Science Museum of Minnesota's Invention, Design, Engineering, and Art (IDEA) Cooperative youth development program was carried out from June 2008 - May 2009. The front-end and formative evaluation activities were guided by four overarching questions. 1. To what extent are youth able to apply IT and engineering process skills to design challenges? Can they come up with multiple solutions to challenges? Are they persistent problem solvers? 2. To what extent does the program provide youth with the necessary resources to help youth prepare for both
DATE:
TEAM MEMBERS:
Amy Grack NelsonMelissa FitzenbergerKathleen MillerClaire Phillippe
The Dallas Museum of Art's (DMA) Teaching Programs staff desires to learn more about the student experience occurring in the galleries during one-hour docent-guided tours. The focus of the present implementation evaluation is on the docents' role in facilitating the student experience. Before developing a summative study focused on the impact of tours on students, it was important to understand how the tours were being implemented and to what degree and in what ways they met the standards articulated by the DMA's Education Division. The strong partnership between the practitioner (Molly Kysar
The Youth Astronomy Apprenticeship (YAA) is a yearlong, out-of-school time initiative that connects urban teenage youth with astronomy as an effective way to promote scientific literacy and overall positive youth development. The program employs the strategies of a traditional apprenticeship model, common in crafts and trades guilds as well as in higher education. During the apprenticeship, youth develop knowledge and skills to create informal science education projects: through these projects they demonstrate their understanding of astronomy and use their communication skills to connect to
The Natural History Museum of Los Angeles County (NHM) contracted Randi Korn & Associates, Inc. (RK&A) to study visitor engagement in the Museum. The intent of this research was to deepen the NHM's understanding of its audiences by examining visitors' programmatic and content-driven experiences in the NHM. In addition, RK&A explored the qualities and characteristics associated with different types of visitors and identified how such characteristics determine visitors' level of engagement with the NHM. How did we approach this study? RK&A used a combination of standardized questionnaires and in
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Natural History Museum of Los Angeles County
The Nanoawareness Study is designed to answer the question "What, if any, impact do NISE Net activities delivered at Tier 1 and Tier 2 institutions have on the nanoawareness of the public audiences that experience those activities?" The appendix of this report includes the online survey instrument used in the study.
In order to better understand how visitors to science and natural history museums connect to ideas around Indigenous knowledge and Western science, the Cosmic Serpent evaluation team (Institute for Learning Innovation and Native Pathways) conducted front-end audience research focused on audience perceptions and attitudes towards Indigenous ways of knowing and Western science in informal science settings.A total of 121 exit interviews were conducted with visitors to the New Mexico Museum of Natural History and Science in Albuquerque, NM, and to the Oregon Museum of Science and Industry in
DATE:
TEAM MEMBERS:
Jill SteinShelly ValdezTammy MessickUniversity of California-BerkeleyIndigenous Education Institute
The Salmon Camp Research Team (SCRT) project was created to address the under-representation of Native Americans in information technology (IT) and IT-intensive professions in science, technology, engineering, and mathematics (STEM). The Oregon Museum of Science and Industry (OMSI) partnered with the Native American Youth and Family Association (NAYA) under renewed National Science Foundation funding to strengthen community involvement and work directly with students year round. The 2007-2008 evaluation of the project found evidence of effective implementation and data on important student
DATE:
TEAM MEMBERS:
Phyllis AultOregon Museum of Science and Industry
The Exploratorium is home to XTech, a science education program which began in 2006 and was primarily funded by a three-year National Science Foundation grant (Award # 05-25217) through its ITEST (Innovative Technology Experiences for Students and Teachers) initiative. XTech provided project-based afterschool activities in science, engineering, and technology to underserved middle school students from the San Francisco Bay Area. As part of the Exploratorium's Community Outreach department, XTech involved partnerships with two community-based organizations in the Bay Area "Aim High and First
DATE:
TEAM MEMBERS:
Becky CarrollAnita SmithPam CastoriExploratorium
Nanoscience is an emerging scientific field, and therefore an increasing amount of funding is flowing into nanoscience and nanotechnology research, including money from the federal government. Several studies of public understanding and public attitudes toward nanoscience have shown that most of the public is generally uninterested in and unmotivated to learn about nanoscale science and technology3. Because this emerging interdisciplinary field of science offers so much promise, and because it will have an increasing presence in everyday life, the NSF is committed to increasing public
DATE:
TEAM MEMBERS:
Mark St. JohnJenifer V. HelmsNanoscale Informal Science Education (NISE) NetworkPam CastoriJudy HirabayashiLaurie LopezMichelle Phillips
The Media MashUp project is funded by the IMLS (Grant LG-07-08-0113 ) to build capacity at libraries for computer-based programs for youth that help build 21st Century literacy skills. Twenty first Century literacy skills include interactive engagement with technology, collaboration and team problem solving, taking initiative and managing time and the use of higher level processing skills (www.21stcenturyskills.org/). This project uses the Scratch programming platform (http://scratch.mit.edu/) developed at MIT to help foster youth's 21st Century literacy skills. The professional audience
From April 19 to June 15, 2009, volunteers had the opportunity to provide feedback on their volunteer experience and offer suggestions for improvement. The survey was initially only available as a web-based survey. Volunteers with email accounts were sent a link to the survey. Those volunteers without an email address were asked to contact Volunteer Services for a paper copy of the survey. Volunteers received an hour of volunteer time for completing the survey. Of the 369 active volunteers, a total of 144 filled out the survey for a 39% response rate (compared to 46% in 2008 and 41% in 2007)