This paper presents a summary of each of 10 evaluations conducted of NASA educational programs. The paper begins with a table outlining the titles of the evaluations and who conducted them, the date of the report, the evaluation questions, the evaluation design or methods and brief comments on the quality of each report. After the table each report is considered in more depth through an overview of what the evaluation included as well as a critique of the evaluation questions, methods and findings. The paper concludes with an overall commentary on the set of evaluations.
This book describes results of the Museum Impact and Evaluation Study, headed by the Chicago Museum of Science and Industry. The project that began in January 1990 and was completed in 1992 explored relationships between museums and their visitors and was intended to help staff members understand how they develop these relationships, what characterizes these relationships, and how these relationships are maintained.
DATE:
TEAM MEMBERS:
Museum of Science and IndustryPeter AndersonBonnie Cook Roe
STEM learning ecosystems harness unique contributions of educators, policymakers, families, and others in symbiosis toward a comprehensive vision of science, technology, engineering, and math (STEM) education for all children. This paper describes the attributes and strategies of 15 leading ecosystem efforts throughout the country with the hope that others may use their lessons to deepen rich STEM learning for many more of America’s children.
This article reports on part of a larger study of how 11- and 12-year-old students construct knowledge about electricity and magnetism by drawing on aspects of their experiences during the course of a school visit to an interactive science museum and subsequent classroom activities linked to the science museum exhibits. The significance of this study is that it focuses on an aspect of school visits to informal learning centers that has been neglected by researchers in the past, namely the influence of post-visit activities in the classroom on subsequent learning and knowledge construction
DATE:
TEAM MEMBERS:
David AndersonKeith LucasIan GinnsLynn Dierking
This report proposes a comprehensive study to answer the question: How does conversation as a socially mediating activity act as both a process and an outcome of museum learning experiences? The study will examine museum learning across six kinds of museums and across different kinds of visiting groups. This proposal describes a model of museum learning that puts conversation among different kinds of coherent conversational groups at the core of museum learning. It focuses on ways that conversations are elaborated, enriched, and extended as a consequence of museum activity. The model recasts
In this article, I invite readers to think outside of evaluation’s current boundaries and to see the deep connectedness between what museums hope to achieve and how we evaluate the extent to which these aspirations may be realized. To do this, I present four imperatives for making museum evaluation more relevant, credible, and useful: 1) Link program activities with intended outcomes and hoped-for impact. 2) Take a systems-oriented evaluation approach. 3) Use affirmative data collection approaches based on assets and strengths. 4) Engage in courageous conversations.
The project will conduct a mapping study to describe the contexts, characteristics and practices of a national sample of science-focused Out-of-School Time (OST) programs. The study targets OST programs for middle- and high-school-aged youth, including after-school programs, camps, workshops, internships, and other models. While millions of dollars are invested in these programs, and tens of thousands of students participate , as a community, we have no truly comprehensive view of the wide variety of formats, audiences, and approaches that are represented by the many active programs. Where, when, and by whom are these science-rich programs conducted? What types of experiences do they offer to what kinds of students, with what goals? What organizational and experiential factors affect the outcomes for these youth? Ultimately, we wish to understand how these differences in program design are related to youth outcomes such as STEM learning, attitudes and interest, and their later career and educational choices. To answer these questions, we are gathering data through documents, interviews, and the online MOST-Science Questionnaire.
The summative evaluation of the Farming for Fuels classroom program and family event was conducted over two years. Two interim reports were delivered with preliminary results about specific areas of focus. This final report described the overall evaluation study methods and results, and made recommendations for potential revisions and improvements to the program. The evaluator worked with the program team at the Creative Discovery Museum to generate a list of questions to guide the evaluation study. The questions covered each of the major audiences for the program: museum educators, teachers
In this paper, we introduce the Exploratory Behavior Scale (EBS), a quantitative measure of young children's interactivity. More specifically, the EBS is developed from the psychological literature on exploration and play and measures the extent to which preschoolers explore their physical environment. A practical application of the EBS in a science museum is given. The described study was directed at optimizing parent guidance to improve preschoolers' exploration of exhibits in science center NEMO. In Experiment 1, we investigated which adult coaching style resulted in the highest level of
The purpose of this study was to describe and understand the range of outcomes of class visits to natural history museums. The theoretical framework is based on the multifaceted process of learning in free choice learning environments, and emphasizes the unique and individual learning experience in museum settings. The study’s significance is in highlighting several possible cognitive as well as non-cognitive learning effects in museums class visits, by providing the student’s point of view. Data was collected by semi-structured interviews with 50 students in grades 6–8 on the day following
This article describes an initial attempt to find out students’ perceptions of class visits to natural history museums, with regard to the museum’s role as a place for intellectual and social experience. The study followed up approximately 500 Grades 6–8 students who visited four museums of different sizes, locations and foci. Data sources included the Museum Constructivist Learning Environment Survey (M-CLES), which was adapted from Constructivist Learning Environment Survey, an open-ended question and semi-structured interviews with 50 students. The three instruments highlighted some
The C2C award addresses the lack of validated instruments to measure teamwork and collaboration in middle and high school students in out of school time (OST) settings by implementing a rigorous four-phase process to develop new assessments. Phase 1 focuses on defining the construct of teamwork and collaboration skills so it aligns with the research literature and is relevant to outcomes in a variety of STEM OST programs. Construct maps are developed during Phase 2 to guide item development. The instruments are piloted in Phase 3 through think-aloud interviews and survey administration with a diverse set of youth and programs. Through an iterative process, items are revised or removed based on their psychometric properties. The final phase is a national field test with a cross-section of STEM OST programs. C2C's intellectual merit is its potential to advance understanding of how to measure teamwork and collaboration skills in STEM OST programs. There is a national call for more measures to evaluate 21st century skills. C2C's creation of instruments to measure teamwork and collaboration skills in STEM OST programs helps to address this gap. The work of C2C addresses broader impacts and benefit society by creating tools to understand the role STEM OST programs play in readying our nation's youth for the STEM workforce. C2C will create instruments validated specifically for this diverse population, allowing programs to understand the role they play in important societal STEM workforce readiness outcomes. C2C also benefits the informal science education field by conceptualizing the construct of teamwork and collaboration within STEM OST programs and developing validated instruments to understand the impact of these programs on youth.