This evaluation report provides a brief review of the National Science Foundation (NSF) planning grant, Creating an Early Childhood STEM Ecosystem, as of August 2019. The purpose of the evaluation was to provide an external, independent overview of the work completed and some of the lessons learned to date.
The summative evaluation report for Project TRUE focuses on program implementation, participant experiences, organizational capacity outcomes and project scale-up over the five-year project.
Appendix includes logic model and instruments.
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL) and identified a “constellation” of knowledge, dispositions, and practices within each of those themes. Finally, Project RESET demonstrated the potential benefits of multi-modal analysis
The Lemelson Center for the Study of Invention and Innovation (Lemelson) at the National Museum of American History (NMAH) contracted RK&A to conduct a front-end evaluation of Game Changers, a new exhibition that will highlight stories of invention and innovation related to sports. The goals of the study were to identify visitors’ associations with sports and invention and explore their reactions to preliminary exhibition concepts and titles.
How did we approach this study?
RK&A conducted 40 in-depth interviews with walk-in visitors to NMAH. As much as possible, RK&A recruited
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether