The National Building Museum (NBM) contracted RK&A, Inc. to conduct a summative evaluation of the Why Engineering? distance learning program. The goal of the evaluation was to assess program operations and explore the extent to which the program achieved its intended outcomes for students and teachers.
How did we approach this study?
RK&A used three methodologies for the study: online program observations; student assessments administered immediately after the program; and telephone interviews with teachers. Observations were primarily used to gain a holistic understanding of how the
RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
‘6 Degrees of Connection’ is an informative and memorable program that combines a one-hour Science On a Sphere® interactive presentation with a follow-up creative art activity – each aspect of which encourages middle school students to think of interconnections among phenomena on the planet, including the natural world and human activity.
The ‘6 Degrees of Connection’ program was developed by the Nurture Nature Center (Easton PA) in collaboration with the Maryland Science Center (Baltimore MD) through an extensive process of developing the concept, prototypes, and final program. Lehigh
The Field Museum contracted RK&A to conduct a summative evaluation of the Grainger Science Hub and the Discovery Squad Carts, two museum experiences facilitated by educators or trained volunteers. The goals of the study are to explore the extent to which visitors interact with programming in the Science Hub and at Discovery Squad Carts and the nature of those interactions, as well as visitor motivations and takeaways.
How did we approach this study?
RK&A conducted observations in the Science Hub and at Discovery Squad Carts to understand the nature of experiences at each. The
The Collaboration for Ongoing Visitor Experience Studies (COVES) aims to help science centers gather and share data to better understand visitors’ experiences. For the summative evaluation of COVES, the Museum of Science’s Research and Evaluation Department studied the program’s impacts on participating museums and museum professionals. Specifically, this evaluation was designed to:
Examine participants’ overall satisfaction with the collaboration and their likelihood to recommend it to others;
Understand the impact that COVES is having on Participating Institutions;
Assess whether
Citizen science, also known as participatory research, combines the efforts among professional researchers and community volunteers to collect data. We have established a collaborative project in eastern North Carolina, near the 79,000-acre Hofmann Forest, comprising of 55,000 acres of planted forests and 24,00 acres of deep pocosin natural forests. The White Oak River, New River, and Trent River all flow out of the Hofmann. The Hofmann acts plays a keystone ecological role as it acts as a natural filtration system for harmful runoff that occurs in the coastal plain of North Carolina.
The
DATE:
TEAM MEMBERS:
Meredith HovisFrederick CubbageMadhusudan KattiKathleen McGinley
This report summarizes evaluative findings from Computational Thinking in Ecosystems project, and the resulting product, i.e., a functional draft of a game called “The Pack.” Evaluative efforts included gathering feedback from key stakeholders—including members of the design based research (DBR) team members at the New York Hall of Science (NYSCI) along with advisors and project partners— about the game and the DBR process, as well as an independent assessment of the game via feedback from educators and a round of play-testing with youth.
AHA! Island is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. This research is intended to examine the extent to which the prototyped media and activity sets support the project’s learning goals. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative study with 16 English-speaking families (children and their caregivers) to test out these media and activity set prototypes. During the in-person video
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
resourceevaluationProfessional Development, Conferences, and Networks
The STAR Library Network Phase 2 (STAR Net) brings inquiry-based STEM learning experiences to public libraries through six traveling exhibits, training for library staff and associated programming for library patrons, and a virtual community of practice for library staff and others interested in bringing STEM programming to libraries. In 2014, the National Science Foundation (NSF) awarded a four-year grant to the Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL) and its partners—the American Library Association (ALA), the Lunar and Planetary Institute (LPI), the
DATE:
TEAM MEMBERS:
Ginger FitzhughSarah ArmstrongSheila RodriguezVicky Coulon
The Monterey Bay Aquarium is planning to redesign existing conservation-related interactives as well as add new experiences on the Aquarium floor. In preparation for this project, the Aquarium sought to gain a better understanding of visitors’ awareness of and engagement in conservation-related actions and responses to conservation-related messaging. The Aquarium contracted with MWA Insights to conduct a front-end evaluation study to help inform the planning for these conservation stations. Specifically, the evaluation sought to understand:
Are visitors aware of issues affecting the