Science, technology, engineering, and mathematics(STEM) programs in out-of-school time (OST) are designed to supplement school work, ignite student interest, and extend STEM learning. From interactive museum exhibits to summer-long science camps, opportunities for informal student engagement in STEM learning abound. What difference do these programs make, and how can we improve them? These questions preoccupy educators and funders alike. OST program developers and providers can benefit from understanding why evaluation is critical to the success of STEM OST programs, what data collection
This article examines afterschool science in light of the National Research Council’s comprehensive synthesis report on promoting science learning in informal environments (NRC, 2009). We present the results of our analysis of qualitative case studies of nine state-funded afterschool sites in California, discussing the strengths of these programs against the background of three key site-based constraints—time available for science, staff’s science backgrounds, and instructional materials—as well as the importance of partnerships with outside organizations to support sites in overcoming these
This document describes the Dimensions of Success (DoS), an assessment tool created by researchers at the Program in Education, Afterschool, and Resiliency (PEAR). DoS was created to help out-of-school time programs and researchers monitor and measure quality. It allows observers to collect systemic data along 12 quality indicators to pinpoint the strengths and weaknesses of afterschool science learning experiences.
DATE:
TEAM MEMBERS:
Anahit PapazianAshima ShahCaitlin Rufo-McCormick
Although stakeholders agree that afterschool STEM education can be powerful, there is less agreement on the critical question of which aspects of STEM education the afterschool field is best positioned to support. Hence, in spring 2012, the Afterschool Alliance undertook a study to ask afterschool stakeholders what aspects of STEM learning the field is best positioned to support. The aim of the Afterschool STEM Outcomes Study was to identify consensus views on appropriate and feasible outcomes and indicators for afterschool STEM programs. The study provides a realistic vision of the field’s
As part of the National Science Foundation-funded Access Algebra project, the Oregon Museum of Science and Industry (OMSI) developed both a 6,000 square foot traveling exhibition (Design Zone) and a professional development program for host-museum facilitators who would work in the exhibition. The primary goal of the project was to engage visitors in algebraic thinking, with a special focus on reaching a target audience of 10- to 14-year-olds and their families. Facilitation in Design Zone was intended to support and extend visitors’ engagements with the exhibits and engage visitors in
Design Zone’s primary objective is to engage visitors in algebraic thinking, with a special focus on reaching a target audience of 10- to 14-year-olds and their families. The exhibition is organized into three thematic areas: art, music, and engineering. Exhibits in each area are based on real-world design challenges in which math and algebra are used. Garibay Group was contracted to conduct the summative evaluation of Design Zone. Using a mixed methods approach, data were collected at three museums hosting the Design Zone exhibition.
This consent form was used as part of a TERC project that focused on developing and evaluating math materials in libraries. It uses simple and readable text.
The C2C award addresses the lack of validated instruments to measure teamwork and collaboration in middle and high school students in out of school time (OST) settings by implementing a rigorous four-phase process to develop new assessments. Phase 1 focuses on defining the construct of teamwork and collaboration skills so it aligns with the research literature and is relevant to outcomes in a variety of STEM OST programs. Construct maps are developed during Phase 2 to guide item development. The instruments are piloted in Phase 3 through think-aloud interviews and survey administration with a diverse set of youth and programs. Through an iterative process, items are revised or removed based on their psychometric properties. The final phase is a national field test with a cross-section of STEM OST programs. C2C's intellectual merit is its potential to advance understanding of how to measure teamwork and collaboration skills in STEM OST programs. There is a national call for more measures to evaluate 21st century skills. C2C's creation of instruments to measure teamwork and collaboration skills in STEM OST programs helps to address this gap. The work of C2C addresses broader impacts and benefit society by creating tools to understand the role STEM OST programs play in readying our nation's youth for the STEM workforce. C2C will create instruments validated specifically for this diverse population, allowing programs to understand the role they play in important societal STEM workforce readiness outcomes. C2C also benefits the informal science education field by conceptualizing the construct of teamwork and collaboration within STEM OST programs and developing validated instruments to understand the impact of these programs on youth.
With support from the Institute of Museum and Library Services, the Mathematics in Zoos and Aquariums project worked with zoo and aquarium staff members to integrate mathematical concepts into the interpretation of living collections. Over two years, the project developed three activities related to logic, measurement, and data analysis and conducted workshops with over 400 staff from 124 institutions. In refining the workshop model and conducting evaluation, we found that most staff increased their comfort with and use of math-based activities and that the goals of the participants and the
This report presents a project overview and findings from a formative evaluation of the Ready, Set, School prototype exhibit space at Marbles Kids Museum in Raleigh, NC. This study was conducted by museum staff in consultation with Randi Korn & Associates in May 2013.
Over a period of three weeks in October 2012, Marbles Kids Museum conducted focus groups to support the development of a new school readiness-focused exhibit space and programming. Focus groups included parents of children ages 3-5, preschool and early elementary school educators, and staff from community organizations involved in early childhood education in Wake County, NC. Focus groups addressed the following questions: (1) What does school readiness mean to you? (2) What do you envision or expect in a school readiness exhibit space? (3) What school readiness program possibilities can you
This three-year research project will study the impact of science center staff facilitation strategies in the area of mathematics learning in a museum exhibit environment. The three main deliverables are: (1) Iteratively developing and refining a theoretical model of how staff facilitation can deepen and extend family mathematical discourse at interactive exhibits; (2) Rigorously testing key components of this model, including the relationship between staff facilitation and the nature of family mathematical discourse; and (3) Providing evidence and research-based tools to support PD efforts for informal STEM educators. The project will leverage the success of the NSF-funded Access Algebra project (DRL-0714634) to advance the field's understanding of socially mediated, informal math learning and identify effective, evidence-based facilitation approaches. The project's research will build from theoretical notion of sociomathematical norms (Yackel & Cobb, 1996), which is currently based on classroom research. A key element of the project will be to determine whether and how, the norms can be applied to informal learning environments. The first phase of the project begins with a qualitative, design-based research (DBR) study to develop a theoretical model of staff-facilitated family math learning, including staff facilitation strategies that support family mathematical discourse and contextual factors that influence that discourse. In the second phase of the project, the team will use an experimental approach to rigorously test the staff facilitation model developed during Phase 1. This mixed-method design will allow the team to both study the complexities of informal math learning and rigorously test causal connections between staff facilitation and the level of family math discourse. Finally, the project staff will provide tools to support PD efforts for informal STEM educators across the country.