Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Children Investigating Science with Parents and Afterschool (CHISPA) was a collaboration between the Phillip and Patricia Frost Museum of Science, UnidosUS (formerly National Council of La Raza), and the ASPIRA Association that took place from 2014-18. CHISPA sought to address the disparity in science achievement among Latino and non-Latino children through local-level partnerships between science museums in metropolitan areas with growing Latino populations and UnidosUS and ASPIRA affiliate organizations serving the same communities through afterschool programs.
Partners included the
The Wildlife Conservation Society and Good Shepherd Services (a youth development and education agency) are implementing and evaluating a school-to-career model program that consists of afterschool and weekend programming for high school students at four New York City area zoos and an aquarium, followed by post-participation tracking, support, and mentoring. The goal is to promote affective, cognitive and behavioral outcomes among 150 low-income minority youth necessary to pursue careers in the wildlife sciences.
The Bridging the Gap project is (1) developing a science career program that includes hands-on, technology-enriched, science learning experiences at zoos/aquaria; career building services, mentoring, and long-term tracking and support, (2) forming a community of minority students who have the knowledge and skills to pursue wildlife careers, (3) generating research findings on the short-term and long-term effectiveness of the program, and (4) disseminating information about the project's resources and findings to other informal science education institutions around the nation for replication. The evaluation plan measures a variety of outputs, outcomes and impacts that include short-term and long-term cognitive and affective variables. Data collection methods include student activity monitoring and pre-post testing.
The project addresses a compelling personnel issue documented by the American Zoo and Aquarium Association - the small number of minority science professionals working in zoos and aquariums. Because few programs currently exist to help minority students enter the wildlife science professions, this project fills an important programmatic need and serves as a model workforce program that can be replicated by other informal science education organizations around the country. The project's key strategic impact is its capacity to broaden participation in the wildlife sciences by expanding the science professional pipeline beginning in high school.
DATE:
-
TEAM MEMBERS:
Karen TingleyChanda BennettDon LisowyBrian JohnsonEmily StoethCourtney Wiggins
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
EDC’s Center for Children and Technology (CCT), a nonprofit research and development organization (cct.edc.org), conducted the formative evaluation of the BAS project for the last three years. Iridescent has assisted CCT researchers in the successful implementation of the evaluation (e.g., organizing site visits and meetings with partners, administering surveys, collecting consent forms). As discussed in more details below, Iridescent has always taken seriously the evaluation findings and recommendations, and has acted upon them to make program improvements. This research partnership has led
The data collection for this project involves three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Nebraska-Lincoln. Data was collected from February to April, 2013 and the evaluation was conducted by the Bureau of Sociological Research (BOSR). Appendix contains surveys
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets
The Center for Chemistry at the Space-Time Limit (CaSTL)’s outreach program in collaboration with the California Science Project at Irvine (CSPI), housed at the Center for Educational Partnerships at UC Irvine designed, created, implemented, and consistently refined a science program for 8-12 year old students at the Boys and Girls Club(BGC) in Santa Ana, California. The year-long weekly program and 4-day summer camp consisted of hour-long lessons designed to connect to CaSTL’s research goals of investigation at the microscopic level. Appendix includes observation protocol, performance measure
The project will conduct a mapping study to describe the contexts, characteristics and practices of a national sample of science-focused Out-of-School Time (OST) programs. The study targets OST programs for middle- and high-school-aged youth, including after-school programs, camps, workshops, internships, and other models. While millions of dollars are invested in these programs, and tens of thousands of students participate , as a community, we have no truly comprehensive view of the wide variety of formats, audiences, and approaches that are represented by the many active programs. Where, when, and by whom are these science-rich programs conducted? What types of experiences do they offer to what kinds of students, with what goals? What organizational and experiential factors affect the outcomes for these youth? Ultimately, we wish to understand how these differences in program design are related to youth outcomes such as STEM learning, attitudes and interest, and their later career and educational choices. To answer these questions, we are gathering data through documents, interviews, and the online MOST-Science Questionnaire.
This article examines afterschool science in light of the National Research Council’s comprehensive synthesis report on promoting science learning in informal environments (NRC, 2009). We present the results of our analysis of qualitative case studies of nine state-funded afterschool sites in California, discussing the strengths of these programs against the background of three key site-based constraints—time available for science, staff’s science backgrounds, and instructional materials—as well as the importance of partnerships with outside organizations to support sites in overcoming these
This document describes the Dimensions of Success (DoS), an assessment tool created by researchers at the Program in Education, Afterschool, and Resiliency (PEAR). DoS was created to help out-of-school time programs and researchers monitor and measure quality. It allows observers to collect systemic data along 12 quality indicators to pinpoint the strengths and weaknesses of afterschool science learning experiences.
DATE:
TEAM MEMBERS:
Anahit PapazianAshima ShahCaitlin Rufo-McCormick
Although stakeholders agree that afterschool STEM education can be powerful, there is less agreement on the critical question of which aspects of STEM education the afterschool field is best positioned to support. Hence, in spring 2012, the Afterschool Alliance undertook a study to ask afterschool stakeholders what aspects of STEM learning the field is best positioned to support. The aim of the Afterschool STEM Outcomes Study was to identify consensus views on appropriate and feasible outcomes and indicators for afterschool STEM programs. The study provides a realistic vision of the field’s