Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
Children Investigating Science with Parents and Afterschool (CHISPA) was a collaboration between the Phillip and Patricia Frost Museum of Science, UnidosUS (formerly National Council of La Raza), and the ASPIRA Association that took place from 2014-18. CHISPA sought to address the disparity in science achievement among Latino and non-Latino children through local-level partnerships between science museums in metropolitan areas with growing Latino populations and UnidosUS and ASPIRA affiliate organizations serving the same communities through afterschool programs.
Partners included the
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
Through the Scientists for Tomorrow pathways project, The Science Institute at Columbia College in Chicago will test a model for preparing non-science major, pre-service elementary school teachers to deliver three ten-week informal science education modules to youth in after school programs. The initiative will bring engineering concepts, environmental science, and technology to approximately 240 urban Chicago youth (ages 10-14 years old) and their families. The Science Institute will partner with eight minority serving community based organizations and the Museum of Science and Industry, the Field Museum, and the Garfield Park Conservatory Alliance to develop and implement all aspects of the program. The goals of the program are two-fold. First, the project will develop and implement a high-quality STEM based afterschool program for under-represented youth in STEM. Second, the professional development and experience implementing the curriculum with youth in the local communities and within informal science education (ISE) institutions will extend and enrich the pre-service teachers\' STEM content and pedagogical knowledge base and better prepare them to teach science in formal and informal settings. Thirty teachers will receive specialized professional development through a seminar, course, and other support mechanisms in order to best support the implementation of the modules, while building their STEM content expertise, confidence, and pedagogical knowledge. Each module has a different STEM content focus: alternative energy (fall), the physics and mathematics of sound and music (winter), and environmental science (spring). At the end of each module, a culminating youth-led presentation will be held at one of the partnering Chicago museums. Youth will be encouraged to participate in all three modules. The formative evaluation will be conducted by the Co-Principal Investigators. Pre and post assessments, artifact reviews, and interviews will be used for the summative evaluation, which will be conducted by an external evaluator at the Illinois Institute of Technology. The project deliverables include: (a) a teacher training program, (b) an after school curriculum, and (c) media tools - DVDs, website. Over the grant period, the project intends to reach 120 youth each year, over 100 family and community members, and 30 teachers. The larger impact of this project will be the development of a scalable model for bringing relevant STEM content and experiences to youth, their families, and non-science major pre-service teachers. As a result of this project, a cadre of pre-service teachers will have: (a) increased their STEM content knowledge, (b) gained experience presenting STEM content in informal settings, (c) learned effective approaches to deliver hands-on STEM content, and (d) learned to use museum and other ISE resources in their teaching. In fact, after the grant period nearly half of the teachers will continue to work at the centers as part-time instructors, fully supported by the partnering community centers.
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
The data collection for this project involves three audiences: (1) a post-event survey completed by participants at the 'Eight-Legged Encounters' event, (2) a club experience survey completed by middle school students in an after school club, and (3) focus groups, observations, and end-of-course evaluations conducted with students in the BIOS 497/897 'Communicating Science through Outreach' seminar class at the University of Nebraska-Lincoln. Data was collected from February to April, 2013 and the evaluation was conducted by the Bureau of Sociological Research (BOSR). Appendix contains surveys
DATE:
TEAM MEMBERS:
University of Nebraska-LincolnEileen Hebets
This project is a full-scale development project that builds upon a pilot program funded by the NSF in 2007 (LEAP into Science/Pilot), developed by The Franklin Institute (FI) in collaboration with The Free Library of Philadelphia. By connecting children’s literature and hands-on science activities in out-of-school settings, LEAP/Pilot has promoted student and family engagement in science and literacy in Philadelphia for over six years. In 2011, a cohort of ten national sites joined the initiative to pilot LEAP into Science resources in multiple out-of-school time contexts and within unique institutional partnerships. The 10 sites, consisting of 27 institutional partnerships representing a diverse group of organizations (museums, libraries, K-12 school districts, universities, and public media). Through continued collaboration in Philadelphia and with these national cohort sites, LEAP into Science: Engaging Diverse Community Partners in Science and Literacy is leveraging the relationships, experiences, and resources initiated in LEAP /Pilot to address the needs of new audiences, meet partners’ requests for enhanced professional development, and study the efficacy of this program in different out-of-school time structures and populations across the country. The result will be an adaptable program that more effectively reaches diverse audiences in science and literacy through community partners, as well as a stronger understanding of implementation for improved sustainability.
The Museum of Aviation: STEM-ulating Georgia's Future Workforce Through Outreach project will build partnerships between the Museum of Aviation, STARBASE, six Georgia school districts, NASA, and volunteer mentors that promote STEM literacy, awareness of NASA's mission, and encourage the pursuit of STEM careers. This goal will be achieved through meeting the following objectives: -Promote lifelong learning by students, educators, and families, using NASA-themed STEM and missions via six outreach programs serving 10,750 participants (including 9,000 students, 1,600 parents, and 150 teachers). -Improve the understanding of NASA's missions, contributions to STEM disciplines and careers by students and faculty in grades pre K-8 by at least 35%. To accomplish the objectives, 6 STEM-based outreach programs will be provided to 12 school districts and will serve students, parents, and teachers. -ACE on the Go - STEM Modules use hands-on interactive activities for 2nd-5th graders -Family STEM Night - provides 2nd-5th graders and their families an opportunity to partake in 15 or more hands-on, interactive experiments that demonstrate STEM principles. -Aviation Outreach - introduces 6th-8th graders to aviation, and to STEM related careers. -STEM Afterschool - 6th-8th graders will learn about forces and motion and how forces make flight possible. -STARBASE 2.0 Afterschool STEM Mentoring Club consists of two components - a STEM Academy and a STEM Mentoring Afterschool Program both for underserved and at-risk youth in grades 6-8. -Teacher Training – STEM Workshops for teachers through the Georgia NASA RERC. This project will help to strengthen Georgia's future workforce by targeting students traditionally underserved and underrepresented in communities and in STEM fields. It will help attract and retain students in STEM disciplines by engaging students in STEM education and exposing them to STEM careers, and connect students, teachers, and families to NASA's mission by building strategic partnerships with formal education providers. The project will also help to strengthen the nation's and NASA's future workforce, attract and retain students in STEM disciplines, and engage Americans in NASA's mission.
This Pathways project from the Ocean Discovery Institute (ODI) seeks to develop and pilot a program model designed to fill an identified gap in citizen science research and practice literature: how to effectively engage and better understand how to foster participation among people from under-represented groups in citizen science research. The ODI model is designed around six principles: (1) leaders who are reflective of the community, (2) science that is locally relevant, (3) guided, as opposed to self-guided, experiences, (4) direct interactions with scientists, (5) progressively increasing responsibilities for participants who express interest, and (6) removing barriers to participation, such as transportation, language, family involvement and access to technology. The project addresses environmentally degraded, crime-ridden local canyons, a locally relevant STEM-related issue, and leverages the Southern California Coastal Water Research Project's (SCCWRP) regional citizen science effort focused on identifying the sources and pathways of trash through regional watersheds. The scientific research components of the project focus on four canyons in the area, employing sampling methods developed by SCCWRP. Youth who are part of other ODI programs and who have demonstrated leadership and interest in science, work with the project team to scaffold family and youth participation in project activities taking place during afterschool and weekend time. Based on continued participation in the project, community participants can become more involved in the project, starting as "new scientists" and moving through "returning scientists" to "expert scientists" roles. The project evaluation seeks to identify the role and importance of the components of the proposed model with respect to participation, retention, and learning by participants from groups under-represented in STEM. The dissemination products of this Pathways project include a white paper describing the model and lessons learned as well as presentations to community groups and education and citizen science practitioners. Based on insights from the iterative approach to the model during this Pathways study, a subsequent full-scale development project would seek to engage citizen science projects around the nation in adapting the model to increase participation of individuals from groups underrepresented in STEM, including building out ODI's citizen science programming.
DATE:
-
TEAM MEMBERS:
Lindsay GoodwinRoxanne RuzicTheresa Sinicrope Talley
The project is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs). The project builds on the foundation of an NSF-supported afterschool science program--APEX (Afterschool Program Exploring Science). In collaboration with National Council of La Raza (NCLR), and ASPIRA, the project adapts APEX into a bilingual English/Spanish format and, using a train the trainer model, disseminates it nationally, using a train the trainer model. Each of the ten local project sites will build on a partnership between a science museum and a CBO affiliate of NCLR or ASPIRA. The project is designed to: (1) Build the organizational capacity of partner science museums to work with CBOs and the Hispanic community. (2) Strengthen links between science museums and Hispanic serving CBOs in their communities. (3) Engage the expertise, involvement, and collaboration of national Hispanic-serving organizations, NCLR and ASPIRA, in STEM education. (4) Increase the engagement of Hispanic children and families in STEM. The project evaluation will investigate how effectively the project builds the organizational capacity of partner museums and CBOs in engaging Hispanic children and families in STEM; the types and strength of science museum/CBO partnerships; the effectiveness of the project in increasing Hispanic student and family engagement in STEM, and the types of contributions the project makes to the field of informal STEM learning. The evaluation will use qualitative and quantitative methods, including surveys, interviews, case studies, social network and collaboration analysis, observations, activity tracking, embedded assessment, photo elicitation, and focus groups.
Backyard Mystery is an NSF-funded curriculum, focused on diseases, pathogens and careers, using interactive paper and physical activities. Content is for middle school participants in afterschool settings, like 4-H and other similar venues. The curriculum engages student interest in genetics and genomics and in the bioSTEM workforce. The curriculum storyline is placed in a familiar setting to students--the backyard--and explores fungi, bacteria, viruses and parasites in a way that is engaging fun and informative. It can be tailored to specific audiences, e.g. participants interested in animal science will gain from focusing on the parasite panel. The curriculum is available in two forms: a combined lesson that brings all of the elements together in one session and another in which the content is broken out into three separate lessons. We would like to share this curriculum with facilitators and educators for both out-of-school time and classroom settings. It is available electronically and free to use. We only ask for users to complete a brief survey to give us feedback, which is helpful for NSF.
In October 2007, The Franklin Institute Science Museum (FI) in partnership with the Free Library of Philadelphia was awarded a 5-year National Science Foundation grant to build a model museum/library partnership. This partnership project, called LEAP into Science, integrates science content and inquiry into an existing afterschool program at the Library, called LEAP. More specifically, LEAP into Science has three overarching goals: 1) To increase the capacity of influential adults for science teaching and learning; 2) To increase the capacity of libraries for science teaching and learning; 3)
DATE:
TEAM MEMBERS:
Jessica LukeFranklin InstituteJeanine E. AnceletClaudia Figueiredo