This practitioner guide summarizes lessons learned from a three-year design-based research project focused on using elements of narrative (such as characters, settings, and problem frames) to evoke empathy and support girls' engagement in engineering design practices. The guide includes a summary of the driving concepts and key research findings from this work, as well as design principles for creating narrative-based engineering activities. Six activity case studies illustrate the design principles in action, and facilitation tips and observation tools offer practical guidance in developing
The U.S. urgently needs the perspective and knowledge of females who are Latinx and African American in STEM fields. Providing early STEM interest pathways for these populations that are historically underrepresented in STEM fields is critical to creating gender equity in the STEM workforce. There are profound inequities in STEM fields for women of color that impact their interest and persistence in these fields. This Research in Service to Practice project will build important knowledge about early pathways for reducing these inequities by developing early interest in STEM. Gender stereotypes around who can do STEM are one of the sociocultural barriers that contributes to girls’ loss of interest in STEM. These stereotypes emerge early and steer young women away from STEM studies and pursuits. Exposing girls to role models is an effective strategy for challenging stereotypes of who belongs and succeeds in STEM. This project will explore how an afterschool program that combines narrative and storytelling approaches, STEM role models, and family supports, sparks elementary-age girls’ interest in STEM and fosters their STEM identity. The project targets K-5 students and families from underrepresented groups (e.g., Latinx and African American) living in poverty. The project will evaluate an inquiry-based, afterschool program that serves both elementary school girls and boys and explores if adding storytelling components to the out-of-school time (OST) learning will better support girls’ interest in STEM. The storytelling features include: 1) shared reading of books featuring females in STEM; 2) students’ own narratives that reminisce about their STEM experiences; and 3) video interviews of female parents and community members with STEM careers. A secondary aim of this project is to build capacity of schools and afterschool providers to deliver and sustain afterschool STEM enrichment experiences. Museum-based informal STEM experts will co-teach with afterschool providers to deliver the Children’s Museum Houston (CMH) curriculum called Afterschool Science, Technology, Engineering, Arts and Math (A’STEAM). Although A’STEAM has been implemented in over 100 sites and shows promise, to scale-up this and other promising afterschool programs, the team will evaluate how professional development resources and the co-facilitation approach can build afterschool educators' capacity to deliver the most promising approaches.
Researchers at the Children’s Learning Institute (CLI) at UTHealth will partner with Museum-based informal STEM educators at CMH, YES Prep, a high performing charter school serving >95% of underrepresented groups, and other afterschool providers serving mostly underrepresented groups experiencing poverty. Storytelling components that highlight females in STEM will be added to an existing afterschool program (A'STEAM Basic). This derivative program is called A’STEAM Stories. Both instantiations of the afterschool programs (Basic and Stories) include an afterschool educator component (ongoing professional development and coaching), a family component (e.g., home extension activities, in-person, and virtual family learning events), and two age-based groups (K-G2 and G3-G5). Further, the A’STEAM Stories professional development for educators includes training that challenges STEM gender stereotypes and explains how to make science interesting to girls. The 4-year project has four phases. In Phase 1, researchers, CMH, and afterschool educators will adapt the curriculum for scalability and the planned storytelling variation. During Phase 2, the research team will conduct an experimental study to evaluate program impacts on increasing STEM interest and identity and reducing STEM gender stereotypes. To this end, the project’s team will recruit 36 sites and 1200 children across Kindergarten through Grade 5. This experimental phase is designed to produce causal evidence and meet the highest standards for rigorous research. The researchers will randomly assign sites to one of three groups: control, A’STEAM Basic, or A’STEAM Stories. During Phase 3, researchers will follow-up with participating sites to understand if the inclusion of afterschool educators as co-facilitators of the program allowed for sustainability after Museum informal science educator support is withdrawn. In Phase 4, the team will disseminate the afterschool curriculum and conduct two training-of-trainers for local and national afterschool educators. This study uses quantitative and qualitative approaches. Data sources include educator and family surveys, focus groups, and interviews as well as observations of afterschool program instructional quality and analysis of parent-child discourse during a STEM task. Constructs assessed with children include STEM interest, STEM identity, and STEM gender stereotype endorsement as well as standardized measures of vocabulary, science, and math. Findings will increase understanding of how to optimize OST STEM experiences for elementary-age girls and how to strengthen STEM interest for all participants. Further, this project will advance our knowledge of the extent to which scaffolded, co-teaching approaches build capacity of afterschool providers to sustain inquiry-based STEM programs.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015.
Education Development Center is conducting the formative and summative evaluation of the project. To assess the
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015.
Education Development Center is conducting the formative and summative evaluation of the project. To assess the
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
Temple University's "Sisters in Science in the Community (SISCOM)" is a constructivist-based, inclusive youth/community project targeting underrepresented urban middle and high school girls in grades 6-10 and their families; it supports inclusion of girls with disabilities. It engages girls and their parents in hands-on, inquiry-based sports science in after-school, Saturday, and summer programs co-hosted by community-based organizations and Temple University. Girls will also be engaged in student-centered research projects guided by female scientists. With regard to intellectual merit, SISCOM is based on previous research done by Temple on methods for engaging girls and their parents in STEM activities. The infrastructure of research and practices in education will be facilitated through the sharing of information between the network of partners and the national community of formal and informal educators
Temple University's "Sisters in Science in the Community (SISCOM)" is a constructivist-based, inclusive youth/community project targeting underrepresented urban middle and high school girls in grades 6-10 and their families; it supports inclusion of girls with disabilities. It engages girls and their parents in hands-on, inquiry-based sports science in after-school, Saturday, and summer programs co-hosted by community-based organizations and Temple University. Girls will also be engaged in student-centered research projects guided by female scientists. With regard to intellectual merit, SISCOM is based on previous research done by Temple on methods for engaging girls and their parents in STEM activities. The infrastructure of research and practices in education will be facilitated through the sharing of information between the network of partners and the national community of formal and informal educators