In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The U.S. urgently needs the perspective and knowledge of females who are Latinx and African American in STEM fields. Providing early STEM interest pathways for these populations that are historically underrepresented in STEM fields is critical to creating gender equity in the STEM workforce. There are profound inequities in STEM fields for women of color that impact their interest and persistence in these fields. This Research in Service to Practice project will build important knowledge about early pathways for reducing these inequities by developing early interest in STEM. Gender stereotypes around who can do STEM are one of the sociocultural barriers that contributes to girls’ loss of interest in STEM. These stereotypes emerge early and steer young women away from STEM studies and pursuits. Exposing girls to role models is an effective strategy for challenging stereotypes of who belongs and succeeds in STEM. This project will explore how an afterschool program that combines narrative and storytelling approaches, STEM role models, and family supports, sparks elementary-age girls’ interest in STEM and fosters their STEM identity. The project targets K-5 students and families from underrepresented groups (e.g., Latinx and African American) living in poverty. The project will evaluate an inquiry-based, afterschool program that serves both elementary school girls and boys and explores if adding storytelling components to the out-of-school time (OST) learning will better support girls’ interest in STEM. The storytelling features include: 1) shared reading of books featuring females in STEM; 2) students’ own narratives that reminisce about their STEM experiences; and 3) video interviews of female parents and community members with STEM careers. A secondary aim of this project is to build capacity of schools and afterschool providers to deliver and sustain afterschool STEM enrichment experiences. Museum-based informal STEM experts will co-teach with afterschool providers to deliver the Children’s Museum Houston (CMH) curriculum called Afterschool Science, Technology, Engineering, Arts and Math (A’STEAM). Although A’STEAM has been implemented in over 100 sites and shows promise, to scale-up this and other promising afterschool programs, the team will evaluate how professional development resources and the co-facilitation approach can build afterschool educators' capacity to deliver the most promising approaches.
Researchers at the Children’s Learning Institute (CLI) at UTHealth will partner with Museum-based informal STEM educators at CMH, YES Prep, a high performing charter school serving >95% of underrepresented groups, and other afterschool providers serving mostly underrepresented groups experiencing poverty. Storytelling components that highlight females in STEM will be added to an existing afterschool program (A'STEAM Basic). This derivative program is called A’STEAM Stories. Both instantiations of the afterschool programs (Basic and Stories) include an afterschool educator component (ongoing professional development and coaching), a family component (e.g., home extension activities, in-person, and virtual family learning events), and two age-based groups (K-G2 and G3-G5). Further, the A’STEAM Stories professional development for educators includes training that challenges STEM gender stereotypes and explains how to make science interesting to girls. The 4-year project has four phases. In Phase 1, researchers, CMH, and afterschool educators will adapt the curriculum for scalability and the planned storytelling variation. During Phase 2, the research team will conduct an experimental study to evaluate program impacts on increasing STEM interest and identity and reducing STEM gender stereotypes. To this end, the project’s team will recruit 36 sites and 1200 children across Kindergarten through Grade 5. This experimental phase is designed to produce causal evidence and meet the highest standards for rigorous research. The researchers will randomly assign sites to one of three groups: control, A’STEAM Basic, or A’STEAM Stories. During Phase 3, researchers will follow-up with participating sites to understand if the inclusion of afterschool educators as co-facilitators of the program allowed for sustainability after Museum informal science educator support is withdrawn. In Phase 4, the team will disseminate the afterschool curriculum and conduct two training-of-trainers for local and national afterschool educators. This study uses quantitative and qualitative approaches. Data sources include educator and family surveys, focus groups, and interviews as well as observations of afterschool program instructional quality and analysis of parent-child discourse during a STEM task. Constructs assessed with children include STEM interest, STEM identity, and STEM gender stereotype endorsement as well as standardized measures of vocabulary, science, and math. Findings will increase understanding of how to optimize OST STEM experiences for elementary-age girls and how to strengthen STEM interest for all participants. Further, this project will advance our knowledge of the extent to which scaffolded, co-teaching approaches build capacity of afterschool providers to sustain inquiry-based STEM programs.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.
The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.
By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Todd BoyetteJill HammJanice AndersonCrystal Harden
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
Science, technology, engineering, and mathematics (STEM) education and programming has become a priority in our nation. In the United States, the STEM pipeline is considered "leaky" as many students disengage from STEM at various points during their lives. In particular, women, Latinos, and African Americans are more likely to disengage from the STEM pipeline. American students are less likely to earn STEM postsecondary and graduate degrees compared to other nations. As careers in STEM fields are expected to increase at a faster rate than other occupations, there is growing concern about the
DATE:
TEAM MEMBERS:
Annette ShtivelbandAmanda Wallander RobertsRobert Jakubowski
This paper sketches the context for participation in science by girls from historically underrepresented populations and offers a detailed description of Sisters4Science (S4S) and its personalized, girl-centered pedagogy. The S4S example suggests a need to complement current out-of-school science programs with lessons from girl-centered practice and research.
This presentation given at the 2013 Materials Research Society (MRS) Spring Meeting examines evidence for the effectiveness of STEM education programs at the National High Magnetic Field Laboratory.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.