In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This briefing paper reports findings from the Youth Access & Equity in Informal Science Learning (ISL) project,
a UK-US researcher-practitioner partnership funded by the Science Learning+ scheme. Our project focuses on young people aged 11-14 primarily from under-served and non-dominant communities and includes researchers and practitioners from a range of ISL settings: designed spaces (e.g. museums, zoos), community-based (e.g. after school clubs) and everyday science spaces (e.g. science media).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This research project leverages ongoing longitudinal research to investigate whether, and if so how, youth from ages 10 to 15 in a diverse, under-resourced urban community become interested and engaged in STEM. The project addresses a global issue; fewer youth choose to major in scientific fields or take science coursework at high school or university levels. These declining numbers result in fewer STEM professionals and fewer scientifically literate citizens who are able to function successfully in an increasingly scientific and technological society. These declines are observed for youth as a whole, but are most pronounced for girls and particular non-white ethnic minorities. Data collected from youth in this community of study, including non-white ethnic minorities, mirrors this decline. NSF funding will support a five-year systematic and systemic process in which project researchers work collaboratively with existing informal and formal educational partners (e.g., museums, libraries, afterschool providers, schools) to develop sets of customized, connected, and coordinated learning interventions, in and out of school, for youth with different backgrounds, needs, and interests, all with the goal of averting or dampening this decline of STEM interest and participation during early adolescence. In addition to new research and community STEM networks, this project will result in a Community Toolkit that includes research instruments and documentation of network-building strategies for use by other researchers and practitioners nationally and internationally. This mixed methods exploratory study has two distinct but interrelated populations - youth and educators from across informal and formal institutions. To develop a clearer understanding of the factors that influence youths' STEM interest development over time, particularly among three youth STEM Interest Profiles identified in a secondary analysis (1-Dislike Math, 2-Like all STEM, 3-Dislike all STEM), the design combines surveys with in-depth interviews and observations. To study educators and institutions, researchers will combine interviews, focus groups, and observations to better understand factors that influence community-wide, data-driven approaches to supporting youth interest development. Research will be conducted in three phases with the goal of community-level change in youth STEM interest and participation. In Phase 1 (Years 1 & 2) four educational partners will develop interventions for a 6th and 7th grade youth cohort that will be iteratively refined through a design-based approach. Educational partners and researchers will meet to review and discuss interest and participation data and use these data to select content, as well as plan activities and strategies within their programs (using a simplified form of conjecture mapping). By Phase 2 (Years 3 & 4) four additional partners will be included, more closely modeling the complex system of the community. With support from researchers support and existing partners, new educational partners will similarly review and discuss data, using these to select content, as well as plan activities consistent with program goals and strategies. Additional interventions will be implemented by the new partners and further assessed and refined with a new 6th and 7th grade cohort, along with the existing interventions of the first four partners. In Phase 3 (Year 5) data will be collected on pre-post community-level changes in STEM interest and participation and the perceived effectiveness of this approach for youth. These data will inform future studies.