The education research component of the Pulsar Search Collaboratory (PSC) seeks to determine how the PSC experience affects the science identity and STEM career intentions of its participants and how individual programmatic elements influence persistence. These questions are investigated by comparing pre-‐survey and post-‐survey results and by examining the participant’s interaction with the PSC online portal.
This report d pre/posistilled t survey data that examines student participants’ STEM intentions along a number of dimensions: Science/Engineering Identity, Self-‐Efficacy, Science
This report presents findings from the evaluation of four Pulsar Search Collaboratory (PSC) activities: online training, use of website, capstone events at hub institutions, and the PSC summer camp.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This project is a retrospective study to explore the long-term impact of STEM programming. The study follows up with participants to ask questions like "Where are they now? What mattered? What difference did it make? and What’s next?"
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The project's goals are to:
Develop systems thinking skills in youth
Increase understanding of sustainable agricultural systems
Raise awareness of STEM careers related to agricultural systems
Leverage scientific research models and data for educational video games
Use the Corn-Water-Ethanol-Beef System as a model for interconnected Food, Energy, Water Systems (FEWS)
Environmental Protectors is a four-year project based at the University of California at Berkeley’s Lawrence Hall of Science. The project is designed to explore the educational and developmental impact of an informal science education programming model that features Community and Citizen Science (CCS) activities for youth of color residing in urban communities. The project is grounded in hypothesis that CCS-focused experiences result in learning outcomes that better position youth of color to more effectively engage in Science, Technology, Engineering, and Mathematics (STEM) related educational, occupational, and civic activities. Each year, in three economically challenged urban communities located throughout the country, youth of color between the ages of 14 and 18 will participate in month-long summer or semester-long afterschool programs. These programs will feature CCS-related activities that include collection, analysis, interpretation and presentation of data that addresses local, pressing environmental quality concerns, such as soil lead contamination and air particulate matter pollution. The project will use a mix of qualitative and quantitative data collection and analysis to assess the impact of youth engagement in these CCS activities. Overall, through its implementation the project aims to generate information useful in nationwide efforts designed to identify effective strategies and approaches that contribute to increasing STEM understanding and interest among youth of color.
Project research is guided by the following questions: A) What are ways to increase STEM engagement among those who have typically been underrepresented in Community and Citizen Science (CCS) research projects in particular and STEM in general? B) When youth are engaged in CCS, what outcomes are observed related to their science agency and science activism? What other unanticipated outcomes are observed related to benefits of participation and learning? C) How does science activism develop in youth participating in CCS?; and D) How do differences in program implementation impact youth outcomes. In particular, the project explores the manner in which particular CCS activities (e.g., project design, data analysis and interpretation, data presentation) impact youth “Science Agency,” defined as a combination of constructs that include Science Identity (i.e., sense of themselves as science thinkers), Science Value (i.e., awareness of the potential benefits of applying scientific practices to addressing critical community health and environmental issues) and Science Competency Beliefs (i.e., belief of themselves as competent science practitioners) and “Science Activism,” defined as a combination of perceived behavioral control and personal salience. Through its execution the project will refine a theory of learning that makes explicit connections between these constructs. Information derived from the execution of the project will contribute to deeper understanding of the potential for using of CCS projects as a key component of science education environments in urban areas and in general.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
Many Black youth in both urban and rural areas lack engaging opportunities to learn mathematics in a manner that leads to full participation in STEM. The Young People’s Project (YPP), the Baltimore Algebra Project (BAP), and the Education for Liberation Network (EdLib) each have over two decades of experience working on this issue. In the city of Baltimore, where 90% of youth in poverty are Black, and only 5% of these students meet or exceed expectations in math, BAP, a youth led organization, develops and employs high school and college age youth to provide after-school tutoring in Algebra 1, and to advocate for a more just education for themselves and their peers. YPP works in urban or rural low income communities that span the country developing Math Literacy Worker programs that employ young people ages 14-22 to create spaces to help their younger peers learn math. Building on these deep and rich experiences, this Innovations in Development project studies how Black students see themselves as mathematicians in the context of paid peer-to-peer math teaching--a combined social, pedagogical, and economic strategy. Focusing primarily in Baltimore, the project studies how young people grow into new self-definitions through their work in informal, student-determined math learning spaces, structured collaboratively with adults who are experts in both mathematics and youth development. The project seeks to demonstrate the benefits of investing in young people as learners, teachers, and educational collaborators as part of a core strategy to improve math learning outcomes for all students.
The project uses a mixed methods approach to describe how mathematical identity develops over time in young people employed in a Youth-Directed Mathematics Collaboratory. 60 high school aged students with varying mathematical backgrounds (first in Baltimore and later in Boston) will learn how to develop peer- and near-peer led math activities with local young people in informal settings, after-school programs, camps, and community centers, reaching approximately 600 youth/children. The high school aged youth employed in this project will develop their own math skills and their own pedagogical skills through the already existing YPP and BAP structures, made up largely of peers and near-peers just like themselves. They will also participate in on-going conversations within the Collaboratory and with the community about the cultural significance of doing mathematics, which for YPP and BAP is a part of the ongoing Civil Rights/Human Rights movement. Mathematical identity will be studied along four dimensions: (a) students’ sequencing and interpretation of past mathematical experiences (autobiographical identity); (b) other people’s talk to them and their talk about themselves as learners, doers, and teachers of mathematics (discoursal identity); (c) the development of their own voices in descriptions and uses of mathematical knowledge and ideas (authorial identity); and (d) their acceptance or rejection of available selfhoods (socio-culturally available identity). Intended outcomes from the project include a clear description of how mathematical identity develops in paid peer-teaching contexts, and growing recognition from both local communities and policy-makers that young people have a key role to play, not only as learners, but also as teachers and as co-researchers of mathematics education.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Jay GillenMaisha MosesThomas NikundiweNaama LewisAlice Cook
This innovations in development project will develop and study the Wéetespeme Stewardship Program (Wéetespeme: “I am of this land”). Tribal led, the project supports and studies climate science learning experiences grounded in traditional ecological knowledge, culturally relevant pedagogy, and land education pedagogy. Nez Perce high-school youth and college-age adults will choose specific species and places; work with tribal resource management offices to learn to monitor, assess, and mitigate climate impacts; and receive mentorship from tribal elders, as they co-develop climate-science adaptive management plans for local concerns. Adaptive management plans may include topics such as: drought and extreme weather impacts, shifts in animal populations and migration patterns, cultivating traditional foods, and managing important cultural sites. The Tribal research team will collaborate with curriculum developers and Indigenous graduate student(s) from the University of Idaho and Northwest Youth Corps to explore how a STEM curriculum centered on cultural identity and traditional knowledge can align with Indigenous youths’ identities, resource responsibilities, and understanding and interest in STEM career pathways within the Tribe and in the region. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This project’s approach to curriculum development, and youths’ identity and career interest development, will contribute to the informal STEM learning field’s nascent understanding of Tribal-driven education efforts, and approaches to blending or bridging traditional ecological knowledge and Western ways of knowing. With co-funding from the Directorate of Geosciences’ (GEO), this project will further advance efforts related to the application of traditional ecological knowledge to the geosciences, including Indigenous workforce development opportunities and research experiences for Indigenous graduate students.
Over a two-year duration, the study will address two research questions. 1) How and in what ways does a culturally relevant out-of-school curriculum support Indigenous youths’ understanding of their own identity, resource responsibility, and possible career pathways, including those on Tribal land? 2) How and in what ways does a culturally relevant out-of-school curriculum develop Indigenous youths’ ability to monitor and address climate change impacts, to protect, preserve and recover land relationships that are central to their cultural identities and values? Thirty-two college-age young adults and high-school youth (sixteen of each age group) will participate in the Wéetespeme Stewardship Program and research study. Indigenous research methodologies will guide the approach to investigating and sharing Indigenous youths’ understanding of their own identity, resource responsibility, possible career pathways, and learning experiences within the Wéetespeme Stewardship Program activities. Two Indigenous graduate students will play a central role in conducting the research, supporting systemic impacts within, and beyond, the Tribe. Methods will be embedded in learners’ experiences and will include field journals, adaptive management plans, story maps, and talk circles. Youth will also participate as research partners: understanding the research questions, assisting with the analysis, contributing to interpretation of the findings, and co-authoring manuscripts that share their stories and this work. The informal STEM curriculum will be shared regionally, allowing for Tribes in the plateau region to benefit from culturally relevant approaches youth engagement to support climate resilience. The results of the research will also be shared more broadly, contributing to the emerging knowledge-base about the ways that cultural practices and values, guided by land education pedagogy and the mentorship of traditional ecological knowledge keepers, and embedded in informal STEM learning experiences, can contribute to Indigenous youths’ identities and understanding of, and investment in, local and meaningful environmental resources and STEM career pathways.
DATE:
-
TEAM MEMBERS:
Nakia WilliamsonKarla Bradley EitelJeff ParkerJosiah Pinkham
Research suggests that when both science, technology, engineering, and mathematics (STEM) education and social-emotional development (SED) are supported in afterschool, summer, and other informal settings, young people can better develop skills for the future such as leadership, decision-making, and relationship-building so they could have successful careers/participation in STEM. However, researchers and practitioners working in the out-of-school time (OST) sector often do so without connections across these fields. The appeal for more integration of STEM and SED in OST program delivery and data collection has remained abstract and aspirational. This Literature Review and Synthesis project is the next step needed to move the OST field toward the intentional, explicit, and evidence-based integration of STEM and SED in research and practice. The project will create shared understanding necessary to improve program content, staff training, and evaluation. This synthesis will support future research on unified STEM+SED that can lead to more effective, equitable, and developmentally appropriate programming. Improved programming will contribute to talent development, address STEM workforce needs, and promote socioeconomic mobility to benefit children, youth, educators, and society. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project will systematically examine what domains and skills at the interface of STEM+SED are most researched among K-12 youth in informal STEM learning environments, compared to formal STEM educational environments. The team will further explore how gender, race, and other intersectional forms of equity can be added to the STEM+SED equation. The project team will search and appraise empirical and gray literature (2001-2020) to identify the most commonly researched domains and skills at the interface of STEM+SED in informal environments serving K-12 youth. The review and synthesis process will include four steps: search, appraisal, synthesis, and analysis. The search will begin with STEM+SED skills in four foundational domains (agency, belonging, engagement, and reflection) identified previously with experts from the fields of STEM and SED. The search will include all existing, eligible references from formal K-12 settings to contrast commonly studied domains and skills (e.g., perseverance, self-regulation, teamwork, complex problem-solving, self-awareness) in formal versus informal learning environments. The study approach will then compare these domains and skills by the demographics variables noted above. Following the creation of a strong catalog of evidence, information will be synthesized using three “pillars” for building coherence in STEM+SED integration: phenomenon (the knowing), implementation (the doing) and assessment (the result). These pillars will be used to organize and critically analyze the literature. Building conceptual coherence through a systematic review and synthesis of literature from the fields of STEM and SED will lead to greater understanding of STEM+SED in OST practice, highlight the most important content and skills to learn in informal environments, and identify when and how youth should learn specific content and skills at the interface of STEM+SED. Applying coherence to the integration of STEM+SED ensures that the principles and practices are layered carefully, in ways that avoid superficial checklists or duplication of effort and build meaningfully upon young people’s knowledge and skills. The long-term goal is to broker connections and alignment of STEM+SED across schools and OST programs. Recommendations and a roadmap to guide equitable, effective STEM+SED research, practice, and policy will result from this research.
To gather information about national opportunities for out-of-school time science, technology, engineering, and math (OST STEM) learning, Education Northwest conducted a systematic review of OST STEM programs for the Overdeck Family Foundation. The goal of this work was to better understand what programs and program elements have been successful in scaling up to regional and national levels. We were also interested in the evidence that these programs meet their academic and social goals with students, particularly students underrepresented in STEM, and how evidence of effectiveness relates to
Urban environments are remarkable natural laboratories to study ecology and speciation. These learning ecosystems are ecologically diverse and potentially more accessible for urban youth and their families. Unfortunately, disparities in STEM access continue to persist. Transportation, social and financial barriers, and a lack of awareness of STEM opportunities are a few of the inequities that significantly limit participation in STEM programs among urban youth, especially from underrepresented groups. Perceptions of who can meaningfully engage in scientific research remain demographically skewed to affluent, aged, and non-minoritized individuals. In an effort to address these challenges, this pilot study will investigate the feasibility of using remote cameras to survey local, urban wildlife to promote inclusive practices and youth engagement in STEM. A co-created curriculum will be employed, bringing urban ecologists and Detroit youth (6th-8th grade) together to participate in wildlife field experiences to garner and analyze data collected from cameras deployed through the city. It is the unique coupling of the camera surveys with authentic place-based, culturally relevant ecological research that will facilitate the innovative, experiential learning experiences. This pilot study will advance the understanding of the extent to which various facilitation methods and participation in out-of-school time programs like the Wildlife Neighbors program impact youth. From a broader impacts perspective, this work may yield positive environmental literacy outcomes and prove applicable for other urban youth in the country. The research findings would lay the foundation for future research and add novel approaches to the NSF portfolio on urban, out-of-school time environmental education programs for middle school youth using camera surveys to promote inclusivity, engagement in scientific field research, and increase youths' interest in STEM.
Through a strategic partnership between the Applied Wildlife Ecology Lab at the University of Michigan and the Detroit Zoological Society, this pilot will examine the effects of experiential learning through wildlife monitoring in twenty-four Detroit parks on strengthening four aspects of youth's environmental literacy: knowledge of ecology, competencies as researchers, empathy for wildlife, and sense of place. Youth will self-select into one of four facilitation models, each varying in intensity (summer experience, afterschool club) and mode (in-person, remote). Using camera surveys deployed in Detroit parks, youth will be immersed in ecological research, engaging them in the entire scientific process: observation, inquiry, data collection, fieldwork, data analysis and storytelling. Youth pre- and post-surveys, daily reflections on program activities, and parent/guardian questionnaires will assess impacts and experiences of the Wildlife Neighbors facilitation models and program more broadly. The research questions will explore the extent to which participation in Wildlife Neighbors: (a) differs across facilitation intensity and mode, and (b) strengthens environmental literacy among middle school urban youth when engaged in a co-created out-of-school time experiential program using remote cameras to survey local wildlife. Over the two-year pilot duration, approximately 100 youth and their families will participate in the program.
This pilot study is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Well-designed out-of-school time experiences can provide youth with rich opportunities to learn. However, to design effective out-of-school time experiences, it is critical to have a research basis that clarifies the features of programs that support increased youth engagement that then leads to better outcomes for youth. This project explores the features of programming that integrates sports, mathematics and science concepts, and growth mindset for 4th through 8th grade aged Latinx and African American youth. To accomplish this, the investigators refine curricular resources for out-of-school time programs and develop a model for professional learning experiences for informal educators and facilitators to support their implementation of integrated sports and STEM programming. To identify critical features of the programming, the researchers explore the ways that the program activities are implemented in two different contexts as well as the impact of the programming on youth participants' mindset, understanding of science and mathematics concepts, STEM interests, and self-perceived science and mathematics abilities. Additionally, researchers will explore the ways that the sports-themed programming supports (or could better support) girls' engagement.
The project builds on the University of Arizona researchers' existing partnerships with Major League Baseball (MLB) and Boys/Girls Club programs and an existing school-based MLB program for schools to (a) expand and refine Science of Baseball activities to enhance engagement among girls and incorporate growth mindset experiences that focus on the value of effort, determination, and learning from mistakes in both athletics and STEM; (b) study the enactment and outcomes of the program with 4th-8th grade aged youth in the two distinct informal learning settings; and (c) develop and refine a model for professional learning that includes in-person and on-line components for training informal STEM learning facilitators. The work will focus on two study contexts: afterschool programs of Boys and Girls Clubs in AZ, CA, and MO and summer programs of MLB in CA and MO. Participants will include 300 youth and up to 28 informal STEM learning facilitators split across the two contexts. Design-Based Implementation Research (DBIR) will be used to a) iteratively refine the activities and professional development model, and b) study the enactment and outcomes of the program. Research questions focus on outcomes for youth participants (i.e., impact on growth mindset, STEM dispositions, and understanding of science/math concepts), and the elements of effective professional development for informal STEM educators. Outcomes of the project include empirical evidence of what works and what doesn't work in the design, implementation, and professional development for STEM learning programs that integrate sports and growth mindset principles. In addition, outcomes of the project will advance knowledge of how different out-of-school program structures with similar sports-focused STEM programming can similarly (or differentially) support youth learning.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.