Research suggests that when both science, technology, engineering, and mathematics (STEM) education and social-emotional development (SED) are supported in afterschool, summer, and other informal settings, young people can better develop skills for the future such as leadership, decision-making, and relationship-building so they could have successful careers/participation in STEM. However, researchers and practitioners working in the out-of-school time (OST) sector often do so without connections across these fields. The appeal for more integration of STEM and SED in OST program delivery and data collection has remained abstract and aspirational. This Literature Review and Synthesis project is the next step needed to move the OST field toward the intentional, explicit, and evidence-based integration of STEM and SED in research and practice. The project will create shared understanding necessary to improve program content, staff training, and evaluation. This synthesis will support future research on unified STEM+SED that can lead to more effective, equitable, and developmentally appropriate programming. Improved programming will contribute to talent development, address STEM workforce needs, and promote socioeconomic mobility to benefit children, youth, educators, and society. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project will systematically examine what domains and skills at the interface of STEM+SED are most researched among K-12 youth in informal STEM learning environments, compared to formal STEM educational environments. The team will further explore how gender, race, and other intersectional forms of equity can be added to the STEM+SED equation. The project team will search and appraise empirical and gray literature (2001-2020) to identify the most commonly researched domains and skills at the interface of STEM+SED in informal environments serving K-12 youth. The review and synthesis process will include four steps: search, appraisal, synthesis, and analysis. The search will begin with STEM+SED skills in four foundational domains (agency, belonging, engagement, and reflection) identified previously with experts from the fields of STEM and SED. The search will include all existing, eligible references from formal K-12 settings to contrast commonly studied domains and skills (e.g., perseverance, self-regulation, teamwork, complex problem-solving, self-awareness) in formal versus informal learning environments. The study approach will then compare these domains and skills by the demographics variables noted above. Following the creation of a strong catalog of evidence, information will be synthesized using three “pillars” for building coherence in STEM+SED integration: phenomenon (the knowing), implementation (the doing) and assessment (the result). These pillars will be used to organize and critically analyze the literature. Building conceptual coherence through a systematic review and synthesis of literature from the fields of STEM and SED will lead to greater understanding of STEM+SED in OST practice, highlight the most important content and skills to learn in informal environments, and identify when and how youth should learn specific content and skills at the interface of STEM+SED. Applying coherence to the integration of STEM+SED ensures that the principles and practices are layered carefully, in ways that avoid superficial checklists or duplication of effort and build meaningfully upon young people’s knowledge and skills. The long-term goal is to broker connections and alignment of STEM+SED across schools and OST programs. Recommendations and a roadmap to guide equitable, effective STEM+SED research, practice, and policy will result from this research.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Ronda JensonKelly Roberts
resourceevaluationProfessional Development, Conferences, and Networks
Summative evaluation study for the Space Earth and Informal Science Education (SEISE) project examining professional impacts including project reach, partnerships, professional knowledge, and professionals' use of the project’s public-facing products and their implementation of practices for engaging the public
Over the course of the five-year NASA grant, the Space and Earth Informal STEM Education (SEISE) project offered a range of free professional development opportunities and resources to support informal educators’ ability to offer Earth and space programming and to partner with others
In order for children to identify with STEM fields, it is essential that they feel there is a place within STEM for individuals “like them.” Unfortunately, this identification is difficult for Hispanic/Latine youths because of lack of representation and even stereotyping that is widespread in educational institutions in the United States. Some research has been done, though, that suggests there is promise in understanding the ways that parents help children see themselves as “STEM people” in spite of these obstacles. Building on this work, we present some of our own research on the experiences
In this paper, we examine the relationship between participants’ childhood science, technology, engineering, and mathematics (STEM) related experiences, their STEM identity (i.e., seeing oneself as a STEM person), and their college career intentions. Whereas some evidence supports the importance of childhood (i.e., K‐4) informal STEM education experiences, like participating in science camps, existing research does not adequately address their relationship to STEM career intention later in life. Grounding our work in identity research, we tested the predictive power of STEM identity on career
Drawing on results from a recent national study, we draw attention to the importance of the experiential learning cycle for enhancing meaningful outcomes of interpretive and educational experiences. The experiential learning cycle involves participating in a concrete experience, reflecting on that experience, drawing out lessons learned and principles from that reflection, and putting that knowledge to work in a new situation. Recent studies reveal that attention to completing all four stages of the experiential learning cycle can enhance positive outcomes for participants in educational and
Knowing how specific publics understand and experience science is crucial for both researchers and practitioners. As learning and meaning-making develop over time, depending on a combination of factors, creative possibilities to analyze those processes are needed to improve evaluation of science communication practices. We examine how first grade children's drawings expressed their perceptions of the Sun and explore their views of a major astronomical body within their social, cultural and personal worlds. We then examine how the observation of the Sun through a telescope led to changes in
DATE:
TEAM MEMBERS:
Sara AnjosAlexandre AibéoAnabela Carvalho
This Masters project consists of two elements: 1) an integrated after-school program to improve student English language reading and academic outcomes for third graders' vocabulary development by incorporating music, artistic creativity and linguistics; 2) a pilot sample curriculum that demonstrates the approach for building student comprehension through musical theater and Science, Technology, Engineering, and Mathematics (STEM) content experiences. Called "Water Buddy", this is an after-school program uses singing, dancing, writing, and play to build reading and vocabulary skills. The goal
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Implementation of a permanent exhibit and supporting programs exploring themes of labor, immigration, and the changing nature of work and community in New Bedford’s commercial fishing industry.
To produce "More Than a Job: Work and Community in New Bedford’s Commercial Fishing Industry," a permanent exhibit, digital exhibits, K-12 curriculum materials, and significant public programming exploring themes of labor and immigration, and the changing nature of work and community in New Bedford's commercial fishing industry.
The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. An ongoing challenge to the design of effective STEM learning exhibits for diverse young children is the absence of reliable and evidence-based resources that designers can apply to the design of STEM exhibits that draw upon play as a child's primary pedagogy, while simultaneously engaging children with STEM content and processes that support development of STEM skills such as observation. To address these challenges, the project team will use a collaborative process in which learning researchers and informal STEM practitioners iteratively develop, design, and test the STEM for Play Framework that could then be applied to the design of STEM-focused exhibits that support play and STEM skill use among early learners.
This Research in Service to Practice project will address these questions: 1) What is a framework for play in early STEM learning that is inclusive of children's cultural influences?; 2) To what extent do interactions between early learners (ages 3-8) and caregivers or peers at exhibits influence the structure and effectiveness of play for supporting STEM skill development?; 3) How do practitioners link play to STEM skill development, and to what extent does a framework for play in early STEM learning assist in identifying types of play that supports early STEM skill development?; and 4) What do practitioners identify as best practices in exhibit design that support the development of STEM skills for early childhood audiences, and conversely, to what extent do practitioners perceive specific aspects of the design as influential to play? The project team will address these questions across four phases of study that will include (a) development of a critical research synthesis to inform the initial STEM for Play framework; (b) the use of surveys, focus groups, and interviews to solicit feedback from practitioners; (c) testing and revising the framework by conducting structured observations of STEM exhibits at multiple museums. The project team will use multiple analytic approaches including qualitative thematic analyses as well as inferential statistics. Results will be disseminated to children?s museums, science centers, and research communities.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As an emerging field of theory, research, and practice, STEAM (Science, Technology, Engineering, Arts and Mathematics) has received attention for its efforts to incorporate the arts into the rubric of STEM learning. In particular, many informal educators have embraced it as an inclusive and authentic approach to engaging young people with STEM. Yet, as with many nascent fields, the conceptualization and usage of STEAM is somewhat ambivalent and weakly theorized. On the one hand, STEAM offers significant promise through its focus on multiple ways of knowing and new pathways to equitable