This project addresses a longstanding problem in informal science education: how to increase the likelihood of consequential science, technology, engineering, and mathematics (STEM) learning from short duration experiences such as field trips. Although informal learning experiences can greatly contribute to interest in and knowledge of science, there is a shared concern among educators and researchers that students may have difficulty recalling and using scientific information and practices emphasized during these experiences, even though doing so would further their science learning. Nonetheless, science learning is rarely, if ever, a "one-shot deal." Children acquire knowledge about science cumulatively across different contexts and activities. Therefore, it is important that informal science learning institutions identify effective practices that support the consolidation of learning and memory from exhibit experiences to foster portable, usable knowledge across contexts, such as from informal science learning institutions, to classrooms, and homes. To this end, this Research in Service to Practice project seeks to harness the power and potential of visual representations (e.g., graphs, drawings, charts, maps, etc.) for enhancing learning and encouraging effective reflection during and after science learning experiences. The project promises to increase learning for the 9,000+ 5th and 6th grade students from across the rurality and growing diversity of the state of Maine who annually participate in LabVenture, a 2.5-hour exploration of the Gulf of Maine ecosystem at Gulf of Maine Research Institute. The research will provide new and actionable informal science learning practices that promote engagement with visual representations and reflection, and science understandings that can be applied broadly by informal science institutions. This project is funded by the Advancing Informal STEM Learning (AISL) and the Discovery Research PreK-12 (DRK-12) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the DRK-12 program goal of enhancing the learning and teaching of STEM by preK-12 students and teachers.
The project is grounded in the idea that visual representations, including drawings, can both enhance science learning and encourage reflection on doing science that can support extension of that learning beyond a singular informal science experience. The project uses design-based research to address the following research questions: (1) Does reflection during an informal science learning experience promote students’ retention and subsequent use of science information and practices that are part of the experience? (2) Does interpreting and constructing visual representations, such as drawings, improve students’ understanding and retention of information, and if so, how and when? and (3) Does combining visual representations and narrative reflections confer benefits on students’ science learning and engagement in science practices both during the informal learning experience, and later in their classrooms and at home? These questions will be pursued in collaboration with practitioners (both informal educators and classroom teachers) and a diverse team of graduate and undergraduate student researchers. Approximately 600 student groups (roughly 3000 individual students) will be observed during the LabVenture experience, with further data collection involving a portion of these students at school and at home. The project will yield resources and video demonstrations of field-tested, empirically based practices that promote engagement with visual representations and reflection, and science understandings that can travel within students' learning ecosystem. In support of broadening participation, the undergraduate/graduate student researchers will gain wide understanding and experience connecting research to practice and communicating science to academic and nonacademic audiences.
Research suggests that when both science, technology, engineering, and mathematics (STEM) education and social-emotional development (SED) are supported in afterschool, summer, and other informal settings, young people can better develop skills for the future such as leadership, decision-making, and relationship-building so they could have successful careers/participation in STEM. However, researchers and practitioners working in the out-of-school time (OST) sector often do so without connections across these fields. The appeal for more integration of STEM and SED in OST program delivery and data collection has remained abstract and aspirational. This Literature Review and Synthesis project is the next step needed to move the OST field toward the intentional, explicit, and evidence-based integration of STEM and SED in research and practice. The project will create shared understanding necessary to improve program content, staff training, and evaluation. This synthesis will support future research on unified STEM+SED that can lead to more effective, equitable, and developmentally appropriate programming. Improved programming will contribute to talent development, address STEM workforce needs, and promote socioeconomic mobility to benefit children, youth, educators, and society. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project will systematically examine what domains and skills at the interface of STEM+SED are most researched among K-12 youth in informal STEM learning environments, compared to formal STEM educational environments. The team will further explore how gender, race, and other intersectional forms of equity can be added to the STEM+SED equation. The project team will search and appraise empirical and gray literature (2001-2020) to identify the most commonly researched domains and skills at the interface of STEM+SED in informal environments serving K-12 youth. The review and synthesis process will include four steps: search, appraisal, synthesis, and analysis. The search will begin with STEM+SED skills in four foundational domains (agency, belonging, engagement, and reflection) identified previously with experts from the fields of STEM and SED. The search will include all existing, eligible references from formal K-12 settings to contrast commonly studied domains and skills (e.g., perseverance, self-regulation, teamwork, complex problem-solving, self-awareness) in formal versus informal learning environments. The study approach will then compare these domains and skills by the demographics variables noted above. Following the creation of a strong catalog of evidence, information will be synthesized using three “pillars” for building coherence in STEM+SED integration: phenomenon (the knowing), implementation (the doing) and assessment (the result). These pillars will be used to organize and critically analyze the literature. Building conceptual coherence through a systematic review and synthesis of literature from the fields of STEM and SED will lead to greater understanding of STEM+SED in OST practice, highlight the most important content and skills to learn in informal environments, and identify when and how youth should learn specific content and skills at the interface of STEM+SED. Applying coherence to the integration of STEM+SED ensures that the principles and practices are layered carefully, in ways that avoid superficial checklists or duplication of effort and build meaningfully upon young people’s knowledge and skills. The long-term goal is to broker connections and alignment of STEM+SED across schools and OST programs. Recommendations and a roadmap to guide equitable, effective STEM+SED research, practice, and policy will result from this research.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This is a survey we developed in 2018 for our exploratory research study of listeners and their parents/guardians of the children's science podcast, Brains On!. The survey includes questions about who listens, when and where children listen, children's listening behaviors, motivations for listening, activities after listening, household information, and demographic questions.
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
Using a design-based research approach, we studied ways to advance opportunities for children and families to engage in engineering design practices in an informal educational setting. 213 families with 5–11-year-old children were observed as they visited a tinkering exhibit at a children’s museum during one of three iterations of a program posing an engineering design challenge. Children’s narrative reflections about their experience were recorded immediately after tinkering. Across iterations of the program, changes to the exhibit design and facilitation provided by museum staff corresponded
DATE:
TEAM MEMBERS:
Maria MarcusDiana AcostaPirko TouguDavid UttalCatherine Haden
Kid-focused STEM podcasts have grown in popularity over the years, but the ISE field lacks knowledge of the impact and value of this medium as a means for engaging children and families in science learning and discovery. This research summary shares the results of an exploratory study of the popular children's science podcast, Brains On!, in an effort to being to fill this knowledge gap.
The research was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On
The Brains On! exploratory research study was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On! listeners using the podcast and engaging with its content?
What kinds of impacts does Brains On! have on its audiences?
These questions were answered through a three-phase mixed-methods research design. Each phase informed the next, providing additional insights into answering the research questions. Phase 1 was a review of a sample of secondary data in the
Awareness of a STEM discipline is a complex construct to operationalize; a learner’s awareness of a discipline is sometimes viewed through the lens of personal identity, use of relevant discourse, or knowledge of career pathways. This research proposes defining engineering awareness through a learner’s associations with engineering practices - fundamental processes involved in engineering such as identifying criteria and constraints, testing designs, diagnosing issues and assessing goal completion. In this study, a learner’s engineering awareness was determined by examining 1) their ability to
This paper provides detailed descriptions of the goals, theoretical perspectives, context, and methods used in A study of collaborative practices at interactive engineering challenge exhibits (the C-PIECE Study), the first of two studies in the Designing Our Tomorrow (DOT) research program. The C-PIECE Study supported foundational and exploratory lines of inquiry related to engineering practices used by families engaging with design challenge exhibits. This paper describes the study background and methods as an anchor to four other products that detail these four specific lines of inquiry and
Chicago Children’s Museum (CCM) closed its doors to the public in March 2020 to help stop the spread of COVID-19. Like many learning spaces, CCM needed to switch from in-person to online interactions to continue connecting with our community during the pandemic. Museum educators soon began making videos at home, building upon our best practices for interacting with guests at the museum. Here are some tips gained by staff that we hope other museum professionals can use and adapt for your online programming!