This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Informal STEM education spaces like museums can intentionally serve surrounding communities and support sustainable and accessible engagement. Building from this base, the project takes a stance that the intersection of the museum, home/family life and the youth’s internal practices and disciplinary sense of self are rooted in history and culture. Thus, this CAREER work builds on the following principles: Black families and youth have rightful presence in STEM and in STEM learning environments; Black families are valuable learning partners; and Black youths need counterspaces to explore STEM as one mechanism for creating future disciplinary agency. In partnership with the Henry Ford Museum and the Detroit-Area Pre-College Engineering Program, the project seeks to (a) expand the field's understanding of how Black youth engineer and innovate; (b) investigate the influence of a culturally relevant curriculum on their engineering practices and identity, knowledge, and confidence; and (c) describe the ways Black families and museums support youth in engineering learning experiences. The work will center on the 20-hour “Innovate” curriculum which was designed by the museum to bridge design, innovation, and creation practices with the artifacts of innovators throughout time. The project comprises six weekend “Innovate” sessions and an at-home innovation experience plus participation in an annual Invention Convention. By focusing on these aims, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
The main research questions of this multiphase CAREER award are: (1) What practices do Black youths and families engage in as they address engineering, design, and innovation challenges? (2) In what ways does a culturally relevant museum-based innovation program influence the design and innovation practices and assessment performance of Black youths and families as they engage in engineering, design, and innovation across learning settings? (3) How does teaching innovation, design, and engineering through historical re-telling and reconstruction influence a youth’s perception of their own identities, abilities, and practices? and (4) How do Black families engage with informal STEM learning settings and what resources best support their engineering, design, and innovation exploration? Youth in sixth grade are the focus of the research. The work is guided by ecological systems, sociocultural learning, culturally relevant pedagogy, and community cultural wealth theories. During phase one, the focus will be to refine the curriculum and logistics of the study implementation. The investigator will enhance the curriculum to include narratives of Black innovators and engineers. Fifteen families will be recruited to participate in the program enhancement pilot and initial research cycle for phase two. In phase three another cohort of families will be recruited to participate. Survey research, narrative inquiry and digital ethnography will comprise the approaches to explore the research questions. The evaluation has a two-pronged focus: to assess (1) how well the enhanced Innovate curriculum and museum/home learning experience supports Black families’ participation and (2) how well the separate phases of the study connect and operate together to meet the research aims. The study’s findings can help families and informal practitioners leverage evidence-based approaches to support Black youth in making connections between history and out-of-school contexts to model and develop their innovative engineering practices. Additionally, this work has implications for Black undergraduate students who will develop skills through their mentorship and researcher roles, studying cultural practices and learning experiences. The research study and findings can inform the design of future museum/home learning programs and research opportunities for Black learners in informal learning spaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
This three-year project focuses on professional research experiences for middle and high school STEM teachers through investigations of the Great American Biotic Interchange (GABI). Each year 10 teachers (in diverse fields including biology, chemistry, earth and environmental sciences, and oceanography) and three to five professional paleontologists will participate in a four-phase process of professional development, including: a (1) pre-trip orientation (May); (2) 12 days in Panama in July collecting fossils from previously reported, as well as newly discovered, sites; (3) a post-trip on-line (cyber-enabled) Community of Practice; and (4) a final wrap-up at the end of each cohort (December). In addition, some of the teachers may also elect to partner with scientists in their research laboratories, principally located in California, Florida, and New Mexico. The partners in Panama are from the Universidad Autónoma de Chiriquí (UNACHI), including faculty and students, as well as STEM teachers from schools in Panama. Teachers that participate in this RET will develop lesson plans related to fossils, paleontology, evolution, geology, past climate change, and related content aligned with current STEM standards.
The GABI, catalyzed by the formation of the Isthmus of Panama during the Neogene, had a profound effect on the evolution and geography of terrestrial organisms throughout the Americas and marine organisms globally. For example, more than 100 genera of terrestrial mammals dispersed between the Americas, and numerous marine organisms had their interoceanic distributions cut in half by the formation of the Isthmus. Rather than being considered a single event that occurred about 4 million years ago, the GABI likely represents a series of dispersals over the past 10 million years, some of which occurred before full closure of the Isthmus. New fossil discoveries in Panama resulting from the GABI RET (Research Experiences for Teachers) are thus contributing to the understanding of the complexity and timing of the GABI during the Neogene.
This award is being co-funded with the Office International and Integrative Activities.
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This presentation "Revealing Impacts: How does one long-term, statewide field trip program influence a community's learning ecosystem?" was shared as showcase at the 2021 Connected Learning Summit (https://app.clowdr.org/conference/clsummit2021/) held virtually from July 7-30, 2021.
In the showcase session, we shared details of an NSF funded collaborative project between the Gulf of Maine Research Institute, Oregon State University and TERC to understand how a longstanding, statewide field trip program, LabVenture, influences a community’s learning ecosystem. The project uses the construct
Cities need to know how their cultural institutions related to each other; yet these institutions themselves struggle to understand what their niche can and should be in a city (Kloosterman, 2014). However the public often implicitly ‘knows’ the role of a particular cultural institution within an urban ecology; increasingly this knowledge is made manifest on a variety of digital apps and social media platforms (Budge, 2020; Moreno-Mendoza et al., 2020). Cultural institutions can learn from visitors and other institutions by utilizing digital apps to view area content offerings and attendance
The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.
The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.
This research extends the investigator's prior NSF supported work to develop theoretical and empirical understanding of the double bind faced by women of color in STEM fields. That is, their race and gender present dual dilemmas as they move through STEM educational and career paths. The proposed study will identify gaps in our understanding, and identify some of the methodological problems associated with answering outstanding questions about the double bind. The major research question is: What strategies work to enable women of color to achieve higher levels of advancement in STEM academia and professions? The goal is to bring a clearer understanding of the issues which confront women of color as they pursue study of science and engineering, and what factors influence whether they leave or remain in STEM.
The work will employ a highly structured narrative analysis process to identify and quantify factors that have been successful in broadening the participation of minority women in STEM. The research design involves two separate tracks of work: 1) to conduct narrative analysis of primary documents associated with women of color in science; and 2) to conduct site visits and interviews to understand features of programs associated with successful support of women of color in undergraduate and graduate education. The first part is designed to inform the second, with the narrative analysis helping to identify features to look for in site visits and to use in development of interview protocols.
This research will focus on individual and programmatic factors that sustain women of color as they confront barriers to their career goals. It examines institutional strategies and support structures that help women of color ultimately to succeed, and social and pedagogic elements that influence their educational experiences. Although women of color have made some progress over the last three decades towards more equitable participation in STEM fields, the major efforts made to address this issue have not produced the desired outcomes; minority women continue to be underrepresented relative to white women and non-minority men. The factors that account for continued lower participation rates are not yet fully understood.
Beyond the Double Bind is designed to transform the intellectual basis for building future programs that will better enable women of color to be successful in STEM. While focused on women of color, the results will ultimately inform strategies and programs to expand the presence of all women and minorities in STEM.