Interest is a critical motivating factor shaping how children engage with STEM inside and outside of school and across their lives. In this paper, we introduce the concept of interest catalyst that emerged from longitudinal research with preschool-age children and their families as critical to the process through which each family developed unique interest pathways through their experience with a family-based informal engineering education program. As defined by the team, an interest catalyst is an instance or moment in which an element of the program (or other learning resource or experience)
In collaboration with Metropolitan Family Service (MFS), we conducted a three-year design-based research study to better understand how the characteristics of hands-on, home-based family engineering activities influence how preschool-age children and their parents engage in the engineering design process. Four themes emerged from the study: (1) Families used their imagination and activity narrative elements to set the design context, (2) Families evaluated and revised their solutions based on imagination-driven constraints, (3) Families creatively modified the design space, and (4) Imaginative
The ICBOs (Independent Community-based Organizations), a group of fifteen community representatives from communities historically excluded from the sciences, share results from eight years of community-led de-colonial participatory action research. We wrote this white paper to share our findings and recommendations with funders like the National Science Foundation. These findings, recently published in BioScience (https://doi.org/10.1093/biosci/biac001), along with preliminary results from our current research, and our lived experiences point towards a critical need to change the existing
DATE:
TEAM MEMBERS:
Karen PurcellBobby WilsonMakeda CheatomJohn AnnoniTanya Schuh
The Formative Evaluation for the Mars Habitat exhibit was conducted to gather visitor feedback on a prototype of the exhibit component. Data was collected in three rounds, and the exhibit component was updated as necessary between rounds. Evaluation questions focused on understanding if visitors knew what to do while at the Mars Habitat exhibit, how visitors interacted with both the exhibit and each other, and if visitors walked away with an understanding of the intended activity goals. These were explored through both observation and a follow-up interview. This report summarizes findings
This document is aimed primarily at Informal Learning (IFL) educators working with adult learners from disadvantaged and underserved communities, who wish to:
exploit the inclusive nature of Tinkering to create engaging and relevant STEM learning experiences for adult learners and their families
better understand how and why collaboration and co-design with community organisations can help develop more inclusive programming in STEM learning for adults.
It can also serve as a useful reference for community leaders and adult educators wishing to collaborate with the IFL sector
Although museums have long valued and catered to families as an audience, museum educators have not always had the tools or training to support the unique nature of family learning or to develop family-specific approaches that are distinct from classroom teaching. In this chapter, we outline a series of research-based principles for understanding family learning and provide examples to illustrate how these principles play out in museums. Specifically, we highlight the importance of (a) recognizing that families have multiple goals, (b) appreciating the central role of parents and other adult
To build understanding of the essential needs involved in human exploration on Mars, the museum will create the Build a Mars Habitat – Survive and Thrive exhibit which allows museum visitors, especially school field trips and families with children in grades 4-8, to design and construct their own imaginary habitat for successful living on Mars using interchangeable building pieces. This would be designed to appeal particularly to girls, be accessible to audiences using a universal design approach, and be understood by Spanish-language visitors. Partnerships include the National Informal STEM Education Network (NISENet), NASA Ames Research Center, and NASA Marshall Space Flight Center. The project team will also develop professional development materials for both facilitated and unfacilitated experiences to accompany the exhibit. This immersive experience augments the existing “Sun, Earth, Universe” exhibit that was recently distributed to 52 science and children’s museums across the U.S. by NISENet, collectively reporting attendance of over 10 million visitors per year. The exhibition serves as a platform for scientists and museum staff and volunteers to engage visitors with additional facilitated educational programming and hands-on experiences. Anticipated STEM learning outcomes include audience’s increased interest and positive attitudes towards learning about space exploration, increase in informal education professionals’ capacity to engage public audiences in space exploration, and strengthened partnerships among NASA and museums.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
It has been well documented that under-resourced Latinx communities face persistent barriers to accessing quality STEM education and STEM careers, particularly in the field of engineering. For young children and their families from these communities, the development of executive function skills offers promising pathways to support educational success and prepare children to engage with STEM practices and content. Executive function skills, such as focusing attention, retaining information, and managing emotions are critical for children’s development and long-term success, and have been identified as central to engagement with STEM practices and content, whether in or out of school. However, much of the work on development of executive function skills to date has been conducted with White, middle-class children and has largely ignored the knowledge, values, or perspectives of other communities, including Latinx families. Similar gaps also exist in attention to culturally responsive approaches to using family-based STEM activities to support executive function skills. Taken together, there is a critical need to work with Latinx communities to re-imagine the intersection of STEM learning and executive function skills using equity-based frameworks. This Pilot and Feasibility project will develop and test a new participatory, dialogic method that leverages informal family engineering activities to support the development of executive function skills for preschool-age children from Latinx families. The combination of this proposal’s unique engagement of parents as research partners with the study of engineering and executive functions could lay the foundation for a promising program of future equity-focused research.
Three research questions will guide the study: 1) What knowledge, assets, and practices already exist within Latinx families related to these executive function skills? 2) What aspects of executive function skills can be supported through informal family engineering activities? and 3) What are promising design strategies for adapting informal family engineering activities to highlight family assets and support executive function skills for young children? To address these questions, the project team will engage Latinx parents in a dialogue series in which parents are central collaborators, sharing their in-depth perspectives and partnering with researchers to develop conceptual frameworks and new approaches. Data generated through these ongoing discussions will be analyzed using (a) qualitative, participatory approaches, including iterative co-development and refinement of emergent themes with parents, (b) detailed inductive coding of parent dialogue group discussions using grounded theory techniques, and (c) retrospective analysis at the end of the project. The parent dialogue series will be supported by a systematic literature review examining the intersections between engineering design, executive function, and the strengths and assets within Latinx families. The results of the exploratory research will include a (1) conceptual framework co-developed with parents that highlights promising opportunities and design strategies for using family engineering design activities to support executive function skills for preschool-age children from Latinx families and (2) research agenda outlining questions and priorities for future work that reflect the goals and interests of this community. Aligned with project’s equity approach, the team will work collaboratively with project partners and families for dissemination, focusing on amplifying community voices, sharing challenges and successes, and supporting improvements in the local community. Results will also be broadly shared with educators and researchers to advance knowledge and promote new equitable approaches to collaborating with parents from Latinx communities.
This Pilots and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
This project will create the specification for a learner-controlled system to represent youth learning in Out-of-School-Time (OST) settings, to improve access to future Science, Technology, Engineering, and Mathematics (STEM) learning opportunities. For learners to pursue a STEM education, and STEM careers, they must be able to move through "gatekeeping" mechanisms that filter and sort students based on factors such as prior coursework and grades, teacher recommendations, and language proficiency assessments. Even though abundant evidence shows that such measures fail to capture all important aspects of STEM learning, they are traditionally relied upon in secondary and post-secondary STEM education contexts as indicators of preparation for future STEM learning. These systemic processes exclude certain minoritized groups, including Black, Indigenous, and other people of color (BIPOC), low income, immigrant and refugee youth, and youth learning English, from high-quality secondary and post-secondary STEM learning experiences because existing measures do not validate their prior knowledge and experiences. Yet, minoritized youth often engage in OST STEM learning opportunities, where their readiness for future learning opportunities is nurtured and valued. One challenge is to reliably document this readiness in a usable format so youth can access new STEM learning opportunities, especially in post-secondary contexts. This project builds strategically upon earlier work focusing on the democratization of STEM learning through vehicles such as digital micro-credentials or badges, and upon digital portfolios. Missing from these earlier efforts was integration of these platforms with an infrastructure that connected youth learners to OST STEM learning organizations and to future STEM learning opportunities. This Innovations in Development project brings together minoritized youth and their families, OST providers, and admissions officials from higher education institutions to explore the needed design features for OST "transcripts," and user stories that describe how software systems can support their creation and sharing. Grounded in the concept of mastery-based learning, where learning is demonstrated via action, learners will control what is included in the transcript so that they create their own narratives about their learning experiences. Recognizing that documentation is not the key focus of most STEM OST organizations, this project will provide direct support for identifying and codifying learning goals or outcomes that learners and their families find relevant and important within different STEM activities. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will take a Design-Based Implementation Research (DBIR) approach and proceed by convening representatives from three main stakeholder groups (youth and their families, OST providers, and admissions staff) to engage in a series of discovery and design activities. Project partners, including the Mastery Transcript Consortium (MA), STEAMville (IL), STUDIO (WA), and Wolverine Pathways (MI), will work together with the PIs to design templates learners can use to characterize STEM learning from each provider, aligned with different STEM learning foci (e.g., computer science, computational thinking, cross-cutting concepts, science and engineering practices, and mathematics). Data collected from these sessions will be used to address the following research questions: (1) How and why do youth and families from minoritized communities understand and choose to participate in STEM OST learning opportunities?, (2) How do youth understand and interact with STEM OST learning opportunities?, (3) How do OST providers characterize the STEM learning goals in the activities they provide?, and (4) How do college admissions personnel view the role of informal STEM learning as part of a holistic admissions process? This work has the potential to further the understanding of how OST learning can be documented and shared as a part of the larger ecosystem of STEM learning trajectories. By deeply engaging the perspectives and voices of minoritized youth and families, this project seeks to develop a valid and trustworthy instrument that recognizes and serves their STEM learning, thus broadening the participation of minoritized youth in STEM education and careers. This work will also benefit OST providers, by translating the documentation of youth STEM learning into forms that may help communicate the efficacy of their programs in ways that further their missions, including communicating evidence of effectiveness to both future participants and funders.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Despite the rich scientific evidence of adaptations and their evolutionary basis, there are concerning public misconceptions about evolution, processes of natural selection, and adaptations in the biodiverse world. Such misconceptions begin early. Younger elementary school children are often resistant to the idea that one “kind” of animal could descend from a completely different kind of animal, and they see features as having always existed. Other misconceptions lead to an inaccurate belief that changes in individual organisms acquired in a lifetime are passed directly on to offspring or that entire populations transform as a whole. These cognitive biases and "intuitive” misunderstandings can persist into adulthood. This Innovations in Development project will counter that narrative through an informal science project focusing on the blue whale one of nature’s most spectacular stories of adaptation. It is a species that lives life at extremes: a long-distance migrator, a deep diver, an extravagant eater, the largest animal to ever exist. With its awe-inspiring size and rich mosaic of anatomical, physiological, and behavioral specializations, it serves as a bridge to an enriched understanding of universal concepts in elementary biology and can begin to dispel the deeply rooted misconceptions. The project deliverables include a giant screen film documenting the field work of research scientists studying the blue whales in the Indian Ocean and Gulf of Mexico; multi-platform educational modules and programs that will build on the blue whale content from the film for use in science center programs and rural libraries; and professional development webinars that will offer content utilization and presentation skills for ISE facilitators. Project partners include California Science Center, STAR Library Education Network, HHMI Tangled Bank Studios and SK Films.
The external evaluation studies will gather data from 20 participating rural libraries and 6 science museums. A formative evaluation of the film will be conducted in a giant screen theater setting with 75 families. After viewing a fine-cut version of the film they will complete age-appropriate post-viewing surveys on the film’s engagement, storytelling, content appeal and clarity, and learning value in communicating key science concepts. An external summative evaluation will include three studies. Study 1 will assess the implementation of the project at the 26 organizations, addressing the question: To what extent is the project implemented as envisioned in the libraries and science center settings? Baseline information will be collected, and later partners will complete post-grant surveys to report on their actual implementation of the project elements. In addition, the study will examine outcomes relating to professional development. Study 2 will be an evaluation of the film as experienced by 400 youth and parents in science centers and examining the question: To what extent does experiencing the film engage youth and parents and affect their interest, curiosity, and knowledge of blue whales, adaptations, and the scientific process? Study 3 will examine: To what extent and how does experiencing an educational module (virtual field trips, hands on activities, augmented reality) affect youth and parents’ interest, curiosity, and knowledge of adaptations and scientific process?
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
This Innovations in Development project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Specifically, this project connects Native Hawaiian youth ages 12-17 and their family members to STEM by channeling their cultural relationship with ʻāina, the sustaining elements of the natural world including the land, sea, and air. This project seeks to: broaden participation of Native Hawaiian youth who have been historically underrepresented in STEM; actively uphold Native Hawaiian ways of knowing and traditional knowledge; articulate the science rooted in cultural wisdom; and bring STEM into the lives of participants as they connect to the ʻāina. In partnership with six ʻāina-based community organizations across Hawaiʻi, this project will develop, implement, and study ʻāina-centered environmental education activities that explore solutions to local environmental problems. For example, in one module youth and their families will explore of a section of a nearby stream; identify and discuss the native, non-native, and invasive species; remove invasive species from a small section of the stream and make observations leading to discussions of unintended consequences and systemic impacts; ultimately, learners will meet at additional local waterways to engage in similar explorations and discussions, transferring their knowledge to understanding the impacts of construction on local streams and coral reefs. To this effort, the community-based organizations bring their expertise in preserving Hawaiian culture and sustainable island lifestyle, including rural and urban systems such as farming and irrigation traditions and the restoration of cultural sites. University of Hawai’i faculty and staff bring expertise in Environmental Science, Biology, Hawaiian Studies and Problem-Based Learning Curriculum Development. This project further supports organizational learning and sharing among the six community-based organizations. Grounded in Hawaiian ʻAʻo, where learning and teaching are the same interaction, community-based organizations will create a Community of Practice that will co-learn Problem-Based Learning pedagogy; co-learn and engage in research and evaluation methods; and share experiential and traditional knowledge to co-develop the ʻāina-based environmental education activities.
This project is uniquely situated to study the impact of community-led culturally relevant pedagogy on Hawaiian learners’ interests and connections to environmental science, and to understand ʻāina-based learning through empirical research. Research methods draw on Community-Based Participatory Research and Indigenous Research Methods to develop a collaborative research design process incorporated into the project’s key components. Community members, researchers, and evaluators will work together to examine the following research questions: 1) How does environmental Problem-Based Learning situate within ʻāina-based informal contexts?; 2) What are the environmental education learning impacts of ʻāina-based activities on youth and family participants?; and 3) How does the ʻāina-centered Problem-Based Learning approach to informal STEM education support STEM knowledge, interest and awareness? The evaluation will employ a mixed-methods participatory design to explore program efficacy, fidelity, and implementation more broadly across community-based sites, as well as program sustainability within each community-based site. Anticipated project outcomes are a 15-week organizational learning and sharing program with six ʻāina-based community organizations and 72 staff; the design and implementation of 18 activities to reach 360 youth and at least one of their family members; and the launch of an ʻāina-based STEM Community of Practice. The project’s research and development process for ʻāina-centered environmental education activities will be shared broadly and provide a useful example for other organizations locally and nationally working in informal settings with Native or Indigenous populations.