This Innovations in Development project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Quantum information science (QIS) is an emergent cross-disciplinary field at the interface of physics, computer science, materials science, and engineering. Yet, there are few educational programs that encourage young people to explore QIS and understand its applications and societal benefits. Such programs are critical for supporting the growth of a quantum-ready workforce. Building intuition is a foundational first step but this is challenging because quantum effects are neither visible to the naked eye, nor experienced in everyday life. This project will create a suite of accessible, engaging digital games for middle schoolers, and study their effectiveness in cultivating intuition around QIS. Relating QIS concepts to common game mechanics is designed to increase students’ confidence in their QIS knowledge, reduce their fear of tackling such a subject, and consider pursuing a career in this field or another STEM area. The game-driven design appeals to a broad population beyond the age groups studied. Moreover, the deliverables will be freely available online, which allows anyone with a phone or computer and internet access a way to learn about QIS in an engaging, play-based environment. The program will partner with teacher organizations and other community groups to share the games, maximizing the project’s impact.
The project is guided by the QIS Key Concepts developed in 2020, as well as research and best practices on gamification of learning. The games will be designed for 6th-8th grade students in an informal setting, focusing on the concepts of probability, superposition, and role of measurement. A game world titled "Quander" will include videos that explicitly tie game experiences to QIS concepts and applications. The project will evaluate students' understanding after playing the games and watching the videos, how they engage with aspects of the games, and how the game impacted their interest in QIS. The project data will advance understanding of how to facilitate QIS informal learning experiences in ways that engage young audiences in QIS and similar abstract emerging areas of technology where current research is scant. This project represents one of the first efforts to teach QIS concepts in ways that connect directly to young learners’ play-based experiences. Data gathered from the project will help future program designers understand the ability of young learners to reason about QIS concepts such as measurement, superposition and probabilities in game contexts, providing insights to the ages at which students are ready for more technical content.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
This Pilot and Feasibility study will build foundational knowledge about basic aspects of STEM webcams in the United States (US) from the perspectives of both practitioners and viewers. Thousands of webcams available to the public are operated by STEM organizations, such as zoos, museums, and government agencies. Learning theory suggests that STEM webcams, especially those with accompanying interpretive tools, have the potential to offer rich informal learning opportunities. However, yet no research has quantified any aspect (cognitive, behavioral, or emotional) of viewer outcomes. This study will be the first to develop baseline data regarding cognitive, behavioral, and emotional aspects of perceived viewer experience. Project activities include:
An inventory of STEM webcams that exist in the US, the STEM disciplines they represent, learning and engagement tools they employ, the number of viewers they reach, and the resources required for their operation
A survey of webcam operators, their STEM education goals, implementation strategies, and evaluation results; and
Surveys and interviews gathering data on viewers demographics and potential increase in curiosity, interest, knowledge, and behavior toward the STEM subject. This research will provide foundational knowledge for the STEM-education and research community that quantifies and describes many facets of the population of STEM webcams in the inventory.
Research activities will take place in three distinct phases, with Phase 1 laying the groundwork for Phases 2 and 3. Phase 1: The project team will conduct a systematic internet search for all identifiable STEM related webcams. Phase 2 (operator-focused): An online survey of practitioners of webcams operated by US-based STEM organizations will be conducted using Qualtrics software. Likert scales will be used. Various hypotheses will be tested regarding webcam program objectives, operations, and evaluations from the perspective of program operators or practitioners. Phase 3 (viewer-focused): Surveys and interviews with likely viewers of STEM webcams. Using the webcam inventory built in Phase 1, the team will collaborate with 20 informal STEM institutions that agree to survey their constituents to test hypotheses regarding webcam viewing practices, such as why and how viewers watch, and perceived outcomes of viewing, such as perceived influence on their interest, attitudes, knowledge, or behavior. The findings from this study will be widely shared with informal STEM institutions and webcam operators. It will provide foundational data for future experimental studies.
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge and Conceptual Mapping – as well as social media testing were conducted to address our first research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials
KQED and Texas Tech advanced professional knowledge in the journalism and science communication fields around crisis reporting and building a media practitioner and academic researcher collaboration for audience research through a study conducted by Scott Burg of Rockman et al. Rockman gathered data between October 2020 - May 2021, interviewed KQED Science staff and participated in virtual observations of KQED project and related staff meetings to answer our second research question:
Can KQED develop a more efficient process of disaster reporting that responds to both constantly updating
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge (A&B) and Conceptual Mapping – as well as social media testing were conducted to address our research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge (A&B) and Conceptual Mapping – as well as social media testing were conducted to address our research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge and Conceptual Mapping – as well as social media testing were conducted to address our research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials and
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge and Conceptual Mapping – as well as social media testing were conducted to address our research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials and
This collaborative research project between KQED, a public media organization serving the San Francisco Bay Area, Texas Tech University and Rockman et al conducted research to study how best to provide effective COVID-19 science news and social media content for young adult audiences.
To start the work, four “Knowledge Gap” studies – Twitter Misinformation, Mask Wearing Messaging, Germ Knowledge and Conceptual Mapping – as well as social media testing were conducted to address our research question: How could COVID-19 coverage be designed to best inform, engage and educate millennials and
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
We used a combination of keyword- and human-coding-based strategies to identify and characterize the degree to which four key science communication journals have included research articles focused on the communication of basic science (N = 2,386). These journals included Public Understanding of Science, Science Communication, the Journal of Science Communication, and the International Journal of Science Education, Part B: Communication and Public Engagement. Our intention is to give those interested in basic-science-related communication the ability to speak to the degree to which an evidence