This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Math is everywhere in the world, but youth may see math as disconnected from their everyday experiences and wonder how math is relevant to their lives. There is evidence that informal math done by children is highly effective, involving efficiency, flexibility, and socializing. Yet, more is needed to understand how educators can support math engagement outside of school, and the role these out-of-school experiences can play relative to the classroom and lifelong STEM learning. This Innovations and Development Project seeks to conduct research on a location-based mobile app for informal mathematics learning. This research takes place at 9 informal learning sites and involves iteratively designing an app in which learners can view and contribute to an interactive map of math walk “stops” at these sites. Learners will be able to select locations and watch short videos or view pictures with text that describe how mathematical principles are present in their surroundings. For example, learners could use the app to discover how a painting by a local Latino artist uses ratio and scale, or how a ramp in downtown was designed with a specific slope to accommodate wheelchairs. Research studies will examine the affordances of augmented reality (AR) overlays where learners can hold up the camera of their mobile device, and see mathematical representations (e.g., lines, squares) layered over real-world objects in their camera feed. Research studies will also examine the impact of having learners create their own math walk stops at local informal learning sites, uploading pictures, descriptions, and linking audio they narrate, where they make observations about how math appears in their surroundings and pose interesting questions about STEM ideas and connections they wonder about.
This project draws on research on informal math learning, problem-posing, and culturally-sustaining pedagogies to conduct cycles of participatory design-based research on technology-supported math walks. The research questions are: How does posing mathematical scenarios in community-imbedded math walks impact learners’ attitudes about mathematics? How can experiencing AR overlays on real world objects highlight mathematical principles and allow learners to see math in the world around them? How can learners and informal educators be engaged as disseminators of content they create and as reviewers of mathematical content created by others? To answer these questions, five studies will be conducted where learners create math walk stops: without technology (Study 1), with a prototype version of the app (Study 2), and with or without AR overlays (Study 3). Studies will also compare children's experiences receiving math walk stops vs. creating their own stops (Study 4) and explore learners reviewing math walk stops made by their peers (Study 5). Using a community ethnography approach with qualitative and quantitative process data of how youth engage with the app and with each other, the project will determine how the development of math interest can be facilitated, how learner-driven problem generation can be scaffolded, and under what circumstances app-based math walks are most effective. The results will contribute to research on the development of interest, problem-posing, informal mathematics learning, and digital supports for STEM learning such as AR. This project will promote innovation and have strategic impact through a digital infrastructure that could be scaled up to support STEM walks anywhere in the world, while also building a local STEM learning ecosystem among informal learning sites focused on informal mathematics. This project is a partnership between Southern Methodist University, a nonprofit, talkSTEM that facilitates the creation of community math walks, and 9 informal learning providers. The project will directly serve approximately 500 grades 4-8 learners and 30-60 informal educators. The project will build capacity at 9 informal learning sites, which serve hundreds of thousands of students per year in their programming.
This Innovations in Development project is supported by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
How can creators of STEM learning media reach underserved parents and children, and support the kinds of playful STEM interactions that are foundational for future STEM learning?
This research report summarizes findings from a pilot study of Cyberchase: Mobile Adventures in STEM, a program that uses mobile text messaging and short videos to encourage hands-on family learning among low-income Latino families.
In the study, 95 mostly Latino families received weekly text messages with video clips from the popular children's series Cyberchase, and fun activities to do with their
WNET, working with Education Development Center, will lead a small scale Innovations in Development effort to develop, research, and evaluate a new model to engage underserved families in STEM learning. The new endeavor, Cyberchase: Mobile Adventures in STEM, will build on the proven impact of the public media mathematics series Cyberchase and the growing potential of mobile technology and texting to reach underserved parents. WNET will produce two new Cyberchase episodes for 6-9 year olds, focused on using math to learn about the environment. Drawing on these videos and an existing Cyberchase game, the team will produce a bilingual family engagement campaign that will combine an in-person workshop followed by a 6-8 week "text to parent" campaign, in which parents receive weekly text messages suggesting family STEM activities related to the media content. The engagement model will be piloted in three cities with large low-income/Latino populations, along with one texting campaign offered without the workshop. This project will build knowledge about how to deploy well-designed public media assets and text messaging to promote fun, effective STEM learning interactions in low-income families. While past research on educational STEM media has tended to focus on children, especially preschool age, this project will focus primarily on text messaging for parents, and on learners age 6-9, and the wider scope of parent/child STEM interactions possible at that age.
The primary goal of the project will be to develop, test and refine a family engagement model that includes a face-to-face workshop, rich narrative Cyberchase content, and text-message prompts for parents to engage in short, playful STEM activities with children. The project team will explore which features of the mobile text-and-media program have most value for low-income and Latino families and prompt STEM learning interactions, including a comparison of workshop-based and text-only variants. The project will have three phases: needs assessment and preliminary design; an early-stage test in New York and development and testing of media; and three late-stage tests in contrasting locations, two including workshops and one "text-only," and analysis of findings. Ultimately, the project will share knowledge with the field about the opportunities and challenges of using mobile texting and public media to reach underserved families effectively. This knowledge will also inform a future proposal for production and outcomes research, which, based on the study results, may include a scaled-up version in ten locations and a ten-city Randomized Control Test. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Peg + Cat ELM2 project sought to combine robust media-integrated teacher training in both math content and facilitation of classroom and family engagement activities with transmedia resources that parents and children could utilize at home. This cohesive approach resulted in increases in teachers’ confidence in and knowledge about their mathematics instruction, parents’ engagement in activities and conversations with their children around math, and children’s positive and persistent attitudes towards math, as reported by their parents. Taken together, these findings suggest that the Peg +
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
In prior research and development, the project team and partners developed Cyberchase, a multimedia story-based series for students to practice and learn math. Researchers will develop and test a prototype of a mobile app-based fractions game to be integrated within the multimedia series. The prototype will adjust to students of different skill levels, and will present fractions in different representations (pictures, numbers, and words) to support different modes of learning. In the Phase I pilot, researchers will work with two grade 3 classrooms, and will examine whether the prototype functions as planned, if teachers are able to integrate the game into classroom practice, and whether the prototype shows promise for improving student learning of fractions.
Purpose: This project team will fully develop and test Cyberchase Fractions Quest, a web-based mathematics game for students in grade 3 and 4. Research shows that inadequate understanding of fractions can persist from early grades through higher education, and that success in fractions predicts future success in mathematics and other STEM subjects.
Project Activities: During Phase I (completed in 2016), the team developed a prototype of Cyberchase Fractions Quest, including an interactive number line game with four levels of challenges, and a tool to scaffold learning through hints and provide encouragement as students progress. At the end of Phase I, the research team conducted a pilot study over one week with 60 grade 4 students, half of whom were randomly assigned to use the prototype and half assigned to paper-based fractions activities. Results revealed that the prototype functioned as intended, that students were engaged during gameplay, and that from pre- to post-test, students using the prototype increased significantly in their knowledge of number line problems compared to the control group. In Phase II, the team will finalize the design, artwork, and animation, the formative and summative assessment component, and learning management system. After development is complete, the researchers will carry out a pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the game to improve student learning of fractions over a 5-week period. The study will include four classrooms of grade 3 students, two of which will be randomly assigned, to use the games to supplement in-class lessons while the others will use paper-based activities. The researchers will compare pre-and-post scores for student learning of fractions. The study will also track teacher implementation.
Product: The final product is Cyberchase Fractions Quest—a math game based on the storyline of PBS children's television series, Cyberchase. In the game, students in grades 3 and 4 will apply learning fractions within three contexts: areas and regions (such as shapes), sets (groups of objects), and on a number line. The game will identify specific areas where students struggle and will introduce challenges to support individualized learning. Similar to other popular game apps, student will receive immediate feedback from one to three stars based on how well they perform on each challenge as well as in-game rewards as they progress toward mastery. The game will include teacher resources for classroom implementation, and an educator dashboard presenting results.