Skip to main content

Community Repository Search Results

resource evaluation Media and Technology
Artificial Intelligence (AI), the research and development of machines to mimic human thought and behavior, encompasses one of the most complex scientific and engineering challenges in history. AI now permeates essentially all sectors of the economy and society. Young people growing up in the era of big data, algorithms, and AI need to develop new awareness, content knowledge, and skills to understand humans’ relationships with these new technologies and become producers of AI artifacts themselves. YR Media and MIT’s Understanding AI project researched and developed innovative approaches to
DATE:
resource project Public Programs
Mathematizing, Visualizing, and Power (MVP): Appalachian Youth Becoming Data Artists for Community Learning is a three-year Advancing Informal STEM Learning, Innovations and Development, project that focuses on community-centered data exploration catalyzed by youth. The project develops statistical artistry among young people in East Tennessee Appalachian communities and enables these youth to share their data visualizations with their communities to foster collective reflection and understanding. The creative work generated by the MVP project will be compelling in two ways, both as statistical art and as powerful statements giving voice to the experience of communities. Critical aspects of the MVP model include (1) youth learning sessions that position youth as owners of data and producers of knowledge and (2) Community Learning Events that support community learning as youth learning occurs. The MVP project has a primary focus on broadening the STEM participation of underrepresented communities of Appalachia. The project’s mission is to increase the learning and life outcomes of young people and communities of Appalachia by creating a meaningful foundation of data science and collective data exploration. The University of Tennessee partners with Pellissippi State Community College, Drexel University, and the Boys & Girls Club of the Tennessee Valley to bring together a convergent team of community members, practitioners, and professionals, with the expertise to carry out the project. The project will impact approximately 120 youth and 3800 of their East Tennessee community members. The research generated will inform how to engage community members in learning about community issues through the exploration of datasets relevant to participants.

The field of STEM education is in urgent need of knowledge about effective models to inspire community-based data exploration with young people as leaders in these efforts. The MVP project includes engaging youth with meaningful problems, building a discourse community with possibilities for action, re-positioning youth as knowledge producers within their own communities, leveraging linguistic and cultural resources of the youth participants and their communities, and implementing critical events that support substantial interaction between youth, community members, and the data visualizations. MVP builds on the idea that the design of data visualizations requires an understanding of both data science and artistic design. Research will inform the model of community engagement, examine data artists’ identities, and document community learning. The MVP model will be designed, developed, tested, and refined through three cycles of design-based research. The overarching research question guiding these cycles is: What affordances (and delimitations) related to identity and learning does the model provide for MVP Youth and community members? Data sources for the project include: fieldnotes, portfolios created by MVP Youth, youth pre/post interviews, observations of the learning sessions, a project documentary, surveys for youth and community members, interviews with community members, and audience feedback. The National Institute for STEM Evaluation and Research (NISER) will provide formative and summative evaluation about project activities. Formative feedback will be integrated into the ongoing research cycles. The research conducted will inform (1) the community learning model; (2) the integrated pedagogy and curriculum of the MVP Youth learning sessions that emphasize data science through design arts; and, (3) research on community learning and youth identity. Findings will be shared through conferences, academic and practitioner-focused journals, a video documentary, a Summit on Engaging Youth and Communities in Data, and a project website.
DATE: -
TEAM MEMBERS: Lynn Hodge Elizabeth Dyer Joy Bertling Carlye Clark
resource project Media and Technology
Data is increasingly important in all aspects of people’s lives, from the day-to-day, to careers and to civic engagement. Preparing youth to use data to answer questions and solve problems empowers them to participate in society as informed citizens and opens doors to 21st century career opportunities. Ensuring equitable representation in data literacy and data science careers is critical. For many girls underrepresented in STEM, developing a "data science identity" requires personally meaningful experiences working with data. This project aims to promote middle school-aged girls’ interest and aspirations in data science through an identity-aligned, social game-based learning approach. The goals are to create a more diverse and inclusive generation of data scientists who see data as a resource and who are equipped with the skills and dispositions necessary to work with data in order to solve practical problems. The research team will run 10 social clubs and 10 data science clubs mentored by women in data science recruited through the University of Miami’s Institute for Data Science and Computing. Participants will be 250 middle school-aged girls recruited in Miami, FL, and Yolo County, CA, through local and national girls’ organizations. Youth will participate in a data science club and will learn key data science concepts and skills, including data structures, storage, exploration, analysis, and visualization. These concepts will be learned from working with their own data collected in personally meaningful ways in addition to working with data collected by others in the same social game eco-system. The project will also develop facilitator materials to allow adult volunteers to create game-based informal data science learning experiences for youth in their areas. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments and is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST), which seeks to engage underrepresented students in technology-rich learning environments, including skills in data literacy, and increase students’ knowledge and interest in information and communication technology (ICT) careers.

Researchers will focus on two primary research questions: 1) Across gameplay and club experiences, in what ways do participants engage with data to pursue personal or social goals? 2) How do gameplay and club experiences shape girls’ perceptions of data, data science, and their fit with data and data science? The project will use design-based research methods to iteratively design the game and social club experiences. To ensure that uses of data feel personally and socially meaningful to young girls, the virtual world’s goals, narratives, and activities will be co-designed with girls from groups underrepresented in data science. The project will research engagement with game data in two informal, game-based learning scenarios: organic, self-directed, social play club, and structured, adult-facilitated data science clubs. The research will use a combination of quantitative and qualitative methods including surveys, focus groups, interviews, and gameplay and club observations. Project evaluation will determine how gameplay and club experiences impact participants' attitudes toward and interest in data-rich futures. The project holds the potential for broadening participation and promoting interest in data science by blending game-based learning with the rich social and adult mentoring through club participation. The results will be disseminated through conference presentations, scholarly publications, and social media. The game and facilitator materials will be designed for dissemination and made freely available to the public.
DATE: -
TEAM MEMBERS: Lisa Hardy Gary Goldberger Jennifer Kahn
resource project Informal/Formal Connections
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.

The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
DATE: -
TEAM MEMBERS: Edward Price Frank Gomez James Marshall Sinem Siyahhan James Kisiel Heather Macias Jessica Jensen Jasmine Nation Alexandria Hansen Myunghwan Shin
resource project Media and Technology
The Ice Worlds media project will inspire millions of children and adults to gain new knowledge about polar environments, the planet’s climate, and humanity’s place within Earth’s complex systems—supporting an informed, STEM literate citizenry. Featuring the NSF-funded THOR expedition to Thwaites glacier, along with contributions of many NSF-supported researchers worldwide, Ice Worlds will share the importance of investments in STEM with audiences in giant screen theaters, on television, online, and in other informal settings. Primary project deliverables include a giant screen film, a filmmaking workshop for Native American middle school students that will result in a documentary, a climate storytelling professional development program for informal educators, and a knowledge-building summative evaluation. The project’s largest target audience is middle school learners (ages 11-14); specific activities are designed for Native American youth and informal science practitioners. Innovative outreach will engage youth underserved in science inspiring a new generation of scientists and investigative thinkers. The project’s professional development programs will build the capacity of informal educators to engage communities and communicate science. The Ice Worlds project is a collaboration among media producers Giant Screen Films, Natural History New Zealand, PBS, and Academy Award nominated film directors (Yes/No Productions). Additional collaborators include Northwestern University, The American Indian Science and Engineering Society, the Native American Journalism Association, a group of museum and science center partners, and a team of advisors including scientific and Indigenous experts associated with the NSF-funded Study of Environmental Arctic Change initiative.

The goals of the project are: 1) to increase public understanding of the processes and consequences of environmental change in polar ecosystems, 2) to explore the effectiveness of the giant screen format to impart knowledge, inspire motivation and caring for nature, 3) to improve middle schoolers’ interest, confidence and engagement in STEM topics and pursuits—broadly and through a specific program for Native American youth, and 4) to build informal educators’ capacity to share stories of climate change in their communities. The main evaluation questions are 1) to what extent does the Ice World film affect learning, engagement, and motivation around STEM pursuits and environmental problem solving 2) what is the added value of companion media for youth’s giant screen learning over short and longer term, and 3) what are the impacts of the culturally based Native American youth workshops.

The evaluation work will involve a Native American youth advisory panel and a panel of science center practitioners in the giant screen film’s development and evaluation process. Formative evaluation of the film will involve recruiting youth from diverse backgrounds, including representation of Native youth, to see the film in the giant screen theater of a partner site. Post viewing surveys and group discussions will explore their experience of the film with respect to engagement, learning, evoking spatial presence, and motivational impact. A summative evaluation of the completed film will assess its immediate and longer term impacts. Statistical analyses will be conducted on all quantitative data generated from the evaluation, including a comparison of pre and post knowledge scores. An evaluation of the Tribal Youth Media program will include a significant period of formative evaluation and community engagement to align activities to the needs and interests of participating students. Culturally appropriate measures, qualitative methods and frameworks will be used to assess the learning impacts. Data will be analyzed to determine learning impacts of the workshop on youth participants as well as mentors and other stakeholder participants. Evaluation of the community climate storytelling professional development component will include lessons learned and recommendations for implementation.
DATE: -
TEAM MEMBERS: Deborah Raksany Karen Elinich Andrew Wood Patricia Loew
resource project Media and Technology
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.

This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.

This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.
DATE: -
TEAM MEMBERS: Casey Lynch David Feil-Seifer
resource project Public Programs
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).

Research shows that Black girls and women, regardless of their academic achievements and STEM interests, often encounter academic under-preparation, social isolation, exclusion, and race-gender discrimination that negatively impacts their ongoing engagement and retention in STEM. This project will provide innovative, culturally relevant learning environments to middle and high school Black girls to counter these negative trends. Using hands-on coding and robotics activities, project participants will develop positive attitudes toward science, technology, engineering, and mathematics (STEM). The project emphasizes peer-mentoring by providing opportunities for Black female high school (assistant coaches) and Black college students (coaches) to serve as counselors and mentors to participants. Additionally, engineers, scientists, and executives from STEM industries will serve as mentors and share their experiences to broaden participants’ STEM career aspirations. The project is a three-year collaborative effort between the University of California Davis C-STEM Center, the Umoja Community Education Foundation, and the 66 affiliated California community colleges, industry partners, and school districts in California. Over three years, nearly 2,000 females will participate in the project.

Learning environments for Black girls and women led by other Black girls and women are referred to as “counterspaces” where they are free to engage in STEM in ways that value their identities while promoting STEM engagement, interests, and career aspirations. The project’s curriculum will follow a research-based, culturally relevant multi-tiered mentoring approach. The curriculum is designed to develop participants’ STEM content knowledge, critical thinking, and logical reasoning capabilities through meaningful connections to real-life applications using hands-on coding and robotics. A mixed-method longitudinal study will examine the impact on participants’ STEM outcomes, emphasizing contributing new knowledge on the viability of multi-tiered, culturally relevant mentoring for increasing equity in informal STEM learning (ISL). The program's effectiveness will be evaluated using longitudinal assessments of mathematics standards, computer science and robotics conceptual knowledge, logical and critical thinking skills, STEM school achievements, interests and attitudes toward STEM subjects, advanced STEM course-taking, involvement in other ISL opportunities, and leadership in STEM in one’s school/university and community. The project will test a locally based informal learning model with projects hosted by other K-12 and college partners.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE: -
TEAM MEMBERS: Harry Cheng Faheemah Mustafaa
resource project Media and Technology
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.

The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.

As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Marisa Wolsky Heather Lavigne Jessica Andrews Janna Kook
resource project Media and Technology
Refugee youth are particularly vulnerable to STEM disenfranchisement due to factors including limited or interrupted schooling following displacement; restricted exposure to STEM education; and linguistic, cultural, ethnic, socioeconomic, and racial minority status. Refugee youth may experience a gap in STEM skills and knowledge, and a conflict between the identities necessary for participation in their families and communities, and those expected for success in STEM settings. To conduct research to better understand these challenges, an interrelated set of activities will be developed. First, youth will learn principles of physics and computing by participating in cosmic ray research with physicists using an instructional approach that builds from their home languages and cultures. Then youth periodically share what they are learning in the cosmic ray research with their parents, siblings, and science teachers at family and community science events. Finally, youth conduct reflective research on their own STEM identity development over the course of the project. Research on learning will be conducted within and across these three strands to better understand how refugee youth develop STEM-positive identities. This project will benefit society by improving equity and diversity in STEM through (1) creating opportunities for refugee youth to participate in physics research and to develop computing skills and (2) producing knowledge on STEM identity development that may be applied more broadly to improve STEM education. Deliverables from this project include: (a) research publications on STEM identity and learning; (b) curriculum resources for teaching physics and computing to multilingual youth; (c) an online digital storytelling exhibit offering narratives about belonging in STEM research which can be shared with STEM stakeholders (policy makers, scientists, educators, etc.); and (d) an online database of cosmic ray data which will be available to physicists worldwide for research purposes. This Innovations in Development proposal is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This program is designed to provide multiple contexts, relationships, and modes across and within which the identity work of individual students can be studied to look for convergence or divergence. To achieve this goal, the research applies a linguistic anthropological framework embedding discourse analysis in a larger ethnography. Data collected in this study include field notes, audio and video recordings of naturalistic interactions in the cosmic ray research and other program activities, multimodal artifacts (e.g., students' digital stories), student work products, interviews, and surveys. Critically, this methodology combines the analysis of identity formation as it unfolds in moment-to-moment conversations (during STEM learning, and in conversations about STEM and STEM learning) with reflective tasks and the production of personal narratives (e.g., in digital stories and interviews). Documenting convergence and divergence of STEM identities across these sources of data offers both methodological and theoretical contributions to the field. The research will offer thick description of the discursive practices of refugee youth to reveal how they construct identities related to STEM and STEM disciplines across settings (e.g., during cosmic ray research, while creating digital stories), relationships (e.g., peer, parent, teacher), and the languages they speak (e.g., English, Swahili). The findings will be of potential value to instructional designers of informal learning experiences including those working with afterschool, museums, science centers and the like, educators, and scholars of learning and identity.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Tino Nyawelo John Matthews Jordan Gerton Sarah Braden
resource project Media and Technology
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.

The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.

This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Katherine Isbister
resource project Public Programs
Computing and computational thinking are integral to the practice of modern science, technology, engineering, and math (STEM); therefore, computational skills are essential for students' preparation to participate in computationally intensive STEM fields and the emerging workforce. In the U.S., Latinx and Spanish speaking students are underrepresented in computing and STEM fields, therefore, expanding opportunities for students to learn computing is an urgent need. The Georgia Institute of Technology and the University of Puerto Rico will collaborate on research and development that will provide Latinx and Spanish speaking students in the continental U.S. and Puerto Rico, opportunities to learn computer science and its application in solving problems in STEM fields. The project will use a creative approach to teaching computer science by engaging Latinx and Spanish speaking students in learning how to code and reprogram in a music platform, EarSketch. The culturally relevant educational practices of the curriculum, as a model for informal STEM learning, will enable students to code and reprogram music, including sounds relevant to their own cultures, community narratives, and cultural storytelling. Research results will inform education programs seeking to design culturally authentic activities for diverse populations as a means to broaden participation in integrated STEM and Computing. This Broad Implementation project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments, including multiple pathways for broadening access to and engagement in STEM learning, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

As part of the technical innovation of the project, the EarSketch platform will be redesigned for cultural and linguistic authenticity that will include incorporating traditional and contemporary Latin sound beats and musical samples into the software so that students can remix music and learn coding using sounds relevant to their cultures; and developing a Spanish version of the platform, with a toggle to easily switch between English and Spanish. Investigators will also develop an informal STEM curriculum using best practices from Culturally Relevant Education and Cultural Sustaining Pedagogy that provides authentic, culturally and linguistically rich opportunities for student engagement by establishing direct and constant connections to their cultures, communities and lived experiences. The curriculum design and implementation team will work collaboratively with members of Latinx diverse cultural groups to ensure semantic and content equivalency across diverse students and sites. Validating the intervention across students and sites is one of the goals of the project. The model curriculum for informal learning will be implemented as a semester long afterschool program in six schools per year in Atlanta and Puerto Rico, and as a one-week summer camp twice in the summer. The curricular materials will be broadly disseminated, and training will be provided to informal learning practitioners as part of the project. The research will explore differences in musical and computational engagement; the interconnection between music and the computational aspects of EarSketch; and the degree to which the program promotes cultural engagement among culturally and linguistically heterogenous groups of Latinx students in Atlanta, and more culturally and linguistically homogenous Latinx students in Puerto Rico. Investigators will use a mixed method design to collect data from surveys, interviews, focus groups, and computational/musical artifacts created by students. The study will employ multiple case study methodology to analyze and compare the implementation of the critical components of the program in Puerto Rico and Atlanta, and to explore differences in students' musical and computational thinking practices in the two regions. Results from the research will determine the impact of the curriculum on computer science skills and associated computational practices; and contribute to the understanding of the role of cultural engagement on educational outcomes such as sense of belonging, persistence, computational thinking, programming content knowledge and computer science identity. Results will inform education programs designing culturally authentic and engaging programming for diverse populations of Latinx youths.
DATE: -
TEAM MEMBERS: Diley Hernandez Jason Freeman Douglas Edwards Rafael Arce-Nazario Joseph Carroll-Miranda
resource project Public Programs
Many people with autism are unemployed and isolated because they do not have access to educational opportunities that support them in finding jobs that match their potential. This research seeks to empower adolescents with autism to seek out careers that are well-matched with their strengths and interests. Many people with autism are interested in computing, a marketable skill. This project builds from this interest by developing strategies to effectively engage teenagers with autism. Although people with autism share a diagnosis, each person is unique and has the capacity to become a visionary and transformer in society in their own way. Teenagers with autism will be invited to participate in a game design workshop hosted by an award-winning, not-for-profit Tech Kids Unlimited. Teenagers often enjoy learning how to design games and can learn many useful skills through design. During each workshop, teenagers will rate different teaching strategies using a picture-based survey developed in collaboration with people with autism. It is expected that teenagers with autism who have difficulty focusing to be most engaged by strategies that include multiple types of information (for example, pictures, text, and speech). The team also expects those who are more focused to be most engaged by strategies with fewer sources of information. By developing clear guidelines to help educators match their teaching styles to how different students learn, the project will help them engage youth more effectively. Through an iterative process, the team will revise the game design workshop to make it more engaging for people with different types of autism. New groups of teenagers with autism will participate in improved game design workshops that include an internship in a technology company. An important outcome is to understand which strategies are engaging for young people with autism that help them develop the belief in their skills needed to seek out fulfilling careers. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

This Research in Service to Practice project has the following aims: 1) Identify evidence-based strategies to engage youth with autism spectrum disorder (ASD) in informal STEM learning opportunities that are well matched to their attentional profiles, 2) Determine if engaging youth with ASD in informal STEM learning opportunities increases their STEM self-efficacy, and 3) Determine if engagement with STEM internship activities is associated with increased interest in STEM careers and career decision-making self-efficacy. Principles of Universal Design (UD) and Mayer's principles of effective multimedia instruction are frameworks employed to identify instructional strategies that are emotionally engaging for youth with diverse attentional profiles. The degree to which attentional differences contribute to different patterns of emotional engagement with informal STEM learning will be investigated. Guided by assessments of youth's engagement with different learning opportunities, 'diversity blueprints' or specific instructional strategies that help youth with diverse attentional profiles engage will be developed. After identifying strategies to engage neurodivergent (neurologically diverse) youth in informal STEM learning opportunities, the extent to which these strategies generalize to STEM internship sites will be explored. The team will study potential specificity of the types of contexts that promote different types of self-efficacy, with engagement with extracurricular STEM learning opportunities expected to preferentially target STEM self-efficacy while engagement with internships targets career decision-making self-efficacy. Although UD is often endorsed to promote STEM learning among students with disabilities, the proposed research would be the first iterative adaptation of instructional strategies designed to engage neurodivergent teens in informal STEM learning guided by a systematic analysis of how they engage with and feel about instructional strategies. Project deliverables include workshops for local after-school program providers, publications, a project website, and a multimodal guide of the process of developing 'diversity blueprints' and how to apply them for informal STEM educators and researchers.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Amy Hurst Katie Gillespie