As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The project will develop and research, as a feasibility study, a series of art-inclusive, pop-up Science, Art, Technology, Engineering, and Mathematics (STEAM) makerspaces in a high-poverty, primarily rural county in Oklahoma. A makerspace is a collaborative work space inside a library, school or other community space for making, learning, exploring and sharing that uses high tech to low tech tools. The makerspaces will be temporary workshops that are developed through a community planning process that assesses the needs and interests of citizen stakeholders. Scientists, artists and other experts will work together with the community to design a series of thematic pop-up makerspace sessions. The project builds a collaborative infrastructure and capacity for small and rural communities by bringing together resource providers and experts to identify and design science-oriented challenges. Long-term benefits for participants include sustained focus on new approaches for civic engagement through STEAM-driven making which could foster new role identities pertaining to science and art. The project deliverables include: (1) a theoretically informed model to build a community's capacity to collaborate toward fostering civic engagement through science-oriented pop-up makerspaces, (2) Pop-Up STEAM Studio makerspaces, (3) training for pop-up facilitators, and (4) visual documentation panels and web-based digital stories to communicate progress and process.
Project research will enhance knowledge-building of the process of developing a science-oriented community challenge that embraces STEAM and making. A key contribution of the proposed project will be the generation of insights into how community members establish consensus around the joint goal of designing, documenting, and facilitating integrated art and science making activities to address and communicate the challenge. Research will focus on the roles participants take when engaging in the making process through an identity-based model of motivated action. Analysis of advisory board meeting artifacts and focus group data will allow the researchers to identify processes of negotiation and consensus building at the collective level and in relation to each issue to which the group attends. Emergent themes (such as negotiation, shared learning, idea or project revisions, diverse perspectives coming to consensus, etc.) will be examined across individual and group units of analysis, from all data sources, and through the congruent theoretical lenses of role identity theory and negotiated learning pedagogy. The research outcomes should inform efforts to build infrastructure and capacity of community resources by providing a model for developing collaborative pop-up makerspaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sheri VasindaJoanna GarnerStephanie HathcockRebecca Brienen
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Despite the ubiquity of Artificial Intelligence (AI), public understanding of how it works and is used is limited This project will research, design, and develop innovative approaches focusing on Artificial Intelligence (AI) for under-represented youth ages 14-24. Program components include live social media chats with AI leaders, app development, journalistic investigations of ethical issues in machine learning, and review of AI-based consumer products. Youth Radio is a non-profit media and tech organizations that provides youth with skills in STEM, journalism, arts, and communications. They engage 250 youth annually through free after-school classes and work shifts. Participants are 90% youth of color and 80% low income. Project partners include the MIT Media Lab which developed App Inventor which allows novice users to build fully functional apps. Staff from Google will serve as a project advisor on the curriculum. The project has exceptional national reach through the dissemination of its media and apps through national outlets such as NPR and Teen Vogue as well as various platforms including online, on-air, as well as presentations, publications, and training tools. The project broadens participation by engaging these low income youth of color in developing skills critical to the workforce of the future. It will help prepare an upcoming generation of Artificial Intelligence creators, users, and consumers who understand the technology and embrace and encourage its potential.It will give them the necessary knowledge and opportunities for careers in an AI-driven future.
This project is grounded in sociocultural learning theory and practice and is interdisciplinary by design. The theoretical framework holds that Computational Thinking plus Critical Pedagogy leads to Critical Computational Literacy. Also, Digital Age Civics plus Participatory Culture leads to Civic Imagination helping youth build a better world through technology. The driving research questions include: What do underrepresented youth understand about AI and its role in society? What are the ethical dilemmas posed by AI from their vantage point? What are the features of an engaging ethics-centered pedagogy with AI? What impact do the AI products developed by the youth have on the target audience? The research design will use ethnographic techniques and design research to study and analyze youth learning. Data sources will include baseline surveys, audio recordings and transcriptions from learning sessions with the participants, research analytic memos, focus group interviews, student-generating artifacts of learning and finished products, etc. The design-based approach will enable systematic, evidence-based iteration on the initiative's activities, pedagogical approach and products. An independent summative evaluation will provide complementary data and perspective to triangulate with the research findings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Elisabeth SoepEllin O'LearyHarold Abelson
The project will develop and research how an emerging technology, immersive virtual reality (IVR) using head mounted displays (HMDs), can enhance ocean literacy and generate empathy towards environmental issues. Recent advances in design have resulted in HMDs that provide viscerally realistic and immersive experiences that situate participants in underwater or other remote environments. IVR can provide many people with virtual access to these environments, including persons with disabilities, people living away from coastal areas, or those who lack access for other reasons (e.g., low-income families, underserved/underrepresented communities, persons untrained in diving). The project will develop a high quality 360-degree underwater film that includes live action footage, animation, and interactive elements. The IVR experience will take the participant through an immersive underwater journey of a Pacific reef, using realistic visualizations, narrative, and a compelling story to engage participants in learning the ecology and biology of coral reefs, as well as the impacts of climate change and human disturbances on ocean ecosystems. In addition to the IVR ocean journey, the project will integrate interactive functionality of being on a reef during mass coral spawning, an annual natural phenomenon through which coral reefs replenish their populations. With hand-held controllers, participants will be able to "swim" through the water, watch the degraded reef recover and grow and will have the ability to change the rate of coral recovery and learn how increases in temperature impede coral recovery. While research has been conducted on early, desk-top versions of IVR, the potential impact of IVR on learning is still unclear. The research findings will help guide the development of IVR for use in informal STEM environments such as aquariums, zoos, science museums, and others. The IVR experience will be shared on online platforms for home viewing, at film festivals and conferences, and in informal learning environments.
The project addresses the need for research on the impacts of IVR devices as it become more affordable and more widely used at home and in other informal and formal environments. Few studies have investigated how design elements impact the user in IVR, in which the increased immersion affects the stimuli perception and cognitive processing. The research will assess the learning affordances and impacts of the IVR experience on participant ocean literacy (adapting items from an existing ocean literacy survey), environmental empathy/feelings of presence (naturalistic observations and post-experience interviews), and perceived self-efficacy (pre-post survey, post-interview interviews). In addition, the project will research how segmentation (i.e., a continuous experience vs. an experience with breaks), generative learning tasks (hands-on experiences and interactive during IVR), and gender of the narrator in an IVR experience supports learning about ocean environments. Researchers will collect data from students attending high schools with predominantly minority student enrollments. Research findings will be widely shared through peer-reviewed publications, conference presentations, and publications for educators and designers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project responds to the Faculty Early Career Development Program (CAREER) solicitation (NSF 17-537) and is sponsored by the Advancing Informal STEM Learning program at the National Science Foundation. CAREER: Talking Science: Early STEM Identity Formation Through Everyday Science Talk (Talking Science) addresses the critical issue of the development of children's identification with science, technology, engineering and mathematics (STEM) fields and the limited knowledge about the development of STEM identity through conversations, particularly among very young children from underserved and underrepresented populations. Talking Science is based on the premise that individuals who develop STEM interests and identify with STEM at a young age tend to participate in STEM fields more so than individuals who develop these later in life. This study investigates how STEM-related conversations outside of school with friends and family during formative years (i.e., 7 - 12 years old) shape youths’ STEM identity later in life and their engagement in STEM. The goals of Talking Science are (1) To develop an understanding of the features and context of conversations held between children and their caregivers/teachers that support STEM identity development in both majority and Hispanic/Latine populations; and (2) To translate the research outcomes into informal STEM learning practices that positively contribute to young people's perceptions of STEM fields in their future.
To achieve its goals, this work addresses the following research questions: (1) What is the content, context, and structure of STEM-related conversations with friends and family that youth ages 7 - 12 participate in?; (2) How do the features of conversation (i.e., content, context, structure) relate to the development of youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; (3) How do the cultural values and science talk experiences of Hispanic/Latine youth shape conversation features related to youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; and (4) Does professional development for practitioners that focuses on encouraging youth to engage in STEM-related conversations with friends and family positively contribute to youth's STEM interest, sense of recognition, and self-identification with STEM? To address these questions, the study adopts a qualitative research approach that applies phenomenological strategies in research design, data collection, and analysis to allow for exploration of the meaning of lived experiences in social and cultural contexts. Participants include elementary-age youths (ages 7 - 12) and caregivers from socially, culturally, linguistically, and economically diverse backgrounds. To inform the development of interview protocols in terms of the kinds of childhood talk that leave a long-term impact on students, including the kinds of talk experiences remembered by students who choose or persist towards a STEM career in college, the project also recruits college students pursuing STEM degrees as participants. Data gathering and interpretation strategies include surveys and interviews. The outcomes of this research will constitute a theoretical framework and models that guide the development of both professionals and programmatic activities at informal learning institutions, particularly around scaffolding participation in STEM through family science talk.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins
Robots and robotics excite and challenge youths and adults. Unfortunately, the cost of purchasing robots or building useful robots is prohibitive for many low resource individuals and groups. This project will relieve this expense and provide an opportunity for resource limited individuals to experience the thrilling aspects of robotics by building a computer game that simulates robotic action. This project uses co-robotics wherein the participating player programs an avatar to assist in a symbiotic manner to achieve the goals of the game and participant. The game will provide access to the ideas and concepts such as programing, computational thinking and role assumption. The overarching goals are (1) to engage low-resource learners in STEM education through robotics in out-of-school spaces, and (2) to update the field of robotics-base STEM education to integrate the co-robotics paradigm.
This project is designed to gain knowledge on how co-robotics can be used in the informal education sector to facilitate the integration of computational science with STEM topics and to expand the educational use of co-robotics. Because the concept of co-robotics is new, a designed-based research approach will be used to build theoretical knowledge and knowledge of effective interventions for helping participants learn programing and computational thinking. Data will be collected from several sources including surveys, self-reports, in game surveys, pre and post-tests. These data collection efforts will address the following areas: Technology reliability, Resolution of cognitive tension around co-play, Accelerate discovery and initial engagement, Foster role-taking and interdependence with co-robots, Investigate social learning, and Validate measures using item response theory analysis. The DBR study questions are:
1.What design principles support the development of P3Gs that can effectively attract initial engagement in a free-choice OST space that offers large numbers of competing options? 2.What design principles support a P3G gameplay loop that enables learning of complex skills, computational thinking and co-robotics norms, and building of individual and career interest over the course of repeated engagement?
3.What design principles support P3Gs in attaining a high rate of re-engagement within low-resource OST settings? 4.What kinds of positive impact can P3Gs have on their proximal and distal environment? In addition, the project will research these questions about design: 1.What technical and game design features are needed to accommodate technological interruption? 2.What design elements or principles mitigate competition for cognitive resources between real-time play and understanding the co-robotic's behavior in relation to the code the player wrote for it? 3.What design elements are effective at getting learners in OST settings to notice and start playing the game? 4.What designs are effective at encouraging learners to engage with challenging content, particularly the transition from manual play to co-play? 5.What design elements help players develop a stake in the role the game offers? 6.What social behaviors emerge organically around a P3G prototype that is not designed to evoke specific social interactions?
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This project examines the conditions in which families and young learners most benefit from "doing science and math" together among a population that is typically underserved with respect to STEM experiences--families experiencing poverty. This project builds on an existing program called Teaching Together that uses interactive parent-child workshops led by a museum educator and focused on supporting STEM learning at home. The goal of these workshops is to increase parents'/caregivers' self-perception and ability to serve as their child's first teacher by supporting learning and inquiry conversations during daily routines and informal STEM activities. Families attend a series of afternoon and evening workshops at their child's preschool center and at a local children's museum. Parents/Caregivers may participate in online home learning activities and museum experiences. The project uses an experimental design to test the added value of providing incremental supports for informal STEM learning. The study uses an experimental design to address potential barriers parents/caregivers may perceive to doing informal STEM activities with their child. The project also explores how the quantity and quality parent-child informal learning interactions may relate to changes in children's science and mathematics knowledge during the pre-kindergarten year. The project partners include the Children's Learning Institute at the University of Texas Health Science Center at Houston and the Children's Museum of Houston.
The project is designed to increase understanding of how parents/caregivers can be encouraged to support informal STEM learning by experimentally manipulating key aspects of the broader expectancy-value-cost motivation theory, which is well established in psychology and education literatures but has not been applied to preschool parent-child informal STEM learning. More specifically, the intervention conditions are designed to identify how specific parent supports can mitigate potential barriers that families experiencing poverty face. These intervention conditions include: modeling of informal STEM learning during workshops to address skills and knowledge barriers; materials to address difficulties accessing science and math resources; and incentives as a way to address parental time pressures and/or costs and thereby improve involvement in informal learning activities. Intervention effects will be calculated in terms of effect sizes and potential mediators of change will be explored with structural equation modeling. The first phase of the project uses an iterative process to refine the curriculum and expand the collection of resources designed for families of 3- to 5-year-olds. The second phase uses an experimental study of the STEM program to examine conditions that maximize participation and effectiveness of family learning programs. In all, 360 families will be randomly assigned to four conditions: 1) business-as-usual control; 2) the Teaching Together core workshop-based program; 3) Teaching Together workshops + provision of inquiry-based STEM activity kits for the home; and 4) Teaching Together workshop + activity kits + provision of monetary incentives for parents/caregivers when they document informal STEM learning experiences with their child. The interventions will occur in English and Spanish. A cost analysis across the interventions will also be conducted. This study uses quantitative and qualitative approaches. Data sources include parent surveys and interviews, conversation analysis of home learning activities, parent photo documentation of informal learning activities, and standardized assessments of children's growth in mathematics, science, and vocabulary knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. In this Innovations and Development project, Child Trends, in collaboration with Ivanhoe Broadcast News, will expand the reach of the Child Trends News Service, and rigorously evaluate its impact on viewers. The News Service aims to build the public's knowledge of, and appreciation for, social science research and to encourage adoption of research-informed parenting practices associated with positive child development--particularly among Latino parents. First produced in 2017 through a NSF proof of concept grant, the Child Trends News Service covers actionable, child-focused, social science research. By featuring this research on local TV news, the project expands access to evidence-based parenting recommendations. As of February 2018, 89 stations had subscribed to the News Service, including eight stations in the top 25 Latino-serving TV markets that reach 38% of all Hispanic TV Households in those 25 markets. This project is a response to the challenges faced by U.S. children, of whom more than one in five live in poverty. The focus on Latino parents is in response Latinos' increasing share of all children, and that Latino children are disproportionately poor, in comparison to their peers. The project will examine the impact of the News Service on parents who view the news reports in their homes, as well as Latino parents viewing the News Service as part of their participation in the Abriendo Puertas (Opening Doors) community-based parenting program. This research will contribute to the knowledge base of what we know about how people access and use science, technology, engineering and math (STEM) information across settings.
The overarching aim of this project is to leverage commercial television news to reach populations who have historically been underrepresented in STEM education and careers. The goals of the project are to:
1. Build and manage an interdisciplinary collaborative, including news media professionals, researchers, practitioners in organizations serving at-risk families, and experts in STEM communications and Latino studies.
2. Leverage mass media news outlets to deliver social science research on children to at-risk populations, with a focus on reaching Latino parents.
3. Advance the field of informal STEM learning by exploring how the public interacts with actionable research on child development to inform their knowledge, attitudes and behaviors.
4. Expand the reach and application of the news products through strategic outreach to other stakeholders in the child development field including programs serving under-served families.
To accomplish these goals, the project will further strengthen an Advisory Panel to inform content development, study design, interpretation of findings, dissemination of study results, and the transition of the project after the NSF grant period. The project will continue to provide eight (both in English and Spanish) stories each month to TV stations and strategically grow the reach in top Latino markets. The editorial process will be informed by surveys of Latino parents to identify topics of interest. Through a random-assignment impact study with local TV news audiences from diverse racial/ethnic groups, the project will evaluate the impact of the News Service. The project will use formative research methods to refine messaging and examine the potential for repurposing the videos through a parenting program for Latino parents.
The Child Trends News Service seeks broader impacts in three areas: increasing the public's scientific literacy and engagement with science and technology; increasing partnerships between academia, industry, and others; and improving the well-being of individuals in society.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. There are few empirical studies of sustained youth engagement in STEM-oriented making over time, how youth are supported in working towards more robust STEM related projects, on the outcomes of such making experiences among youth from historically marginalized communities, or on the design features of making experiences which support these goals. The project plans to conduct a set of research studies to develop: a theory-based and data-driven framework for equitably consequential making; a set of related individual-level and program-level cases with exemplars (and the associated challenges) that can be used by researchers and practitioners for guiding the field; and an initial set of guiding principles (with indicators) for identifying equitably consequential making in practice. The project will result in a framework for equitably consequential making with guiding principles for implementation that will contribute to the infrastructure for fostering increased opportunities to learn among all youth, especially those historically underrepresented in STEM.
Through research, the project seeks to build capacity among STEM-oriented maker practitioners, researchers and youth in the maker movement around equitably consequential making to expand the prevailing norms of making towards more transformative outcomes for youth. Project research will be guided by several questions. What do youth learn and do (in-the-moment and over time) in making spaces that work to support equity in making? What maker space design features support (or work against) youth in making in equitably consequential ways? What are the individual and community outcomes youth experience in STEM-making across settings and time scales? What are the most salient indicators of equitably consequential making, how do they take shape, how can these indicators be identified in practice? The project will research these questions using interview studies and critical longitudinal ethnography with embedded youth participatory case study methodologies. The research will be conducted in research-practice partnerships involving Michigan State University, the University of North Carolina at Greensboro and 4 local, STEM- and youth-oriented making spaces in Lansing and Greensboro that serve historically underrepresented groups in STEM, with a specific focus on youth from lower-income and African American backgrounds.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).