In 2022, Kera Collective partnered with Made By Us to evaluate the impact of its flagship program, Civic Season, in its second year running. Held annually between Juneteenth and July 4th, Civic Season “rolls out the welcome mat” for Young People—the future inheritors of the United States—by connecting them to 150+ museums, historic sites, and historical societies and putting history in their hands as a tool for informed, inspired civic participation.
Our work, and Civic Season’s implementation, came at a time when the gap between Young People (age 18-30) and history organizations was huge
The COVID-19 pandemic tested many fundamental connections between science and society. A growing field working to strengthen those connections exists within the informal STEM learning (ISL) community which provides diverse learning and engagement environments outside the formal classroom. One of the largest funders of ISL initiatives is the National Science Foundation (NSF) which runs the Advanced Informal STEM Learning (AISL) program in the United States. The AISL program supports initiatives through six categories that include pilots and feasibility studies, research in service to practice
Despite decades of policies and programs meant to increase the representation of girls and women in science, technology, engineering, and mathematics (STEM), girls and women of color still represent a much smaller percent of the STEM workforce than they do in the US population. This lack of representation is preventing the US STEM workforce from reaching its true potential. Intersecting inequalities of gender, race, ethnicity, and class, along with stereotypes associated with who is successful in STEM (i.e., White men), lead to perceptions that they do not belong and may not succeed in STEM. Ultimately, these issues hinder girls’ STEM identity development (i.e., sense of belonging and future success), lead to a crisis of representation for women of color and have compounding impacts on the STEM workforce. Research suggests there are positive impacts of in-person STEM learning after-school and out-of-school time programs on girls’ sense of belonging. The increasing need for online learning initiated by the COVID-19 pandemic means it is vital to investigate girls’ STEM identity development within an online community. Thus, the project will refine and test approaches in online learning communities to make a valuable impact on the STEM identity development of girls of color by 1) training educators and role models on exemplary approaches for STEM identity development; 2) implementing a collaborative, girl-focused Brite Online Learning Community that brings together 400 girls ages 13-16 from a minimum of 10 sites across the United States; and 3) researching the impact of the three core approaches -- community building, authentic and competence-demonstrating hands-on activities, and interactive learning with women role models -- on participating girls’ STEM identities in online settings.
The mixed methods study is guided by guided by Carlone & Johnson’s model of STEM identity involving four constructs: competence, performance, recognition, and sense of belonging. Data collection sources for the quantitative portion of the project include pre- and post-surveys, while qualitative data sources will be collected from six case study sites and will include observations, focus group interviews with girls, artifacts created by girls and educators, educator interviews, and open-ended survey responses. This approach will enable the research team to determine how and the extent to which the Brite Online Learning Community influences STEM identity constructs, interpreting which practices lead to meaningful outcomes that can be linked to the development of STEM identity for participating girls in an online environment. The products of this work will include research-based, tested Brite Practices and a toolkit for fostering girls’ interest, identification, and long-term participation in STEM. The resulting products will increase the reach of informal STEM education programming to girls of color across the nation as online spaces can reach more girls, potentially increasing the representation of women of color in the STEM workforce.
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This project is funded by the EHR Core Research (ECR) program, which supports work that advances fundamental research on STEM learning and learning environments, broadening participation in STEM, and STEM workforce development. It responds to continuing concerns about racial and social inequities in STEM fields that begin to emerge in the early childhood years. The overarching goal of the project is to identify cultural strengths that support early science learning opportunities among Spanish-speaking children from immigrant Latin American communities, a population that is traditionally underrepresented in STEM educational and career pursuits. Building on a growing interest in the ways stories can promote early engagement in and understanding of science, this project will investigate the role of oral and written stories as culturally relevant and potentially powerful tools for making scientific ideas and inquiry practices meaningful and accessible for young Latinx children. Findings will reveal ways that family storytelling practices can provide accessible entry points for Latinx children's early science learning, and recommend methods that parents and educators can use to foster learning about scientific practices that can, in turn, increase interest and participation in science education and fields.
The project will advance knowledge on the socio-cultural and familial experience of Latinx children that can contribute to their early science learning and skills. The project team will examine the oral story and reading practices of 330 Latinx families with 3- to 5-year-old children recruited from three geographic locations in the United States: New York, Chicago, and San Jose. Combining interviews and observations, the project team will investigate: (1) how conversations about science and nature occur in Latinx children's daily lives, and (2) whether and to what extent narrative and expository books, family personal narratives, and adivinanzas (riddles) engender family conversations about scientific ideas and science practices. Across- and within-site comparisons will allow the project team to consider the immediate ecology and broader factors that shape Latinx families’ science-related views and practices. Although developmental science has long acknowledged that early learning is culturally situated, most research on early STEM is still informed by mainstream experiences that largely exclude the lived experiences of children from groups underrepresented in STEM, especially those who speak languages other than English. The proposed work will advance understanding of stories as cultural resources to support early science engagement and learning among Latinx children and inform the development of high quality, equitable informal and formal science educational opportunities for young children.
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.
This is the third of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on steps for conducting media research and research protocals.
This is the second of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on ways to identify your missing audience.
This is the first of three guides for media practioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on possible practices for creating an audience research collaboration for media professionals, evaluators and communication researchers.
For both parents and educators, monitoring and adjusting their behaviors to ensure that children develop appropriate prosocial and learning behaviors is a complex balance between nurturance and limit setting. When these interactions are strained, negative or coercive cycles may emerge that delay appropriate development and exacerbate existing impairment. To disrupt the development of coercive cycles, adults must have the ability to accurately assess the quality of their interactions with children and integrate this information into personal change. Approaches to measuring these types of interactions will inform what we know about the mechanisms of child social, emotional, and learning development in STEM learning settings, and enable the creation of adaptive interventions for those moments when support is most needed. This project envisions a closed-loop intervention framework to promote a supportive and interactive environment around children. Smart wearables will sense interaction and responses between the children and their parents or educators, using embedded machine learning technology to recognize supportive behaviors. The perceived behaviors will be sent to a cloud server where adaptive interaction strategies will be identified from either online psychological consultation or artificial intelligence. These interaction strategies will then be provided to the parents and educators in the form of guidance cues to promote a supportive STEM learning environment around the children.
This planning project aims to understand the barriers and critical problems in the implementation of smart technology and psychological strategies to support adult-child interactions in STEM learning settings. The work will proceed by convening key stakeholders (parent organizations, formal educational institutions, and informal educational institutions) in a series of iterative discussions to produce a set of adult-child behavioral targets that are essential to children’s development of social, emotional, and learning skills. Further discussions will then identify mechanisms to enhance these behaviors, and reduce competing, less effective approaches. Qualitative thematic analysis of the discussions will be used to capture these behaviors and mechanisms. Then technologies will be developed to measure, provide feedback on, and improve these behaviors. These devices will be piloted with adult-child dyads. Audiovisual data collected by the devices will be human coded as well as processed by algorithms to vet the technological capacity of the devices to detect and respond to targeted behaviors. A series of debriefing interviews and surveys with adult-child dyads will be used to determine the feasibility, acceptability, and utility of the devices. The collected preliminary data will support the forming of critical technological and social science research questions that co-inform one another: questions about the social engagement between adults and children will drive the technical research, and what can be discovered via the technological research will open up new questions that can be posed about social engagement between children and adults. Adult-child interactions are key social factors that integrate to produce student social, emotional, and academic outcomes. Within our informal educational communities, our formal educational communities, and our familial communities it is essential to find the best mechanisms for measuring, providing feedback, and improving these interactions. This work thus seeks to advance a new approach to, and evidence-based understanding of, the development of STEM learning. This Smart and Connected Communities project is also supported by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
This project investigates long-term human-robot interaction outside of controlled laboratory settings to better understand how the introduction of robots and the development of socially-aware behaviors work to transform the spaces of everyday life, including how spaces are planned and managed, used, and experienced. Focusing on tour-guiding robots in two museums, the research will produce nuanced insights into the challenges and opportunities that arise as social robots are integrated into new spaces to better inform future design, planning, and decision-making. It brings together researchers from human geography, robotics, and art to think beyond disciplinary boundaries about the possible futures of human-robot co-existence, sociality, and collaboration. Broader impacts of the project will include increased accessibility and engagement at two partner museums, interdisciplinary research opportunities for both undergraduate and graduate students, a short video series about the current state of robotic technology to be offered as a free educational resource, and public art exhibitions reflecting on human-robot interactions. This project will be of interest to scholars of Science and Technology Studies, Human Robotics Interaction (HRI), and human geography as well as museum administrators, educators and the general public.
This interdisciplinary project brings together Science and Technology Studies, Human Robotics Interaction (HRI), and human geography to explore the production of social space through emerging forms of HRI. The project broadly asks: How does the deployment of social robots influence the production of social space—including the functions, meanings, practices, and experiences of particular spaces? The project is based on long-term ethnographic observation of the development and deployment of tour-guiding robots in an art museum and an earth science museum. A social roboticist will develop a socially-aware navigation system to add nuance to the robots’ socio-spatial behavior. A digital artist will produce digital representations of the interactions that take place in the museum, using the robot’s own sensor data and other forms of motion capture. A human geographer will conduct interviews with museum visitors and staff as well as ethnographic observation of the tour-guiding robots and of the roboticists as they develop the navigation system. They will produce an ethnographic analysis of the robots’ roles in the organization of the museums, everyday practices of museum staff and visitors, and the differential experiences of the museum space. The intellectual merits of the project consist of contributions at the intersections of STS, robotics, and human geography examining the value of ethnographic research for HRI, the development of socially-aware navigation systems, the value of a socio-spatial analytic for understanding emerging forms of robotics, and the role of robots within evolving digital geographies.
This project is jointly funded by the Science and Technology Studies program in SBE and Advancing Informal STEM Learning (AISL) Program in EHR.