This project will host a workshop in order to identify and synthesize research findings from NSF awards that addressed the unanticipated effects of the COVID-19 pandemic on STEM teaching and learning. The interruptions from the pandemic had dramatic, widespread effects in education. Across the nation, teachers, students, parents, staff, and school administrators experienced extended school closures and a rapid and unexpected shift to virtual instruction. Although long-term consequences are unknown, early observations revealed deeper disparities in access and opportunity for many students of color. These inequities extend beyond STEM education and include challenges to student’s mental health and wellbeing. In spring 2020, NSF invited researchers to submit educational research proposals in response to this national crisis. Each award has its own dissemination and plans for broader impacts, yet the public is underserved by separate reports published in many different venues. To enable stakeholders to find and discern the most important insights, our research team will aggregate and organize major findings across these projects via a workshop, synthesize key findings, identify unresolved issues, and communicate overall insights to broader audiences.
To synthesize findings, Digital Promise will organize and convene a workshop with NSF awardees who conducted research on the educational impacts of the pandemic. Workshop attendees will participate in answering four questions: (1) What are the major themes and topics across the different NSF awards? (2) How were imperatives to address emerging inequities related to STEM education addressed in research plans and findings? (3) Within each topic or theme, what are the major findings, insights and recommendations for teaching and learning in STEM? (4) Across awardees, what was learned about doing RAPID research during a pandemic, and what are recommendations for improvement when subsequent needs for RAPID research in education arise? Data sources for the synthesis will be collected from project artifacts (e.g., reports, journal articles, practitioner resources, etc.), pre/post-workshop surveys, and workshop outputs from workshop presentations, panel discussions, and small group discussions. Interviews with a subset of workshop attendees will provide insight into what was learned about conducting research during a global pandemic. Data will be codified, categorized, and coded using established qualitative methods. Digital Promise’s broad network of partners and collaborators will achieve broad dissemination and outreach to education stakeholders at both the K-12 and postsecondary levels. This project is jointly funded by the Advancing Informal STEM Learning (AISL) program, the Discovery Research PreK-12 program (DRK-12) program, the EHR Core Research (ECR:Core) program, and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
DATE:
-
TEAM MEMBERS:
Vanessa PetersJudith Fusco
resourceprojectProfessional Development, Conferences, and Networks
Informal learning institutions--museums, libraries, news organizations, and others--work to inform their audiences about the rapidly emerging scientific consensus on various topics. Often this information invites action such as social distancing during a pandemic. What motivates people to act upon that information (or not)? When recommended actions can yield good or bad outcomes for oneself, the information needs to fit with motivational tendencies towards preventing bad outcomes and/or promoting good outcomes. Recent theories indicate similar motives for recommended actions that affect others: family, friends, neighbors, and up the scale to the societal and the biological world. This small virtual conference will bring together STEM researchers and practitioners to offer a transdisciplinary and practically minded critique of the model of moral motives and discuss its implications for actions related to STEM topics. Specifically, the conference will use data collected by NSF RAPID grant (#2027939) that connects people’s news consumption, their compliance with COVID-19 prevention recommendations, and their judgments of whose wellbeing (from self to society) recommended behaviors protect or promote.
This small virtual conference will recruit approximately 16 attendees including transdisciplinary scholars whose work addresses social responsibility in the context of STEM informal learning and practitioners from a broad range of sectors including science centers, libraries, zoos, and the media. Individual disciplines will include anthropology, psychology, the interdisciplinary fields of the learning sciences and judgement and decision-making. The conference strategy will include synchronous, asynchronous, and small group collaborations in addition to full-group discussion. Conference activities will spread over 8 weeks. The structure of the conference is loosely based on the Open Space Technology approach (i.e.: General & Lantelme, 2014, Owen 1997). To build capacity in these various informal learning sectors participants will distill implications about moral motives into practical advice to publish in the conference proceedings that will include a report on the initial and collaboratively revised models. An editable version of the proceedings will allow registered practitioners to further critique and develop that advice. The conference proceedings will be distributed as a short Creative Commons e-book with copies and links distributed on the website of the Center for Advancing Informal STEM Education , and through all the participant’s professional research and practitioner societies.
This report summarizes findings of an NSF conference grant designed to support the knowledge-building component of the 2019 Inclusive SciComm Symposium (ISCS). Specifically, this document describes symposium participants' motivations for attending the symposium, the symposium's effectiveness in achieving participants' desired outcomes, and participants' attitudes, behaviors, and self-efficacy related to critical dialogue, or difficult conversations across difference. The report also summarizes participants' perceived needs, challenges, and opportunities for advancing inclusive, equitable, and
DATE:
TEAM MEMBERS:
Sunshine MenezesHollie SmithKayon Murray-JohnsonHannah TrautmannMehri Azizi
Despite the fact that most science learning takes place outside of school, little is known about how engagement in informal science learning (ISL) experiences affects learners’ knowledge, skill development, interest, or identities over long periods of time. Although substantial ISL research has documented short-term outcomes such as the learning that takes place during a science center visit, research suggests that the genuine benefits of informal experiences are long-term transformations in learners as they pursue a “cascade” of experiences subsequent to the initial educational event
For both parents and educators, monitoring and adjusting their behaviors to ensure that children develop appropriate prosocial and learning behaviors is a complex balance between nurturance and limit setting. When these interactions are strained, negative or coercive cycles may emerge that delay appropriate development and exacerbate existing impairment. To disrupt the development of coercive cycles, adults must have the ability to accurately assess the quality of their interactions with children and integrate this information into personal change. Approaches to measuring these types of interactions will inform what we know about the mechanisms of child social, emotional, and learning development in STEM learning settings, and enable the creation of adaptive interventions for those moments when support is most needed. This project envisions a closed-loop intervention framework to promote a supportive and interactive environment around children. Smart wearables will sense interaction and responses between the children and their parents or educators, using embedded machine learning technology to recognize supportive behaviors. The perceived behaviors will be sent to a cloud server where adaptive interaction strategies will be identified from either online psychological consultation or artificial intelligence. These interaction strategies will then be provided to the parents and educators in the form of guidance cues to promote a supportive STEM learning environment around the children.
This planning project aims to understand the barriers and critical problems in the implementation of smart technology and psychological strategies to support adult-child interactions in STEM learning settings. The work will proceed by convening key stakeholders (parent organizations, formal educational institutions, and informal educational institutions) in a series of iterative discussions to produce a set of adult-child behavioral targets that are essential to children’s development of social, emotional, and learning skills. Further discussions will then identify mechanisms to enhance these behaviors, and reduce competing, less effective approaches. Qualitative thematic analysis of the discussions will be used to capture these behaviors and mechanisms. Then technologies will be developed to measure, provide feedback on, and improve these behaviors. These devices will be piloted with adult-child dyads. Audiovisual data collected by the devices will be human coded as well as processed by algorithms to vet the technological capacity of the devices to detect and respond to targeted behaviors. A series of debriefing interviews and surveys with adult-child dyads will be used to determine the feasibility, acceptability, and utility of the devices. The collected preliminary data will support the forming of critical technological and social science research questions that co-inform one another: questions about the social engagement between adults and children will drive the technical research, and what can be discovered via the technological research will open up new questions that can be posed about social engagement between children and adults. Adult-child interactions are key social factors that integrate to produce student social, emotional, and academic outcomes. Within our informal educational communities, our formal educational communities, and our familial communities it is essential to find the best mechanisms for measuring, providing feedback, and improving these interactions. This work thus seeks to advance a new approach to, and evidence-based understanding of, the development of STEM learning. This Smart and Connected Communities project is also supported by the Advancing Informal STEM Learning program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
resourceprojectProfessional Development, Conferences, and Networks
Persistent racial injustices and inequities in the United States and in STEM fields underscore the need for creative, research-based approaches to address these concerns. In particular, creative approaches are needed for studying and addressing racial injustices and inequities in STEM education, where racial equity and STEM learning are both given careful and thoughtful consideration. This project focuses on supporting emerging scholars who have new ideas and approaches for approaching racial equity in their scholarship and work. This workshop, implemented as a series of sessions over the course of a year, will support early career scholars in STEM education and the learning sciences in preparing proposals to submit to the National Science Foundation. The workshop is designed to serve scholars who are within five years of obtaining their PhD and who have never before been principal investigator or co-principal investigator of a federally-funded grant. Participants will include early career scholars who focus their work on racial equity. Too often, such scholars have indicated that they have received little to no training on writing grant proposals.
Ten participants will be supported by the project through a year-long series of workshops that include different aspects of the grant writing process including reading through a solicitation, writing a narrative, and creating a budget. In addition to these workshop sessions, the project approach also considers the importance of a professional network and of mentoring, informed by a Communities of Practice theoretical framework and existing research on mentoring practices. As such, each early career scholar will be paired with a senior mentor in the field whose work is aligned with the mentee's. The outcomes of the workshop for early career scholars will include a complete or nearly complete proposal that is aligned with one of the programs within the NSF's Division of Research on Learning. The workshop will highlight strategies for developing CAREER proposals along with considerations for preparing proposals for other programs. More generally, the workshop will create a model for supporting and mentoring early career scholars in proposing STEM education projects centered in racial equity work and will be able to identify areas of need for successful grant proposal writing. All workshop materials will be made freely available to the general public.
The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project is also funded through the Advancing Informal STEM Learning (AISL), CS for All: Research and RPPs, and Innovative Technology Experiences for Students and Teachers (ITEST) programs.
Public outdoor spaces present opportunities for social experiences and learning. This Broader Implementation project will expand and evaluate a model that transforms urban public spaces into accessible and engaging environments for learning social science in outdoor public spaces. The model combines social science inquiry exhibits, place making and human facilitation of learning experiences in outdoor public areas. Project exhibits use the facilitated social interactions as both the content of and medium for the experiences. This project will adapt the existing exhibits and add new exhibits and facilitation techniques for testing in three different urban environments. Project research will explore the efficacy of these adaptations and revised facilitation techniques for the different settings in collaboration with civic partners at each site. The project will share the model and research findings widely through the Exploratorium website and publications for researchers, developers, and educators.
The team’s prior research showed that facilitators improved multiple learning outcomes with the current exhibits. Visitors acquired new social observation skills, reflected on their own experiences, perceptions, and actions, and increased their awareness for how social behavior, cognition, and emotion can be studied scientifically. Building on the prior research, the project will install the exhibition and test its efficacy in three different urban environments and explore the adaptations that are required for different settings with different civic partners. The project will use design-based research to develop a new theoretical model of facilitation strategies for supporting science learning in outdoor public spaces. For evaluation, the project will use mixed methods, including observations, interviews, surveys, and document review. Evaluation will assess success in attracting and engaging visitors; conveying social science concepts; prompting self-reflection of judgments and actions; and fostering empathy among those with different social identities. The project will assess the extent to which participants, particularly those from marginalized communities, experience feelings of belonging and inclusion. The project will be presented in three sites which represent the significant diversity, income levels, and urban environments of San Francisco. Facilitation strategies are being co-developed with Urban Alchemy, an organization that works within distressed urban communities in San Francisco. Project site partners and collaborators include the San Francisco Public Library, the Port of San Francisco, and the San Francisco Department of Parks and Recreation. The project will also measure partnership outcomes, through surveys and interviews, to look at the extent and ways the project integrates a co-creation model and develops an authentic, mutually beneficial, sustainable partnership. The project will generate and disseminate generalizable knowledge about the affordances of combining informal science learning, placemaking, and facilitation in a variety of free, outdoor STEM learning spaces in collaboration with local community groups. The project will also advance public understanding of the social and behavioral sciences.
This research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and sssessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Zoos and aquariums have been offering programming, events, and visit accommodations to autistic individuals for several years. While these efforts can provide great experiences, they are focused more on accommodation and the outward-facing guest experience than inclusion. Lack of inclusion features in design, programming, and representation amongst zoo and aquarium representatives, ultimately limits full inclusion and adds to a sense in autistic individuals of not belonging and not being welcomed. To develop a fully inclusive experience for autistic individuals, this project will develop an evidence-based framework of inclusive practices for zoos and aquariums and build a community of practice around inclusion broadly. The project brings together researchers from Oregon State University, Vanderbilt Kennedy Center’s Treatment and Research Institute for Autism Spectrum Disorders, and the Association of Zoos and Aquariums. Researchers will create and investigate the extent and ways in which a research-informed framework and associated tools (i.e. case studies, discussion guides, self-guided audits, etc.) and strategies support science learning for autistic individuals, and help practitioners expand access and inclusion of autistic audiences beyond special events or the general visit experience by applying inclusive practices for programs, exhibit development, internships, volunteer opportunities, and employment. To maximize impact, the project will develop and expand a network of early adopters to build a community of practice around inclusive practices to develop fully inclusive zoo and aquarium experiences for all individuals.
The project will investigate 4 research questions: (1) In what ways and to what extent are zoos and aquariums currently addressing access and inclusion for autistic individuals? (2) How do staff in zoos and aquariums perceive their and their institution’s willingness and ability to address access and inclusion for autistic individuals? (3) What is a framework of evidence-based practices across the zoo and aquarium experience that is inclusive for autistic individuals, and what associated tools and strategies are needed to make the framework useful for early adopters? And (4) to what extent and in what ways does a research informed framework with associated tools and strategies engage, support, and enhance an existing community of practitioners already dedicated to addressing autistic audiences and promote inclusive practices at zoos and aquariums for autistic people? The project is designed as two phases: (1) the research and development of a framework of inclusive practices and tools for supporting autistic individuals and (2) expanding a network of early adopters to build a community of practice around inclusive practices and an overall strategy of implementation. The framework will be informed through a state of the field study across the zoo/aquarium field that includes a landscape study and needs assessment as well as a review of literature that synthesizes existing research across disciplines for developing inclusive practices for autistic individuals in zoos and aquariums. The team will also conduct online surveys and focus groups to gather input from various stakeholders including zoo and aquarium employees and practitioners, autistic individuals, and their social groups (e.g., family members, peers, advocacy organizations). The second phase of the study will focus on sharing the framework and tools with practitioners across the zoo/aquarium field for feedback and reflection to develop an overall strategy for broader implementation and expanding the existing network of zoo and aquarium professionals to build a community of practice dedicated to the comprehensive inclusion of autistic individuals across the full zoo and aquarium experience. The results will be disseminated through conference presentations, scholarly publications, online discussion forums, and collaborative partners’ websites. The project represents one of the first of its kind on autistic audiences within the zoo and aquarium context and is the first to look at the full experience of autistic patrons to zoos and aquariums across programs/events, exhibits, volunteering, internship, and employment opportunities. A process evaluation conducted as part of the project will explore how the approach taken in this project may be more broadly applied in understanding and advancing inclusion for other audiences historically underserved or marginalized by zoos and aquariums.
This Research in Service to Practice project is supported by the Advancing Informal STEM Learning (AISL) program.
Science is a process of inquiry that involves question asking, experimentation, and exploration. However, for youth, it is often presented as settled, a fixed collection of facts, principles, and theories that can seem sterile and unimaginative. This project is designed to combat that idea. This Research in Service to Practice project brings scientists, middle school youth and choreographers together to explore unsettled scientific phenomena from a complex systems perspective using choreography and agent-based modeling (ABM), to engage all participants in cutting edge scientific inquiry. Given the ubiquity of complex systems, being able to adopt a complex systems perspective is critical to understanding the world and our relationship to it. However, research has shown that this can be a challenge, specifically for youth. While most complex systems research has not focused on the role of the body, recent studies have shown the promise and potential of embodiment as its own form of reasoning about complex systems. Thus, this project will create exploratory science spaces foregrounding embodiment in the process of scientific discovery. The program has two phases: (1) a 20-hour training workshop where scientists and choreographers engage in interdisciplinary collaborative design work, and (2) a 60-hour summer program where the researcher-practitioner partnership involving scientists, choreographers and youth engages in agent- based & embodied choreographic scientific modeling. The summer program takes place in community-based centers in Gainesville, FL and Boston, MA broadening perceptions of what science research looks like and can be. Each site will host 20 youth, two local scientists, and a local choreographer. Participants will engage in embodied collaborative inquiry, brainstorming and modeling to create choreographic representations and culminate in a public event for the community. The project aims to understand the experiences of and shifts in youth and scientists as they engage in these activities and to understand how to design such a model for informal learning. The project will also help scientists apply a complex systems lens to their own work and settled perspectives. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Using a design-based research (DBR) approach, the project will develop and expand embodied and agent-based learning theories, while also piloting, analyzing, and refining collaborative models for science learning in informal spaces. The research questions are: 1. How does engaging in the process of creating embodied and agent-based models of complex systems contribute to new ways of understanding science, de-settle ideas about the process of how science gets “made”, and impact understanding of the role of the body in making science? and 2. How can arrangements of bodies and modeling tools work together to support understanding of complex systems? The research and design are informed by three main theoretical principles: (a) science is “dance of agency”, a process of inquiry that through iterative dialogic interaction with tools, technology, and humans, produces understandings that more and more closely explain natural phenomena; (b) embodied-interactionist theories of learning allow us to understand representational sense-making by looking closely at the processes by which representations are made, not just at representational end- products; and (c) creative embodiment and agent based modeling are valuable tools for sense-making around complex science ideas and emergent phenomena. Two cycles of design, implementation, and analysis across two different informal learning sites will be conducted. Data will be collected at both sites, resulting in four implementation and data collection periods. Each round of implementation will be staggered so that reflections and lessons from an implementation can inform the next design iteration. This project will provide insights on the relationship between choreography and ABM as tools for scientific sense-making and expand ABM to consider the role of movement and bodies more broadly in physical space. It will also contribute to an understanding of how underrepresented youth’s perceptions and conceptions of science can be shaped through embodied science activities, and of the relationships these youth see between their own bodies and identities, science, and the creative arts. Finally, by involving individuals from underrepresented communities as researchers, designers, scientists, evaluators, and advisors, this project expands cross-cultural and training opportunities within the field of education and STEM research.
DATE:
-
TEAM MEMBERS:
Dionne ChampionAditi WaghLauren Vogelstein