For many youth, gaining access to quality STEM (science, technology, engineering mathematics) experiences is a challenge. Inequity and underrepresentation of youth of color in STEM persist. The makerspace movement holds great promise in broadening participation in STEM among youth from underrepresented communities. Makerspaces are defined as collaborative workspaces inside a library, school, or other community location designed for creating, learning, exploring, and sharing with high- to low-tech tools. Despite the availability of making programs focused on STEM activities targeted towards youth of color, the field has few models for designing these programs in ways that build upon youths’ cultural assets and desires for making. Working collaboratively with youth, families, and maker educators in Lansing, Michigan, and Greensboro, North Carolina, this project aims to deepen the field’s understanding about the rich and deep ingenuity in STEM-based making that youth from underrepresented communities can engage. These insights will be leveraged towards advancing community-based maker programming across four community-based makerspaces. The project will also build capacity among STEM-oriented maker educators, researchers, and youth. This model is important because the voices and perspectives of families and communities have been largely absent from the formative knowledge and theory-building processes of the field of makerspace education.
This project will build new knowledge about how and why youth and families make at home, in communities, and in STEM-based maker programs. Collaborators for the project include the University of Michigan, the University of North Carolina at Greensboro, and four STEM- and youth-oriented making spaces in Lansing, Michigan, and Greensboro, North Carolina. This project will take place in two phases, exploring two main research questions: 1) What are the learning results of making at home and in the community? And 2) How do youth organize community resources for sustained STEM making, and what facilitates or hinders such organization? Phase one investigates the community resources (people, tools, materials, knowledge, data, and spaces) youth leverage towards making and how they do so across time. The project will study how youth connect these resources to STEM-rich making and what youth and families learn in the process. In phase two, design-based research will be used to apply phase one insights to the design of community-based STEM-rich maker programs in four maker clubs in Michigan and North Carolina. This work will develop an understanding of youths’ family and community-based STEM-based making practices, including the community resources (people, tools, materials, knowledge, data, and spaces) that youth leverage.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The AI behind Virtual Humans Exhibit aims to communicate to the public about the capabilities and impact of artificial intelligence (AI) through AI technologies used in Virtual Humans including facial recognition and natural language processing. AI has and will continue to profoundly impact society in the United States and around the globe. It is important to prepare the nation’s youth and the future workforce with fundamental knowledge of AI. Informal settings, such as museums, offer open and flexible opportunities in helping youth and the general public learn about AI. Virtual Humans provide an ideal vehicle to illustrate many fields of AI, as AI is arguably the science of building intelligence that thinks and acts like humans. Led by a multidisciplinary team of researchers with expertise in AI, learning design, and assessment from the Institute for Creative Technologies at University of Southern California and the Lawrence Hall of Science at University of California, Berkeley, this project will develop a Virtual Human exhibit to engage visitors through structured conversations with a Virtual Human, while showcasing how AI drives the Virtual Human’s behavior behind the scenes. The exhibit will include collaborative learning experiences for visitors such as parent-child, siblings and peers to explore what AI is and is not, what AI is and is not capable of, and what impact it will have on their lives.
The project will investigate three research questions: (1) How can a museum exhibit be designed to engage visitor dyads in collaborative learning about AI? (2) How can complex AI concepts underlying the Virtual Human be communicated in a way that is understandable by the general public? And (3) How does and to what extent the Virtual Human exhibit increase knowledge and reduce misconceptions about AI?
The project leverages existing conversational Virtual Human technology developed through decades of collaborative research in AI, including machine vision, natural language processing, automated reasoning, character animation, and machine learning. Set in the informal setting of a museum, the exhibit will be designed following evidence-based research in Computer Supported Collaborative Learning. The project team will use a mixed methods design, drawing on design-based research methodologies and experimental studies. The research team will conduct analysis of visitor observations and interviews for iterative formative improvement. Randomized experimental studies will be conducted in both lab and naturalistic environments to gauge visitor knowledge about AI. Quasi-experimental analyses will be performed to study the relationship between engagement with exhibit features and AI knowledge. The project will produce an interactive exhibit with a Virtual Human installed at the Lawrence Hall of Science and other participating museums, and instruments to measure AI learning. The project will also produce a website where visitors can experience parts of the exhibit online and continue more in-depth learning about AI and the Virtual Human technology. The project holds the potential for producing theoretical and practical advances in helping the general public develop an understanding of AI capability and ethics, advancing knowledge in the process through which young learners develop knowledge about AI, and formulating design principles for creating collaborative learning experiences in informal settings. The results will be disseminated through conference presentations, scholarly publications, and social media. The Virtual Human exhibit will be designed for dissemination and made available for installations at informal science education communities.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
This Pilot and Feasibility study will build foundational knowledge about basic aspects of STEM webcams in the United States (US) from the perspectives of both practitioners and viewers. Thousands of webcams available to the public are operated by STEM organizations, such as zoos, museums, and government agencies. Learning theory suggests that STEM webcams, especially those with accompanying interpretive tools, have the potential to offer rich informal learning opportunities. However, yet no research has quantified any aspect (cognitive, behavioral, or emotional) of viewer outcomes. This study will be the first to develop baseline data regarding cognitive, behavioral, and emotional aspects of perceived viewer experience. Project activities include:
An inventory of STEM webcams that exist in the US, the STEM disciplines they represent, learning and engagement tools they employ, the number of viewers they reach, and the resources required for their operation
A survey of webcam operators, their STEM education goals, implementation strategies, and evaluation results; and
Surveys and interviews gathering data on viewers demographics and potential increase in curiosity, interest, knowledge, and behavior toward the STEM subject. This research will provide foundational knowledge for the STEM-education and research community that quantifies and describes many facets of the population of STEM webcams in the inventory.
Research activities will take place in three distinct phases, with Phase 1 laying the groundwork for Phases 2 and 3. Phase 1: The project team will conduct a systematic internet search for all identifiable STEM related webcams. Phase 2 (operator-focused): An online survey of practitioners of webcams operated by US-based STEM organizations will be conducted using Qualtrics software. Likert scales will be used. Various hypotheses will be tested regarding webcam program objectives, operations, and evaluations from the perspective of program operators or practitioners. Phase 3 (viewer-focused): Surveys and interviews with likely viewers of STEM webcams. Using the webcam inventory built in Phase 1, the team will collaborate with 20 informal STEM institutions that agree to survey their constituents to test hypotheses regarding webcam viewing practices, such as why and how viewers watch, and perceived outcomes of viewing, such as perceived influence on their interest, attitudes, knowledge, or behavior. The findings from this study will be widely shared with informal STEM institutions and webcam operators. It will provide foundational data for future experimental studies.
This presentation "Revealing Impacts: How does one long-term, statewide field trip program influence a community's learning ecosystem?" was shared as showcase at the 2021 Connected Learning Summit (https://app.clowdr.org/conference/clsummit2021/) held virtually from July 7-30, 2021.
In the showcase session, we shared details of an NSF funded collaborative project between the Gulf of Maine Research Institute, Oregon State University and TERC to understand how a longstanding, statewide field trip program, LabVenture, influences a community’s learning ecosystem. The project uses the construct
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
Reframing engineering activities to emphasize the needs of others has the potential to strengthen engineering practices like problem scoping, while also providing more inclusive and socially relevant entry points into engineering problems. In a three-year design-based research project, we developed novel strategies for adding narratives to engineering activities to deepen girls’ engagement in engineering practices by evoking empathy for the users of their designs. In this article, we describe a set of hands-on engineering activities developed through iterative development and testing with 190
The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.
This research extends the investigator's prior NSF supported work to develop theoretical and empirical understanding of the double bind faced by women of color in STEM fields. That is, their race and gender present dual dilemmas as they move through STEM educational and career paths. The proposed study will identify gaps in our understanding, and identify some of the methodological problems associated with answering outstanding questions about the double bind. The major research question is: What strategies work to enable women of color to achieve higher levels of advancement in STEM academia and professions? The goal is to bring a clearer understanding of the issues which confront women of color as they pursue study of science and engineering, and what factors influence whether they leave or remain in STEM.
The work will employ a highly structured narrative analysis process to identify and quantify factors that have been successful in broadening the participation of minority women in STEM. The research design involves two separate tracks of work: 1) to conduct narrative analysis of primary documents associated with women of color in science; and 2) to conduct site visits and interviews to understand features of programs associated with successful support of women of color in undergraduate and graduate education. The first part is designed to inform the second, with the narrative analysis helping to identify features to look for in site visits and to use in development of interview protocols.
This research will focus on individual and programmatic factors that sustain women of color as they confront barriers to their career goals. It examines institutional strategies and support structures that help women of color ultimately to succeed, and social and pedagogic elements that influence their educational experiences. Although women of color have made some progress over the last three decades towards more equitable participation in STEM fields, the major efforts made to address this issue have not produced the desired outcomes; minority women continue to be underrepresented relative to white women and non-minority men. The factors that account for continued lower participation rates are not yet fully understood.
Beyond the Double Bind is designed to transform the intellectual basis for building future programs that will better enable women of color to be successful in STEM. While focused on women of color, the results will ultimately inform strategies and programs to expand the presence of all women and minorities in STEM.
This workshop is funded through the "Dear Colleague Letter: Principles for the Design of Digital Science, Technology, Engineering, and Mathematics (STEM) Learning Environments (NSF 18-017)." In today's educational climate, organizations are creating physical learning spaces for hands-on STEM activities, often called makerspaces, co-working spaces, innovation labs, or fablabs. These spaces have evolved to be interdisciplinary centers that personalize learning for individual, diverse learners in collaborative settings. When designed well, these physical spaces create communities that contextualize learning around participants' goals and thus address STEM learning in a dynamic and integrated way. Participation in these learning environments encourages the cultivation of STEM identities for young people and can positively direct their career trajectories into STEM fields. This workshop will bring together a community of collaborators from multiple stakeholder groups including academia, public libraries, museums, community based organizations, non-profits, media makers and distribution channels, and educators within and beyond K-12 schools. Led by the University of Arizona, and held at Biosphere 2, an international research facility, participants will engage in activities that invite experimentation with distributed learning technologies to examine ways to adapt learning to the changing technological landscape and create robust, dynamic online learning environments. The workshop will culminate in a synthesis of design principles, assessment approaches, and tools that will be shared widely. Partnerships arising from the workshop will pave the way for sustained efforts in this area that span research and practice communities. Outcomes will address research and development of the next generation of digitally distributed learning environments.
The three day workshop convening will provide a unique forum to (1) exchange innovative ideas and share challenges and opportunities, (2) connect practical and research-based expertise and (3) form cross-institutional and cross-community partnerships that envision, propose, and implement opportunities for collecting and analyzing data to systematically inform the collective understanding. Participation-based activities will include design-based experiences, participatory activities, demonstrations of works in progress, prototyping, creative pitching, practitioner lightning talks, small group breakouts, hands-on design activities, and an 'unconference' style synthesis of bold ideas. Participants will be invited to experiment with distributed learning technologies. Five focus areas for the workshop include (1) inclusivity of learning spaces that invite multiple perspectives and full participation, (2) documenting learning in ways that are linked to outcomes and impacts for all learners, (3) implementing the use of new technologies in diverse settings, such as the workforce, (4) interpersonal interactions and peer-to-peer learning that may encourage a STEM career-path, and, (5) methods for collecting and analyzing data at the intersection of people, the learning environment, and new technologies at multiple levels. Outcomes of the workshop will serve to advance knowledge regarding critical gaps and opportunities and identify and characterize models of collaboration, networking, and innovation that operate within and across studio-based STEM learning environments.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.