Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey; and analyzing data collected through both the survey and Pathable, the virtual platform.
This report summarizes the key evaluation findings. It includes the following sections:
This 4-year project addresses fundamental equity issues in informal Science, Technology, Engineering and Mathematics (STEM) learning. Access to, and opportunities within informal STEM learning (ISL) remain limited for youth from historically underrepresented backgrounds in both the United States and the United Kingdom. However, there is evidence that ISL experiences can expand opportunities for youth learning and development in STEM, for instance, increase positive attitudes towards educational aspirations and future careers/pursuits, improve grades and test scores in school settings, and decrease disciplinary action and dropout rates. Through research and development, this project brings together researchers and practitioners to focus on the experiences, practices and tools that will support equitable youth pathways into STEM. Working across conceptual frameworks and ISL settings (e.g. science centers, community groups, zoos) and universities in four urban contexts in two different nations, the partnership will produce a coherent knowledge base that strengthens and expands research plus practice partnerships, builds capacity towards transformative research and development, and develops new models and tools in support of equitable pathways into STEM at a global level. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This Equity Pathways project responds to three challenges at the intersections of ISL research and practice in the United States and the United Kingdom: 1) lack of shared understanding of how youth from historically underrepresented backgrounds perceive and experience ISL opportunities across national contexts, and the practices and tools needed to support empowered movement through ISL; 2) limited shared understanding and evidence of core high-leverage practices that support such youth in progressing within and across ISL, and 3) limited understanding of how ISL might be equitable and transformative for such youth seeking to develop their own pathways into STEM. The major goal of this Partnership is for practitioners and researchers, working with youth through design-based implementation research, survey and critical ethnography, to develop new understandings of how and under what conditions they participate in ISL over time and across settings, and how they may connect these experiences towards pathways into STEM. The project will result in: 1) New understandings of ISL pathways that are equitable and transformative for youth from historically underrepresented backgrounds; 2) A set of high leverage practices and tools that support equitable and transformative informal science learning pathways (and the agency youth need to make their way through them); and 3) Strengthened and increased professional capacity to broaden participation among youth from historically underrepresented backgrounds in STEM through informal science learning. The project will be carried out by research + practice partnerships in 4 cities: London & Bristol, UK and Lansing, MI & Portland, OR, US, involving university researchers (University College London, Michigan State University, Oregon State University/Institute for Learning Innovation) practitioners in science museums (@Bristol Science Centre, Brent Lodge Park Animal Centre, Impressions 5, Oregon Museum of Science & Industry) and community-based centers (STEMettes, Knowle West Media Centre, Boys & Girls Clubs of Lansing, and Girls, Inc. of the Pacific Northwest).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. There are few empirical studies of sustained youth engagement in STEM-oriented making over time, how youth are supported in working towards more robust STEM related projects, on the outcomes of such making experiences among youth from historically marginalized communities, or on the design features of making experiences which support these goals. The project plans to conduct a set of research studies to develop: a theory-based and data-driven framework for equitably consequential making; a set of related individual-level and program-level cases with exemplars (and the associated challenges) that can be used by researchers and practitioners for guiding the field; and an initial set of guiding principles (with indicators) for identifying equitably consequential making in practice. The project will result in a framework for equitably consequential making with guiding principles for implementation that will contribute to the infrastructure for fostering increased opportunities to learn among all youth, especially those historically underrepresented in STEM.
Through research, the project seeks to build capacity among STEM-oriented maker practitioners, researchers and youth in the maker movement around equitably consequential making to expand the prevailing norms of making towards more transformative outcomes for youth. Project research will be guided by several questions. What do youth learn and do (in-the-moment and over time) in making spaces that work to support equity in making? What maker space design features support (or work against) youth in making in equitably consequential ways? What are the individual and community outcomes youth experience in STEM-making across settings and time scales? What are the most salient indicators of equitably consequential making, how do they take shape, how can these indicators be identified in practice? The project will research these questions using interview studies and critical longitudinal ethnography with embedded youth participatory case study methodologies. The research will be conducted in research-practice partnerships involving Michigan State University, the University of North Carolina at Greensboro and 4 local, STEM- and youth-oriented making spaces in Lansing and Greensboro that serve historically underrepresented groups in STEM, with a specific focus on youth from lower-income and African American backgrounds.
Trauma infiltrates all of society – including museums. For guests, the trauma may lie in the context of the visit or what they bring with them from their everyday lives. Staff can develop trauma through daily interaction with stressful content or secondary trauma through interaction with traumatized guests. During the COVID19 pandemic, trauma also developed from workplace issues regarding personal health safety and job security. This is a case study about how one museum educated itself about the presence and impact of trauma through exploration of a framework developed by the Trauma Responsive
DATE:
TEAM MEMBERS:
Aaron PriceLeila MakdisiGail HutchinsonDaniel LancasterMicere Keels
This is the third of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on steps for conducting media research and research protocals.
This is the second of three guides for media practitioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on ways to identify your missing audience.
This is the first of three guides for media practioners, evaluators and researchers about some of what was learned through the project Cracking the Code: Influencing Millennial Science Engagement. This guide focuses on possible practices for creating an audience research collaboration for media professionals, evaluators and communication researchers.
Across literature on STEM practice and STEM education, definitions of "imagination" vary in a number of ways. The visual tool below presents a way to organize the characteristics of these definitions along three dimensions: essence, ways of thinking, and context. Using this framework, you can build definitions of imagination relevant to your work.
This pilot and feasibility project will explore whether participation in informal science initiatives like citizen science, which is a form of Public Participation in Scientific Research, can foster or enhance participant attachment to the natural places participants investigate via these programs. The project also examines if participant attachment to place influences the development or application of critical thinking skills among adult learners. Critical thinking skills and the factors that enhance critical thinking skills are important areas of inquiry within the informal STEM learning community. Existing scholarship suggests that three components may be linked: (1) feelings of connection to specific places, (2) intentional exploration and investigation of those places (in this case via citizen science), and (3) understanding of complex socio-ecological systems, which is predicated on critical thinking skills ability. However, the degree to which these aspects are related to each other, the scale at which they occur (local to global), and the specific dimensions of place connection or informal science experiences implicated is not known. Working with the Coastal Observation and Seabird Survey Team (COASST) citizen science program, this project advances collaboration among experts from disparate fields to examine if and how citizen science contributes to increases in connection to place and higher-order critical thinking skills among participants and the potential links between those hypothesized outcomes. The ultimate goal of the project is to inform design of Public Participation in Scientific Research programming that optimizes participant learning, interest, and retention; produces societal outcomes like critical thinking in support of science literacy; and creates high quality data of the scale and grain needed to address questions and issues across the basic-applied science continuum.
This research focuses on the degree to which Public Participation in Scientific Research, specifically citizen science, may foster the presence or intensity of place attachment felt by participants for the sites and settings investigated through these programs and to what extent place attachment may be linked to higher order critical thinking skills among adult learners. A three-pronged mixed-methods research strategy will include: (1) a re-analysis of existing survey and interview data for markers of three-dimensional (personal, social, natural) place attachment as well as critical thinking skills and dispositions; (2) an assessment survey to test for the presence and intensity of place attachment and critical thinking skills; and (3) in-depth interviews to better understand the qualitative nature and development of place attachment and critical thinking skills in a citizen science context. The survey and interview sample will be drawn from participants in the COASST citizen science program and will be stratified into four groups as a function of time engaged in the program, including new, novice, and long-term participants. An independent external advisory board and a committee of visitors comprised of experts in informal science, education, and sense of place will critique and help guide this work. Results are expected to reveal important factors that impact the learning and behavioral outcomes of informal STEM initiatives by probing questions about the essential experiences, exposures, and COASST program components that facilitate deeper critical thinking skills and place attachment. Synthesizing theoretical frameworks from the fields of geography, science education, and educational psychology while testing a unique methodological approach to best measure critical thinking skills and place attachment in an informal citizen science setting will enhance knowledge-building among research and practitioner communities.
In a globalized and increasingly technologically complex world, the ability of citizens to interrogate and interpret scientific evidence, views, and values is critical. That is, scientific literacy is essential for the maintenance of robust and healthy economic, social, and environmental systems in the twenty-first century. Informal science learning fills an important gap in national educational efforts to cultivate a scientifically literate populace as research suggests that formal science training is not always capable of fostering the type of higher order critical thinking skills that undergird such scientific competency. This project aims to strengthen infrastructure and build capacity among informal science practitioners by clarifying whether specific aspects and forms of Public Participation in Scientific Research, especially those relating to people-place connections, are implicated in the development and/or application of critical thinking skills in STEM settings. This effort may expand opportunities to strengthen informal science learning program outcomes, including the cultivation of numerous 21st century skills like information literacy and social skills like conflict management. Through a greater understanding of the individual components that shape informal learning experiences and outcomes, this project also has the potential to support the broadening of participation in STEM fields by providing the groundwork for further research on whether or not underrepresented or traditionally marginalized groups of people experience and/or relate differently to both the "places" most common in citizen science and the practice of informal science programming itself.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
It has been well documented that under-resourced Latinx communities face persistent barriers to accessing quality STEM education and STEM careers, particularly in the field of engineering. For young children and their families from these communities, the development of executive function skills offers promising pathways to support educational success and prepare children to engage with STEM practices and content. Executive function skills, such as focusing attention, retaining information, and managing emotions are critical for children’s development and long-term success, and have been identified as central to engagement with STEM practices and content, whether in or out of school. However, much of the work on development of executive function skills to date has been conducted with White, middle-class children and has largely ignored the knowledge, values, or perspectives of other communities, including Latinx families. Similar gaps also exist in attention to culturally responsive approaches to using family-based STEM activities to support executive function skills. Taken together, there is a critical need to work with Latinx communities to re-imagine the intersection of STEM learning and executive function skills using equity-based frameworks. This Pilot and Feasibility project will develop and test a new participatory, dialogic method that leverages informal family engineering activities to support the development of executive function skills for preschool-age children from Latinx families. The combination of this proposal’s unique engagement of parents as research partners with the study of engineering and executive functions could lay the foundation for a promising program of future equity-focused research.
Three research questions will guide the study: 1) What knowledge, assets, and practices already exist within Latinx families related to these executive function skills? 2) What aspects of executive function skills can be supported through informal family engineering activities? and 3) What are promising design strategies for adapting informal family engineering activities to highlight family assets and support executive function skills for young children? To address these questions, the project team will engage Latinx parents in a dialogue series in which parents are central collaborators, sharing their in-depth perspectives and partnering with researchers to develop conceptual frameworks and new approaches. Data generated through these ongoing discussions will be analyzed using (a) qualitative, participatory approaches, including iterative co-development and refinement of emergent themes with parents, (b) detailed inductive coding of parent dialogue group discussions using grounded theory techniques, and (c) retrospective analysis at the end of the project. The parent dialogue series will be supported by a systematic literature review examining the intersections between engineering design, executive function, and the strengths and assets within Latinx families. The results of the exploratory research will include a (1) conceptual framework co-developed with parents that highlights promising opportunities and design strategies for using family engineering design activities to support executive function skills for preschool-age children from Latinx families and (2) research agenda outlining questions and priorities for future work that reflect the goals and interests of this community. Aligned with project’s equity approach, the team will work collaboratively with project partners and families for dissemination, focusing on amplifying community voices, sharing challenges and successes, and supporting improvements in the local community. Results will also be broadly shared with educators and researchers to advance knowledge and promote new equitable approaches to collaborating with parents from Latinx communities.
This Pilots and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
This project will draft a framework to guide citizen science projects in addressing issues of equity, diversity, and inclusion (EDI). Citizen science, sometimes called community science, involves volunteers who use science research procedures to collect valid scientific data for research projects and who often learn much about science in the process. These projects contribute directly to scientific research and often collect data of direct relevance to many communities. Although there are millions of citizen science volunteers, only a small proportion come from marginalized communities. The project will host a series of six, half-day virtual (online) workshops with scholars and practitioners with deep understanding of the participatory sciences and issues related to EDI. Workshop participants will discuss topics relevant to preparing a framework to provide guidance for integrating support EDI practices in citizen science. The project will disseminate the framework and workshop recommendations through publications for researchers and practitioners, a new website that will serve as a hub for relevant resources and EDI professional development, blogposts, and webinars.
This project will focus on EDI issues in institution-led, large-scale, citizen science projects. The project will organize workshops addressing issues relating to: (1) designing multipurpose projects that can be useful for empowering communities with data addressing community needs, providing researchers a large and robust data set, and providing learners with opportunities to develop a deeper understanding of research; (2) developing diverse leadership and engaging marginalized communities in framing research priorities; and (3) supporting strategies across citizen science projects to address barriers to participation, identity professional development needs, and create inclusive models that foster trust, create supportive networks, and build capacity for EDI in citizen science. The workshop will include approximately 20 participants, including researchers, project leaders and practitioners, with a majority of workshop participants belonging to groups underrepresented in science, such as Black, Hispanic, and Indigenous people.
Maker education has increased tremendously in community settings and classrooms across the country. Maker education is learner-driven and hands-on, often collaborative, and may focus on solving a problem or designing an object or device. There is a growing need for assessment and evaluation tools and approaches to understand and improve the nature of maker learning and provide evidence for the value of maker pedagogy. This workshop will bring together approximately 25 researchers from formal and informal settings as well as practitioners to review current maker assessment and evaluation tools and examine the role those tools can play for informing research and practice. The workshop will identify areas where future work is needed, including designing assessment and evaluation that effectively addresses the interests and needs of diverse learners. The workshop will disseminate an online collection of these assessment and evaluation tools, a research brief, and several webinars sharing the results and recommendations of the conference.
The two-day, in-person conference will include pre-workshop surveys to determine and refine issues for consideration at the conference, identify a core set of readings and resources for conference participants, and to identify key topics for research briefings presented at the conference. The conference will include background briefings, hands-on try-outs of assessment tools, synthesis discussions, and identification of future directions for research and next steps. Resources developed from the workshop will be widely disseminated through workshop partner Maker Education’s website, an annual maker conference held at the University of Wisconsin, and through other publications reaching researchers and practitioners in informal and formal educational settings,
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.