Inverness Research and Oregon State University, with support and input from CAISE, conducted an evaluation of the 2021 NSF AISL Awardee Meeting which was held virtually October 19-21, 2021. The evaluation effort included observing the meeting, participating in debriefing the meeting with CAISE co-PIs, the CAISE equity audit committee, and NSF Program Officers; developing and administering a post-event survey;1 and analyzing data collected through both the survey2 and Pathable, the virtual platform.
The meeting specifically focused on inviting and including community partners, and on
This white paper describes outcomes from a conference about using non-science art in science education. Art and science are often combined for entertainment, education (STEAM) and inspirational value. However, in almost all cases the art is science-themed (scientific visualizations, science-inspired art, art about scientific topics, etc.). This conference asks the question “what about art for arts-sake?”. That is, what is the impact of non-scientific art in science education? Can non-science themed art be used to broaden perspectives about science? Can it cue people to think about science more
The National Network for Ocean and Climate Change Interpretation [NNOCCI] is a Community of Practice [CoP] dedicated to advancing the conversation on climate change, based on the principle that wide-scale training with proven communication techniques can change the national discourse around climate change to be more productive, creative, and solutions-focused.
NNOCCI CoP is a network of individuals and organizations in formal and informal education, the social sciences, climate sciences, and public policy. By 2018, the community represented more than 184 institutions in 38 states, and over
In 2022, Kera Collective partnered with Made By Us to evaluate the impact of its flagship program, Civic Season, in its second year running. Held annually between Juneteenth and July 4th, Civic Season “rolls out the welcome mat” for Young People—the future inheritors of the United States—by connecting them to 150+ museums, historic sites, and historical societies and putting history in their hands as a tool for informed, inspired civic participation.
Our work, and Civic Season’s implementation, came at a time when the gap between Young People (age 18-30) and history organizations was huge
Supporting more equitable participation in science, technology, engineering, and mathematics (STEM) remains a key, persistent educational challenge. This paper employs a sociological Bourdieusian lens to explore how equitable youth outcomes might be supported through informal science learning (ISL). Drawing on multimodal, ethnographic data from four case study youth aged 11–14 from two ISL programs, we identify four areas of practice that were enacted to a greater or lesser extent in the programs in support of equitable youth outcomes. We identify how the equitable potential of these practices
Stark inequities evident in the low representation of Black women in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers persist despite considerable investment in the diversification of the education-to-workplace STEMM pipeline. College participation rates of Black women measure 4-5% of all degrees in biological and physical sciences, 2-3% of degrees in computer science and math, and roughly 1% in engineering. Ultimately, Black women make up only 2.5% of the workforce in STEMM-related fields, indicating that they chronically experience stalled professional advancement. Because there are so few longitudinal studies in either formal or informal settings, educators and researchers lack critical insights into why BA/BS credentialed Black women drop out of STEMM careers at high rates upon entering the workforce. This Research in Service to Practice project will conduct a longitudinal examination of key professional outcomes and life trajectories among adult Black women who enrolled Women in Natural Sciences (WINS), a 40-year-old out-of-school time (OST) high school STEM enrichment program. Prior research on WINS documents that alumnae outperform national averages on all metrics related to STEMM advancement up through college graduation. This study will test the hypothesis that such success continues for these cohorts as they pursue life goals and navigate the workforce. Findings from this study will promote the progress of science, pivotal to NSF’s mission as the project builds knowledge about supportive and frustrating factors for Black women in STEMM careers. Strategic impact lies in the novel participant-centered research methods that amplify Black women’s voices and increase both accuracy and equity in informal STEM learning research.
This research probes the experiences of Black women at a critical phase of their workforce participation when BS/BA credentialed WINS alumnae establish their careers (ages 26-46). The team will conduct a longitudinal comparative case study of outcomes and life trajectories among 20 years of WINS cohorts (1995-2015). Research questions include (1) What do the life-journey narratives of WINS alumnae in adulthood reveal about influential factors in the socio-cultural ecological systems of Black women in STEMM? (2) What are the long-term outcomes among WINS women regarding education, STEMM and other careers, socio-economic status, and STEMM self-efficacy and interest? How do these vary? (3) What salient program elements in WINS are highlighted in alumnae narratives as relevant to Black women’s experiences in adulthood? How do these associations vary? (4) How do selected outcomes (stated in RQ2) and life story narratives among non-enrolled applicants compare to program alumnae? and (5) How do salient components in the WINS program associate with socio-cultural factors in regard to Black women’s careers and other life goals? Participants include 100 Black WINS alumnae as an intervention group and a matched comparison group of 100 Black women who successfully applied to the WINS program but did not or could not enroll. Measurable life outcomes and life trajectory narratives with maps of experiences from both groups will be studied via a convergent mixed methods design inclusive of quantitative and qualitative analyses. Comparisons of outcomes and trajectories will be made between the study groups. Further, associations between alumnae’s long-term outcomes and how they correlate their WINS experiences with other socio-cultural factors in their lives will be identified. It is anticipated that findings will challenge extant knowledge and pinpoint the most effective characteristics of and appropriate measures for studying lasting impacts of OST STEMM programs for Black women and girls. The project is positioned to contribute substantially to national efforts to increase participation of Black women in STEMM.
DATE:
-
TEAM MEMBERS:
Ayana Allen-HandyJacqueline GenovesiLoni Tabb
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
Despite decades of policies and programs meant to increase the representation of girls and women in science, technology, engineering, and mathematics (STEM), girls and women of color still represent a much smaller percent of the STEM workforce than they do in the US population. This lack of representation is preventing the US STEM workforce from reaching its true potential. Intersecting inequalities of gender, race, ethnicity, and class, along with stereotypes associated with who is successful in STEM (i.e., White men), lead to perceptions that they do not belong and may not succeed in STEM. Ultimately, these issues hinder girls’ STEM identity development (i.e., sense of belonging and future success), lead to a crisis of representation for women of color and have compounding impacts on the STEM workforce. Research suggests there are positive impacts of in-person STEM learning after-school and out-of-school time programs on girls’ sense of belonging. The increasing need for online learning initiated by the COVID-19 pandemic means it is vital to investigate girls’ STEM identity development within an online community. Thus, the project will refine and test approaches in online learning communities to make a valuable impact on the STEM identity development of girls of color by 1) training educators and role models on exemplary approaches for STEM identity development; 2) implementing a collaborative, girl-focused Brite Online Learning Community that brings together 400 girls ages 13-16 from a minimum of 10 sites across the United States; and 3) researching the impact of the three core approaches -- community building, authentic and competence-demonstrating hands-on activities, and interactive learning with women role models -- on participating girls’ STEM identities in online settings.
The mixed methods study is guided by guided by Carlone & Johnson’s model of STEM identity involving four constructs: competence, performance, recognition, and sense of belonging. Data collection sources for the quantitative portion of the project include pre- and post-surveys, while qualitative data sources will be collected from six case study sites and will include observations, focus group interviews with girls, artifacts created by girls and educators, educator interviews, and open-ended survey responses. This approach will enable the research team to determine how and the extent to which the Brite Online Learning Community influences STEM identity constructs, interpreting which practices lead to meaningful outcomes that can be linked to the development of STEM identity for participating girls in an online environment. The products of this work will include research-based, tested Brite Practices and a toolkit for fostering girls’ interest, identification, and long-term participation in STEM. The resulting products will increase the reach of informal STEM education programming to girls of color across the nation as online spaces can reach more girls, potentially increasing the representation of women of color in the STEM workforce.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This project addresses the urgent need for the development of equitable approaches to early childhood STEM education that honor the diverse cultural practices through which caregivers (such as parents, grandparents, and other adults in children’s lives) support young children’s learning. Recent studies suggest that both formal and informal educational institutions often privilege Western or Eurocentric parenting practices, neglecting many families’ cultural practices and ways of learning. This study will bring together a group of caregivers, pre-K educators, researchers, and museum staff to investigate how families with young children negotiate among their own cultural practices and the types of STEM learning they encounter in museums, schools, and other community settings. The project team will work together to identify opportunities for informal STEM learning institutions to strengthen their roles as places that can bridge home and school environments and open up new possibilities for building on caregivers’ knowledge and cultural practices within this larger community context. The project will directly benefit the 330 families whose children attend the partnering public school each year, as well as hundreds of families who attend family events at the New York Hall of Science annually. Finally, by considering nuances in caregivers’ perspectives and experiences based on multiple facets of their identities, the research will reveal how structures in educational settings might be changed to become more inclusive and culturally responsive for the broadest possible audience of families.
This Pilots and Feasibility project seeks to 1) conduct exploratory research to understand caregiver engagement, defined as caregivers’ expectations, values, and practices related to their roles in children’s learning, from the perspectives of caregivers, and 2) engage in co-design efforts with caregivers and pre-K educators to explore how the museum can be leveraged as a material and creative resource to support caregiver engagement in STEM learning. This work will be carried out in the context of a long-term partnership between the New York Hall of Science and the New York City Department of Education. Methods will include in-depth interviews with caregivers, using narrative and intersectional research methods to extend existing studies on caregiver engagement in informal STEM learning, while taking into account multiple aspects of families’ social and cultural identities. This work will be carried out in Corona — a neighborhood in Queens, NY, largely made up of low-income and first-generation immigrant families. The project team will collaboratively interpret findings and engage in the initial phases of co-design work, which will include: reflecting on the systems currently in place to support caregivers’ involvement in children’s learning across settings; collaboratively generating new, culturally responsive strategies for leveraging the museum as a material and creative resource for families with young children; and choosing promising directions for further development and testing. Products from this work will include directions for new caregiver engagement initiatives that can be developed and refined as the partnership continues, and strategies for supporting equitable participation by caregivers, pre-K educators, and other community stakeholders in future research-practice partnerships.