In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
The ChemAttitudes project recieved supplemental funding to create materials for train-the-trainer workshops in order to inoculate the chemistry outreach community with members who have the knowledge and resources to train others on strategies for stimulating interest, sense of relevance, and feelings of self-efficacy that were tested in the earlier work of the project. The project team recruited participants from minority serving professional organizations as a strategy for broadening participation. Can it work? Did it work?
This poster was presented at the 2021 NSF AISL Awardee Meeting.
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
This project will draft a framework to guide citizen science projects in addressing issues of equity, diversity, and inclusion (EDI). Citizen science, sometimes called community science, involves volunteers who use science research procedures to collect valid scientific data for research projects and who often learn much about science in the process. These projects contribute directly to scientific research and often collect data of direct relevance to many communities. Although there are millions of citizen science volunteers, only a small proportion come from marginalized communities. The project will host a series of six, half-day virtual (online) workshops with scholars and practitioners with deep understanding of the participatory sciences and issues related to EDI. Workshop participants will discuss topics relevant to preparing a framework to provide guidance for integrating support EDI practices in citizen science. The project will disseminate the framework and workshop recommendations through publications for researchers and practitioners, a new website that will serve as a hub for relevant resources and EDI professional development, blogposts, and webinars.
This project will focus on EDI issues in institution-led, large-scale, citizen science projects. The project will organize workshops addressing issues relating to: (1) designing multipurpose projects that can be useful for empowering communities with data addressing community needs, providing researchers a large and robust data set, and providing learners with opportunities to develop a deeper understanding of research; (2) developing diverse leadership and engaging marginalized communities in framing research priorities; and (3) supporting strategies across citizen science projects to address barriers to participation, identity professional development needs, and create inclusive models that foster trust, create supportive networks, and build capacity for EDI in citizen science. The workshop will include approximately 20 participants, including researchers, project leaders and practitioners, with a majority of workshop participants belonging to groups underrepresented in science, such as Black, Hispanic, and Indigenous people.
Framing: Broadening participation and achieving equitable outcomes has been a core goal of the science museum field for over two decades. However, how to make progress has proven an intractable problem.
Methods: Focusing on five organizations who officially committed to diversity, equity, access, and inclusion (DEAI) by participating in a national professional development program, the researchers investigate how science museums attempt to enact internally-focused change via a mixed methods case study.
Findings: While these organizations considered a variety of structurally focused change
The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.