The Joseph Moore Museum at Earlham College will revise its interpreter training and educational programs to reflect current best practices in participatory STEM education. This project will include strengthening their programs to better prepare undergraduate educators, as well as updating the delivery of their top three requested programs to ensure learner-centered experiences. The project will include the development of a training program modeled on a combination of principles set out by the National Association of Interpretation and the Reflections on Practice program. Undergraduate educators will undergo systematic training in the fundamentals of educational theory and practice and benefit from a program of sustained evaluation and mentorship.
The Hollister Herbarium at Tennessee Tech University will implement “Rooting Students in their Botanical History” — an educational module targeted for 11th and 12th grade biology students. The module will address “plant blindness,” a phenomenon defined as the failure to notice or appreciate plants. The herbarium will collaborate with three Tennessee high school biology teachers, a videographer, and a graduate research assistant to increase knowledge, awareness, and appreciation of plants over the three-year project. Students also will get to know herbarium specimens as an essential resource for information about the natural world.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The Arizona-Sonora Desert Museum will partner with the Flowing Wells Unified School District on “We Bee Scientists,” a program to engage students in grades K–6 in real-world science by learning about bees—the most important group of pollinators. They plan to create a curriculum and related activities aligned with the Arizona science standards. The program is an expansion of the Tucson Bee Collaborative, which empowers community scientists from “K to grey” to contribute to ecosystem health and understanding through the study of native bees. The museum also will partner with Pima Community College and the University of Arizona on the program, which will involve volunteers and high school, college, and university students in documenting the abundance and diversity of native bees.
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This Innovations in Development project explores radical healing as an approach to create after-school STEM programming that welcomes, values and supports African American youth to form positive STEM identities. Radical healing is a strength-based, asset centered approach that incorporates culture, identity, civic action, and collective healing to build the capacity of young people to apply academic knowledge for the good of their communities. The project uses a newly developed graphic novel as a model of what it looks like to engage in the radical healing process and use STEM technology for social justice. This graphic novel, When Spiderwebs Unite, tells the true story of an African American community who used STEM technology to advocate for clean air and water for their community. Youth are supported to consider their own experiences and emotions in their sociopolitical contexts, realize they are not alone, and collaborate with their community members to take critical action towards social change through STEM. The STEM Club activities include mentoring by African American undergraduate students, story writing, conducting justice-oriented environmental sciences investigations, and applying the results of their investigations to propose and implement community action plans. These activities aim to build youth’s capacity to resist oppression and leverage the power of STEM technology for their benefit and that of their communities.
Clemson University, in partnership with the Urban League of the Upstate, engages 100 predominantly African American middle school students and 32 African American undergraduate students in healing justice work, across two youth-serving, community-based organizations at three sites. These young people assume a leadership role in developing this project’s graphic novel and curriculum for a yearlong, after-school STEM Club, both constructed upon the essential components of radical healing. This project uses a qual→quant parallel research design to investigate how the development and use of a graphic novel could be used as a healing justice tool, and how various components of radical healing (critical consciousness, cultural authenticity, self knowledge, radical hope, emotional and social support, and strength and resilience) affect African American youths’ STEM identity development. Researchers scrutinize interviews, field observations, and project documents to address their investigation and utilize statistical analyses of survey data to inform and triangulate the qualitative data findings. Thus, qualitative and quantitative data are used to challenge dominant narratives regarding African American youth’s STEM achievements and trajectories. The project advances discovery and understanding of radical healing as an approach to explicitly value African Americans’ cultures, identities, histories, and voices within informal STEM programming.
DATE:
-
TEAM MEMBERS:
Renee LyonsRhondda ThomasCorliss Outley
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
Presentation slides and narration for the NARST 2022 Annual Conference. In this presentation we summarize findings from our interviewed with undergraduate STEM majors who identify as Latine, homing in on the ways in which they characterize "STEM" and "STEM people" and their descriptions of K-12 experiences that contributed to their characterizations of these concepts.
This project addresses a longstanding problem in informal science education: how to increase the likelihood of consequential science, technology, engineering, and mathematics (STEM) learning from short duration experiences such as field trips. Although informal learning experiences can greatly contribute to interest in and knowledge of science, there is a shared concern among educators and researchers that students may have difficulty recalling and using scientific information and practices emphasized during these experiences, even though doing so would further their science learning. Nonetheless, science learning is rarely, if ever, a "one-shot deal." Children acquire knowledge about science cumulatively across different contexts and activities. Therefore, it is important that informal science learning institutions identify effective practices that support the consolidation of learning and memory from exhibit experiences to foster portable, usable knowledge across contexts, such as from informal science learning institutions, to classrooms, and homes. To this end, this Research in Service to Practice project seeks to harness the power and potential of visual representations (e.g., graphs, drawings, charts, maps, etc.) for enhancing learning and encouraging effective reflection during and after science learning experiences. The project promises to increase learning for the 9,000+ 5th and 6th grade students from across the rurality and growing diversity of the state of Maine who annually participate in LabVenture, a 2.5-hour exploration of the Gulf of Maine ecosystem at Gulf of Maine Research Institute. The research will provide new and actionable informal science learning practices that promote engagement with visual representations and reflection, and science understandings that can be applied broadly by informal science institutions. This project is funded by the Advancing Informal STEM Learning (AISL) and the Discovery Research PreK-12 (DRK-12) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the DRK-12 program goal of enhancing the learning and teaching of STEM by preK-12 students and teachers.
The project is grounded in the idea that visual representations, including drawings, can both enhance science learning and encourage reflection on doing science that can support extension of that learning beyond a singular informal science experience. The project uses design-based research to address the following research questions: (1) Does reflection during an informal science learning experience promote students’ retention and subsequent use of science information and practices that are part of the experience? (2) Does interpreting and constructing visual representations, such as drawings, improve students’ understanding and retention of information, and if so, how and when? and (3) Does combining visual representations and narrative reflections confer benefits on students’ science learning and engagement in science practices both during the informal learning experience, and later in their classrooms and at home? These questions will be pursued in collaboration with practitioners (both informal educators and classroom teachers) and a diverse team of graduate and undergraduate student researchers. Approximately 600 student groups (roughly 3000 individual students) will be observed during the LabVenture experience, with further data collection involving a portion of these students at school and at home. The project will yield resources and video demonstrations of field-tested, empirically based practices that promote engagement with visual representations and reflection, and science understandings that can travel within students' learning ecosystem. In support of broadening participation, the undergraduate/graduate student researchers will gain wide understanding and experience connecting research to practice and communicating science to academic and nonacademic audiences.
The call for more science, technology, engineering, and mathematics (STEM) education taking place in informal settings has the potential to shape future generations, drive new innovations and expand opportunities. Yet, its power remains to be fully realized in many communities of color. However, research has shown that using creative embodied activities to explore science phenomena is a promising approach to supporting understanding and engagement, particularly for youth who have experienced marginalization. Prior pilot work by the principal investigator found that authentic inquiries into science through embodied learning approaches can provide rich opportunities for sense-making through kinesthetic experience, embodied imagining, and the representation of physics concepts for Black and Latinx teens when learning approaches focused on dance and dance-making. This Research in Service to Practice project builds on prior work to better understand the unique opportunities for learning, engagement, and identity development for these youth when physics is explored in the context of the Embodied Physics Learning Lab Model. The model is conceptualized as a set of components that (1) allow youth to experience and utilize their intersectional identities; (2) impact engagement with physics ideas, concepts and phenomena; and (3) lead to the development of physics knowledge and other skills. The project aims to contribute to more expansive definitions of physics and physics learning in informal spaces. While the study focuses primarily on Black and Latinx youth, the methods and discoveries have the potential to impact the teaching of physics for a much broader audience including middle- and high-school children, adults who may have been turned off to physics at an earlier age, and undergraduate physical science majors who are struggling with difficult concepts. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The research is grounded in sociocultural perspectives on learning and identity, embodied interaction and enactive cognition, and responsive design. The design is also informed by the notion of “ArtScience” which highlights commonalities between the thinking and making practices used by artists and by scientists and builds on the theoretical philosophy that all things can be understood through art or through science but integrating the two lenses allows for more complete understandings. Research will investigate the relationship between embodied learning approaches, design principles, and structures of the Embodied Physics Learning Lab model using the lenses of physics, dance, and integrated ArtScience to better understand the model. The project employs design-based research to address two overarching research questions: (1) What unique opportunities for learning, engagement, and identity development for Black and Latinx youth occur when physics is explored in the context of the Embodied Physics Learning Lab Model? and (2) How do variations in site demographics and site implementation influence the impact and scalability of the Learning Lab model? Further, the inquiry will consider (a) how youth experience and utilize their intersectional various identities in the context of the activities, structures, and essential elements of the embodied physics learning lab; (b) how youth's level of physics engagement changes depending on which embodied learning approaches and essential element structures are used; (c) the physics knowledge and other skills youth attain through the set of activities; and (d) how, if at all, the embodied learning approaches engage youth in thinking about their own agency as STEM doers. An interdisciplinary team of researchers, choreographers, and youth along with community organizations will co-design and implement project activities across four sites. Approximately 200 high school youth will be engaged; 24 will have the role of Teen Thought Partner. Through three iterative design cycles of implementation, the project will refine the model to investigate which elements most affect successful implementation and to identify the conditions necessary for scale-up. Data will be collected in the form of video, field notes, pre- and post- interviews, pre- and post- surveys, and artifacts created by the youth. Analyses will include a combination of interaction analysis, descriptive data analysis, and movement analysis. In addition to the research findings and explication of the affordances and constraints of the model, the project will also create a curricular resource, including narrative text and video demonstrations of physics concepts led by the teen thought partners, video case training modules, and assessment tools.
DATE:
-
TEAM MEMBERS:
Folashade Cromwell SolomonDionne Champion
This Innovations in Development project aims to foster the development of STEM identity among a diverse group of middle school students and, in turn, motivate them to pursue in STEM interests and careers. Vegas STEM Lab, led by a team of investigators from the University of Nevada, Las Vegas, will employ a mix of online and on-site activities to introduce students to engineering methods in the context of the entertainment and hospitality (E&H) industry that is the lifeblood of Las Vegas. Investigators will collaborate with local resorts, multimedia designers, and arts institutions to offer field experiences for students to interview, interact with, and learn from local experts. The Lab will help youth overcome prevailing beliefs of STEM as boring and difficult, boost their confidence as STEM-capable individuals, and expose them to the exciting STEM careers available in their hometown. UNLV engineering undergrads will serve as near-peer mentors to the middle school students, guiding them through Lab activities and acting as role models. Investigators will measure student learning and engagement over the course of the Vegas STEM Lab experience with the aim of understanding how the Lab model—with its rich set of activities and interpersonal interactions set in the local E&H industry—can cultivate STEM identity development and encourage students to pursue STEM pathways. Despite the project’s hyperlocal focus on the Las Vegas community, if successful, other cities and towns may learn from and adapt the Lab model for use in their youth development programs.
Vegas STEM Lab will provide online materials for students’ STEM learning during the academic year followed by on-site visits and hands-on project development during a three-week summer experience. The Lab will run for three years with cohorts of 40 students each (N=120) with the aim of iteratively improving its activities and outcomes from year to year. The local school district will help recruit middle school students who have demonstrated low interest in STEM to participate in the Lab, ensuring that participants reflect the demographic makeup of the Las Vegas community in terms of race and ethnicity, socio-economic status, and gender. Summer activities will take students behind the scenes of the city’s major E&H venues; investigate the workings of large-scale displays, light shows, and “smart hospitality” systems; and then build their own smaller scale engineering projects. Investigators will employ the Dynamic Systems Model of Role Identity (DSMRI) framework to study how intentionally designed Lab experiences shape students’ understanding of themselves, their future aspirations, and their grasp of the scientific enterprise. Summer activities will be integrated into the online learning platform at the end of each year of Vegas STEM Lab, and in the final year of the project, workshops will train local educators to use the platform in either formal or informal learning settings. Materials and research findings produced through this work will be disseminated to middle school teachers and afterschool care providers, and shared with researchers through academic publications and conferences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Emma RegentovaVenkatesan MuthukumarJonathan HilpertSi Jung Kim