In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Presentation slides and narration for the NARST 2022 Annual Conference. In this presentation we summarize findings from our interviewed with undergraduate STEM majors who identify as Latine, homing in on the ways in which they characterize "STEM" and "STEM people" and their descriptions of K-12 experiences that contributed to their characterizations of these concepts.
Awareness of a STEM discipline is a complex construct to operationalize; a learner’s awareness of a discipline is sometimes viewed through the lens of personal identity, use of relevant discourse, or knowledge of career pathways. This research proposes defining engineering awareness through a learner’s associations with engineering practices - fundamental processes involved in engineering such as identifying criteria and constraints, testing designs, diagnosing issues and assessing goal completion. In this study, a learner’s engineering awareness was determined by examining 1) their ability to
This front-end evaluation study is part of Designing Our Tomorrow: Mobilizing the Next Generation of Engineers, a five-year project (2018–2023) led by the Oregon Museum of Science and Industry (OMSI) with the support of the National Science Foundation (NSF, DRL-1811617) and project partners: Adelante Mujeres, the Biomimicry Institute, and the Fleet Science Center. The Designing Our Tomorrow (DOT) project seeks to promote and strengthen family engagement and engineering learning via compelling exhibit-based design challenges, presented through the lens of sustainable design exemplified by
Background. STEM identity has emerged as an important research topic and a predictor of how youth engage with STEM inside and outside of school. Although there is a growing body of literature in this area, less work has been done specific to engineering, especially in out-of-school learning contexts.
Methods. To address this need, we conducted a qualitative investigation of five adolescent youth participating in a four-month afterschool engineering program. The study focused on how participants negotiated engineering-related identities through ongoing interactions with activities, peers
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
The goal for this research study was to determine the role of the SciGirls gender-equitable strategies on participating youths’ STEM identity changes in 16 participating SciGirls’ programs across the nation. The definition of STEM identity was based on Eccles (2007), Carlone and Johnson (2007) and Calabrese Barton and colleagues (2013). According to these researchers, individuals must have a positive STEM identity in order to persist in STEM careers. This positive STEM identity is affected by an individual’s expectations of success in STEM and the value they see in STEM and STEM careers
Knight Williams, Inc. completed a summative evaluation report that addresses: (i) the reach and breadth of the Latina SciGirls broadcast program and online components compared to project expectations; (ii) the impact of the Family Fiesta events that incorporated use of SciGirls videos, in-person role models, and hands-on activities as experienced by the girls, family members, and role models that participated in the events; and (iii) the partners’ Latina SciGirls programs and how they used and reflected on the value of the SciGirls resources.
This three-year research and implementation project empowers middle school LatinX youth to employ their own assets and funds of knowledge to solve community problems through engineering. Only 7% of adults in the STEM job cluster are of Hispanic/Latino origin. There is a continuing need for filling engineering jobs in our current and future economy. This project will significantly broaden participation of LatinX youth in engineering activities at a critical point as they make career decisions. Design Squad Global LatinX expands on a tested model previously funded by NSF and shown to be successful. It will enable LatinX youth to view themselves as designers and engineers and to build from their strengths to expand their skills and participation in science and engineering. The project goals are to: 1) develop an innovative inclusive approach to informal engineering education for LatinX students that can broaden their engineering participation and that of other underrepresented groups, (2) to galvanize collaborations across diverse local, national, and international stakeholders to create a STEM learning ecosystem and (3) to advance knowledge about a STEM pedagogy that bridges personal-cultural identity and experience with engineering knowledge and skills. Project deliverables include a conceptual framework for a strength-based approach to engineering education for LatinX youth, a program model that is asset based, a collection of educational resources including a club guide for how to scaffold culturally responsive engineering challenge activities, an online training course for club leaders, and a mentoring strategy for university engineering students working with middle school youth. Project partners include the global education organization, iEARN, the Society of Women Engineers, and various University engineering programs.
The research study will employ an experimental study design to evaluate the impact on youth participating in the Design Squad LatinX programs. The key research questions are (1) Does participation increase students' positive perceptions of themselves and understanding of engineering and global perspectives? (2) To what extent do changes in understanding engineering vary by community (site) and by student characteristics (age, gender, ethnicity)? (3) Do educators and club leaders increase their positive perceptions of youths' funds of knowledge and their own understanding of engineering? and (4) Do university mentors increase their ability to lead informal engineering/STEM education with middle school youth? A sample from 72 local Design Squad LatinX clubs with an enrollment of 10-15 students will be drawn with half randomly assigned to the participant condition and half to the control condition. Methods used include pre and post surveys, implementation logs for checks on program implementation, site visits to carry out observations, focus groups with students and interviews with adult leaders. Data will be analyzed by estimating hierarchical linear models with observations. In addition, in-situ ethnographically-oriented observations as well as interviews at two sites will be used to develop qualitative case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
Libraries can provide unique opportunities for rural youth and communities. Phase III of the STAR Library Network will be a collaboration with 12 rural school districts in largely Latinx communities to address the challenges faced by rural youth, particularly English Language Learners. The project will use a coordinated and tested strategy to establish three learning pathways in public libraries: science learning spaces with exhibits, library programs, and science kits. These resources will provide learners with art-rich STEM learning opportunities.
Partners
Project partners include the Space Science Institute, the American Library Association (ALA), the Institute for Learning Innovation, and Twin Cities Public Television. The project will rely significantly on expertise from the Latinx community.
Project Plan
Building on an established librarian training model, the project will introduce library staff to the STEAM content and guide them in developing their own STEAM Learning Pathways. The project will draw on existing professional infrastructure from the ALA and the Institute for Learning Innovation’s established community of practice. SciGirls digital media, hands-on activities, family resources, and a training network will expand the depth and reach of the project.
The Research
The research team will study the efficacy of each pathway, alone and in tandem, on participant’s interest development and persistence. The research will use a mixed-methods design-based approach that involves questionnaires, interviews, and case studies. The results should yield a model for nationwide application and contribute insights for the formal education sector.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.