In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Since 2006, the National High Magnetic Field Laboratory (MagLab) through the Center for Integrating Research and Learning (CIRL) has offered a SciGirls Summer Camp to introduce middle school girls to various fields of science. Code: SciGirls was created in 2017 to increase the engagement in computer science studies and career paths for girls. This consistent commitment to girls in STEM led the SciGirls creators at Twin Cities Public Television (TPT) to invite CIRL to be a partner with them. In the summer of 2021, CIRL & TPT
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
DATE:
TEAM MEMBERS:
Ross Higashi
resourceresearchProfessional Development, Conferences, and Networks
This poster was presented at the 2021 National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) Awardee Meeting.
The goal of this two-year project is to examine systemic issues within learning spaces and provide educators with anti-racist approaches that validate and uplift Black learners. Through a combination of media, educator and role model professional development, and intentional outreach, Black SciGirls will create more gender-equitable and anti-racist informal STEM learning environments for Black girls.
DATE:
TEAM MEMBERS:
Rita KarlAdrienne StephensonLataisia JonesRonda Taylor BullockAngel Miles NashJohnavae Campbell
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.
The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Rita KarlAngel Miles NashRonda BullockAdrienne StephensonLataisia Jones
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Research shows that Black girls and women, regardless of their academic achievements and STEM interests, often encounter academic under-preparation, social isolation, exclusion, and race-gender discrimination that negatively impacts their ongoing engagement and retention in STEM. This project will provide innovative, culturally relevant learning environments to middle and high school Black girls to counter these negative trends. Using hands-on coding and robotics activities, project participants will develop positive attitudes toward science, technology, engineering, and mathematics (STEM). The project emphasizes peer-mentoring by providing opportunities for Black female high school (assistant coaches) and Black college students (coaches) to serve as counselors and mentors to participants. Additionally, engineers, scientists, and executives from STEM industries will serve as mentors and share their experiences to broaden participants’ STEM career aspirations. The project is a three-year collaborative effort between the University of California Davis C-STEM Center, the Umoja Community Education Foundation, and the 66 affiliated California community colleges, industry partners, and school districts in California. Over three years, nearly 2,000 females will participate in the project.
Learning environments for Black girls and women led by other Black girls and women are referred to as “counterspaces” where they are free to engage in STEM in ways that value their identities while promoting STEM engagement, interests, and career aspirations. The project’s curriculum will follow a research-based, culturally relevant multi-tiered mentoring approach. The curriculum is designed to develop participants’ STEM content knowledge, critical thinking, and logical reasoning capabilities through meaningful connections to real-life applications using hands-on coding and robotics. A mixed-method longitudinal study will examine the impact on participants’ STEM outcomes, emphasizing contributing new knowledge on the viability of multi-tiered, culturally relevant mentoring for increasing equity in informal STEM learning (ISL). The program's effectiveness will be evaluated using longitudinal assessments of mathematics standards, computer science and robotics conceptual knowledge, logical and critical thinking skills, STEM school achievements, interests and attitudes toward STEM subjects, advanced STEM course-taking, involvement in other ISL opportunities, and leadership in STEM in one’s school/university and community. The project will test a locally based informal learning model with projects hosted by other K-12 and college partners.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.
A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.
This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
Well-designed out-of-school time experiences can provide youth with rich opportunities to learn. However, to design effective out-of-school time experiences, it is critical to have a research basis that clarifies the features of programs that support increased youth engagement that then leads to better outcomes for youth. This project explores the features of programming that integrates sports, mathematics and science concepts, and growth mindset for 4th through 8th grade aged Latinx and African American youth. To accomplish this, the investigators refine curricular resources for out-of-school time programs and develop a model for professional learning experiences for informal educators and facilitators to support their implementation of integrated sports and STEM programming. To identify critical features of the programming, the researchers explore the ways that the program activities are implemented in two different contexts as well as the impact of the programming on youth participants' mindset, understanding of science and mathematics concepts, STEM interests, and self-perceived science and mathematics abilities. Additionally, researchers will explore the ways that the sports-themed programming supports (or could better support) girls' engagement.
The project builds on the University of Arizona researchers' existing partnerships with Major League Baseball (MLB) and Boys/Girls Club programs and an existing school-based MLB program for schools to (a) expand and refine Science of Baseball activities to enhance engagement among girls and incorporate growth mindset experiences that focus on the value of effort, determination, and learning from mistakes in both athletics and STEM; (b) study the enactment and outcomes of the program with 4th-8th grade aged youth in the two distinct informal learning settings; and (c) develop and refine a model for professional learning that includes in-person and on-line components for training informal STEM learning facilitators. The work will focus on two study contexts: afterschool programs of Boys and Girls Clubs in AZ, CA, and MO and summer programs of MLB in CA and MO. Participants will include 300 youth and up to 28 informal STEM learning facilitators split across the two contexts. Design-Based Implementation Research (DBIR) will be used to a) iteratively refine the activities and professional development model, and b) study the enactment and outcomes of the program. Research questions focus on outcomes for youth participants (i.e., impact on growth mindset, STEM dispositions, and understanding of science/math concepts), and the elements of effective professional development for informal STEM educators. Outcomes of the project include empirical evidence of what works and what doesn't work in the design, implementation, and professional development for STEM learning programs that integrate sports and growth mindset principles. In addition, outcomes of the project will advance knowledge of how different out-of-school program structures with similar sports-focused STEM programming can similarly (or differentially) support youth learning.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
National priorities recommend the U.S. fortify a culture of innovation by encouraging broader participation in invention and STEM. The Game Changers is an Innovations in Development exhibition project with embedded research that advances knowledge about how museum exhibits can activate STEM-related inventive identities among the public. The project is a collaboration between the Smithsonian's Lemelson Center for the Study of Invention and Innovation at the National Museum of American History (NMAH-LC), educational researchers, an exhibition design firm, and community based organizations. While the Game Changers exhibition theme of inventiveness in sports provides an initial spark for broad audience interest and engagement, its ultimate intent is to foster and enhance inventive identity among diverse audiences, particularly girls and young women ages 10-17, African American youth ages 10-17, and people of all ages with disabilities. Visitors will be met by a brief introductory display to launch their journey from passive learner to active inventor. A diverse array of athletes and inventors provide relevant motivational exemplars and ask visitors "How will YOU Change the Game?" Examples of invention challenges include, applying the principles of physics and materials science to aid in designing a safer helmet and exploring computational fluid dynamics to design a faster swimsuit. Throughout the exhibition experience, visitors will draw on an array of STEM skills and knowledge essential to sports, including physiology, kinesiology, and biomechanical engineering, physics, biomimicry, robotics, computer science, data analysis, and virtual and augmented reality. Throughout the project, the team will work with priority audiences, starting with front-end research and evaluation; progressing iteratively through stages of formative research, design, and evaluation; and conducting summative evaluation to ensure that the STEM-based content and design strategies are impacting inventive identity and meeting audiences' interests and needs. In coordination with the exhibition development and evaluation teams, educational researchers will iteratively explore and develop a model for innovative identity development in informal learning environments.
Educational psychologists from Old Dominion University and Temple University will collaborate closely with the NMAH-LC team, exhibition design-fabrication firm Roto, and evaluators from Randi Korn & Associates to adapt a theoretical model of identity from a formal education setting to an informal learning context. In the model, identity is conceptualized as a complex dynamic system, with interdependent internal and external elements (ontological/epistemological beliefs; self-perceptions; purpose and goals; perceived action possibilities) and reciprocal influences in a process of continuous emergence. Using design based research and a previously developed coding manual, the team will iteratively apply, test, and further advance the inventive identity development model, a set of inventive identity indicators for future research and development, and a list of exhibition design techniques for activating inventive, STEM-based identity development in informal learning environments. The research team will prioritize diverse audiences for iterative cycles and focus groups, including participants from the Girl Scouts of the Nation's Capital, Smithsonian Accessibility Program, Smithsonian's Anacostia Community Museum, and YMCA of Washington, DC. The exhibition's research, evaluation, and design outcomes will be disseminated widely across the AISL field and through project collaborators.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up