This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The University of Montana will create “Transforming Spaces” to foster a more inclusive, culturally responsive space for Missoula’s urban Indian population and to better meet the community’s needs. The project will explore cross-cultural, collaborative approaches to STEM and Native Science. In collaboration with Montana’s tribal communities, the museum’s education team and advisory groups will design and implement hands-on activities that engage visitors with Native Science. The project will engage tribal role models and partner with tribal elders to create a library of videos for tribal partners, K–12 schools, and organizations. The project will offer teachers professional development designed to fulfill the statewide mandate of Indian Education for All. The exhibit will connect Native and non-Native museum visitors, close opportunity and achievement gaps, and ensure that all Missoula children feel a sense of belonging in museums, higher education, and STEM.
The Michigan Science Center will purchase a portable planetarium that will bring planetarium shows to more than 2,000 children through its Traveling Science Program. The museum plans to take the programs to 10 schools and 8 libraries in Metro Detroit and 6 libraries in northern Michigan. They will deliver the portable planetarium shows in coordination with the museum’s long-standing “Scopes in the City” program, which allows people to use telescopes to see the night sky. The program also will expose students to Michigan’s growing aerospace industry and help increase their interest in earth and space science.
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
To engage youth in global challenges such as energy issues, students’ own community can serve as personally relevant venues for scientific inquiry. For example, after students learn about heat transfer in school, they can use this knowledge to inspect the energy efficiency of their own schools and public buildings in their neighborhood.
To bridge the gap between school science and citizen science, students need scientific instruments that can be used both in and out of school and a community to share their discoveries.
This poster was presented at the 2021 NSF AISL Awardee Meeting. The RAPID: Using Popular Media to Educate Youth About the Biology of Viruses and the Current COVID-19 Pandemic project's goal is develop a web-accessible package of customizable graphics, illustrated stories, and essays, which can be easily incorporated into free-choice and directed on-line learning as well standards-based lesson plans for Grades 6-8.
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.
The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:
RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?
Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?
RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?
Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.
The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.
This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Student engagement is an important predictor of choosing science-related careers and establishing a scientifically literate society: and, worryingly, it is on the decline internationally. Conceptions of science are strongly affected by school experience, so one strategy is to bring successful science communication strategies to the classroom. Through a project creating short science films on mobile devices, students' engagement greatly increased through collaborative learning and the storytelling process. Teachers were also able to achieve cross-curricular goals between science, technology
DATE:
TEAM MEMBERS:
Kaitlyn MartinLloyd DavisSusan Sandretto
Mentoring is a widely accepted strategy for helping youth see how their interests and abilities fit with education and career pathways; however, more research is needed to better understand how different approaches to mentoring impact youth participants. Near-peer mentoring can be a particularly impactful approach, particularly when youth can identify with their mentors. This project investigates three approaches to near-peer mentoring of high-school-aged Hispanic youth by Hispanic undergraduate mathematics majors. Mentoring approaches include undergraduates' visits to high school classrooms, mathematics social media, and a summer math research camp. These three components of the intervention are aimed at facilitating enjoyment of advanced mathematics through dynamic, experiential learning and helping high school aged youth to align themselves with other doers of mathematics on the academic stage just beyond them, i.e., college.
Using a Design-Based Research approach that involves mixed methods, the research investigates how the three different near-peer mentoring approaches impact youth participants' attitudes and interests related to studying mathematics and pursuing a career in mathematics, the youth's sense of whether they themselves are doers of mathematics, and the youth's academic progress in mathematics. The project design and research study focus on the development of mathematical identity, where a mathematics identity encompasses a person's self-understanding of himself or herself in the context of doing mathematics, and is grounded in Anderson (2007)'s four faces of identity: Engage, Imagine, Achieve, and Nature. The study findings have the potential to uncover associations between informal interactions involving the near-peer groups of high school aged youth and undergraduates seen to impact attitudes, achievement, course selection choices, and identities relative to mathematics. It also responds to an important gap in current understandings regarding effective communication of mathematics through social media outlets, and results will describe the value of in-person mathematical interactions as well as online interactions through social media. The study will result in a model for using informal near-peer mentoring and social media applications for attracting young people to study and pursue careers in STEM. This project will also result in a body of scripted MathShow presentations and materials and Math Social Media content that will be publicly available to audiences internationally via YouTube and Instagram.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Aaron WilsonSergey GrigorianXiaohui WangMayra Ortiz
Research shows that algebra is a major barrier to student success, enthusiasm and participation in STEM for under-represented students, particularly African-American students in under-resourced high schools. Programs that develop ways to help students master algebra concepts and a belief that they can perform algebra may lead to more students entering engineering careers. This project will provide an online engineering program to support 9th and 10th grade Baltimore City Public Schools students, a predominantly low-income African-American cohort, to develop concrete goals of becoming engineers. The goals of the program are to help students with a growing interest in engineering to maintain that interest throughout high school. The project will also support students aspire to an engineering career. The project will develop in students an appreciation of requisite courses and skills, and increase self-efficacy in mathematics. The project will also develop a replicable model of informal education capable of reinforcing the mathematical foundations that students learn during the school day. Additionally, the project will broaden participation in engineering by being available to students during out-of-school time and by having relaxed entrance criteria compared to existing opportunities in supplemental engineering curricula. The project is a collaboration between the Baltimore City Public Schools, Johns Hopkins University Applied Physics Laboratory, Northrop Grumman Corporation, and Expanded School-Based Mental Health programs to support students both during and after participation. The project will benefit society by providing skills that will allow high school students to become members of tomorrow's highly trained STEM workforce.
The research will test whether an informal, scaffolded online algebra-for-engineering program increases students' mastery and self-efficacy in mathematics. The research will advance knowledge regarding informal education by applying Social Cognitive Career Theory as a framework for measuring program impact. The theoretical framework will aid in identifying mechanisms through which students with interest in engineering might persist in maintaining this interest through high school via algebra skill mastery and increased self-efficacy. The project will recruit 200 youth from the Baltimore City Public Schools to participate in the project over three years. Qualitative data will be collected to assess how student and school socioeconomic factors impact implementation, student engagement, and outcomes. The research will answer the following questions: 1) What effect does program participation have on math mastery? 2) What direct and indirect effects do program completion and supports have on students' mathematics self-efficacy? 3) What direct and indirect effects do program components have on engineering career goals by the end of the program? 4) What direct and indirect effects does math self-efficacy have on career goals? 5) To what extent are the effects of program participation on engineering career goals mediated by math self-efficacy and engineering interest? 6) How do school factors relate to the implementation of the program? 7) What socioeconomic-related factors relate to the regularity and continuation of student participation in the program? The quantitative methods of data analysis will employ descriptive and multivariate statistical methods. Qualitative data from interviews will be analyzed using an emergent approach and a coding scheme guided by theoretical constructs. Project results will be communicated to scholars and practitioners. The team will also share information through school newsletters and parent communication through Baltimore City Public Schools.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley