This paper discusses findings from the use of the Wise Guys and Gals (WGG) Observation of WGG Youth Protocol in a blended learning environment. The protocol was used to assess youth engagement when completing blended engineering design challenges at two Boys and Girls Clubs. WGG is a project funded through a grant from the National Science Foundation and which brings blended learning design challenges to middle school aged learners in informal STEM (science, technology, engineering, and mathematics) settings. This paper explores the feasibility of using the observation protocol to collect data
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.
The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Potential STEM talent is lost each day for some of the most underserved and underrepresented populations in our nation's incarcerated men, women, and youth. With years devoid of quality STEM education and opportunities while in prison, incarcerated individuals are often significantly underprepared in STEM and for the STEM workforce. This educational debt exacerbates the pattern of marginalization for these vulnerable populations. Their STEM literacy, employability and potential for earning sustainable wages upon release are stifled. This deficit in opportunity is especially stark for underrepresented groups in the United States. Roughly 61% of the prison population is non-white, which far exceeds the national average of 35%. The U.S. also has the highest per capita incarceration rates in the world, incarcerating 698 men, women, and youth for every 100,000 people. Equally unsettling, for the first time in American history the population growth rate for incarcerated women has outpaced men by almost 2 to 1 for the past 25 years. While there are many contributing factors to the high rate of incarceration in the U.S., high quality prison STEM education programs have been shown to help counter socio-economic and education debts through greater STEM knowledge attainment, successful societal integration, and increased wage and advancement potential, which increase the likelihood that formerly incarcerated individuals and their children can live productive lives. The NSF INCLUDES STEM Opportunities in Prison Settings (STEM-OPS) Alliance endeavors to build a national network aimed at providing and supporting viable pathways to STEM for the incarcerated and formerly incarcerated. Using a collective impact approach, the Alliance will work collaboratively with key stakeholders and the target population to advance extant and untapped knowledge on high quality prison STEM education and opportunities. This work builds on efforts supported by the National Science Foundation, including exploratory work piloted by two NSF INCLUDES Design and Development Launch Pilots. If successful, this Alliance has the potential to significantly transform the face of the STEM workforce and the narrative regarding the incarcerated and formerly incarcerated and their potential to succeed in STEM.
The STEM-OPS Alliance is comprised of partner organizations committed to ensuring that STEM preparation during and post incarceration is commonplace and successful. During its first year, the Alliance will focus on establishing its national network through a shared vision and goals and a collective impact approach. It will conduct systems ecology mapping to inform the supports and resources needed for the target population to succeed in STEM. Focus groups and interviews will be conducted with incarcerated middle/high school aged youth to better understand their experiences in K-12 schools and with STEM education prior to and during incarceration. The results of the mapping and youth study will be used to inform the future work of the Alliance. Affordances the network endeavors to achieve include: (a) creating accessible STEM opportunities for the target populations through STEM courses, in-prison laboratories, research experiences for undergraduates (REUs), internships, and mentoring, (b) a culturally responsive platform to connect formerly incarcerated job seekers with STEM employment opportunities, (c) an evidence-based toolkit for effective STEM in-prison program design and implementation, (d) an annual convening of key stakeholders and representatives from the target populations to share learnings, disseminate findings and resources, and support the growth and development of the Alliance, and (d) leveraging connections to the greater NSF INCLUDES National Network. A formative and summative evaluation will be conducted by an external evaluator. Through its network, the STEM OPS Alliance is well poised to directly impact 700-880 incarcerated and formerly incarcerated men and women and reach a significant number of organizations working to improve STEM opportunities and outcomes within prison contexts.
This NSF INCLUDES Alliance is funded by NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES), a comprehensive national initiative to enhance U.S. leadership in discoveries and innovations by focusing on diversity, inclusion and broadening participation in STEM at scale. Significant co-funding has also been provided by the NSF Innovative Technology Experiences for Students and Teachers (ITEST) program and the NSF Advancing Informal STEM Learning Program (AISL).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Eden BadertscherStanley AndrisseJannette CareyRich Milner
Diversity in the STEM workforce is essential for expanding the talent pool and bringing new ideas to bear in solving societal problems, yet entrenched gaps remain. In STEM higher education, students from certain racial and ethnic groups continue to be underrepresented in STEM majors and fields. Colleges and universities have responded by offering precollege STEM programs to high school students from predominantly underrepresented groups. These programs have been shown to positively affect students' analytical and critical thinking skills, STEM content knowledge and exposure, and self-efficacy through STEM-focused enrichment and research experiences. In fact, salient research suggests that out-of-school-time, precollege STEM experiences are key influencers in students' pursuit of STEM majors and careers, and underscore the value of precollege STEM programs in their ability to prepare students in STEM. This NSF INCLUDES Alliance: STEM PUSH - Pathways for Underrepresented Students to Higher Education Network - will form a national network of precollege STEM programs to actualize their value through the creation, spread and scale of an equitable, evidence-based pathway for university admissions - precollege STEM program accreditation. Building on several successful NSF INCLUDES Design and Development Launch Pilots, this Alliance will use a networked improvement community approach to transform college admissions by establishing an accreditation process for precollege STEM programs in which standards-based credentials serve as indicators of program quality that are recognized by colleges and universities as rigorous and worthy of favorable consideration during undergraduate admissions processes. Given the high enrollment of students from underrepresented groups in precollege STEM programs, the Alliance endeavors to broaden participation in STEM by maximizing college access and STEM outcomes in higher education and beyond.
The STEM PUSH Network is a national alliance of precollege STEM programs, STEM and culturally responsive pedagogy experts, formal and informal education practitioners, college admissions professionals, the accreditation sector, and other higher education representatives. The Alliance will establish a formidable collaborative improvement space using the networked improvement community model and a "next generation" accreditation model that will serve as a mechanism for communicating the power of precollege programs to admissions offices. Framing this work is the notion that the accreditation of precollege STEM programs is an equitable supplemental admissions criterion to the current, often cited as a culturally biased, standardized test score-based system. To achieve its shared vision and goals, the Alliance has four key objectives: (1) establish and support a national precollege STEM program networked community, (2) develop a standards-based precollege STEM program accreditation system to broaden participation in STEM, (3) test and validate the model within the networked improvement community, and (4) spread, scale, and sustain the model through its backbone organization, the STEM Learning Ecosystem Community of Practice. Each objective will be closely monitored and evaluated by an external evaluator. In addition, the data infrastructure developed through this Alliance will provide an unprecedented opportunity to advance scholarship in the fields of networked improvement community design and development, the efficacy of STEM precollege programs, and effective practices for broadening participation pathways from high school to higher education. By the end of five years, the STEM PUSH Network will transform ten urban ecosystems across the country into communities where students from underrepresented groups have increased college access and therefore, entree to STEM opportunities and majors in higher education. The model has the potential to be replicated by another 80 STEM ecosystems that will have access to Alliance materials and strategies through the backbone organization.
This NSF INCLUDES Alliance is funded by NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES), a comprehensive national initiative to enhance U.S. leadership in discoveries and innovations by focusing on diversity, inclusion and broadening participation in STEM at scale. It is also co-funded by the NSF Innovative Technology Experiences for Students and Teachers program and the Advancing Informal STEM Learning Program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJan MorrisonJennifer IritiAlaine AllenDavid Boone
resourceprojectProfessional Development, Conferences, and Networks
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Research shows that algebra is a major barrier to student success, enthusiasm and participation in STEM for under-represented students, particularly African-American students in under-resourced high schools. Programs that develop ways to help students master algebra concepts and a belief that they can perform algebra may lead to more students entering engineering careers. This project will provide an online engineering program to support 9th and 10th grade Baltimore City Public Schools students, a predominantly low-income African-American cohort, to develop concrete goals of becoming engineers. The goals of the program are to help students with a growing interest in engineering to maintain that interest throughout high school. The project will also support students aspire to an engineering career. The project will develop in students an appreciation of requisite courses and skills, and increase self-efficacy in mathematics. The project will also develop a replicable model of informal education capable of reinforcing the mathematical foundations that students learn during the school day. Additionally, the project will broaden participation in engineering by being available to students during out-of-school time and by having relaxed entrance criteria compared to existing opportunities in supplemental engineering curricula. The project is a collaboration between the Baltimore City Public Schools, Johns Hopkins University Applied Physics Laboratory, Northrop Grumman Corporation, and Expanded School-Based Mental Health programs to support students both during and after participation. The project will benefit society by providing skills that will allow high school students to become members of tomorrow's highly trained STEM workforce.
The research will test whether an informal, scaffolded online algebra-for-engineering program increases students' mastery and self-efficacy in mathematics. The research will advance knowledge regarding informal education by applying Social Cognitive Career Theory as a framework for measuring program impact. The theoretical framework will aid in identifying mechanisms through which students with interest in engineering might persist in maintaining this interest through high school via algebra skill mastery and increased self-efficacy. The project will recruit 200 youth from the Baltimore City Public Schools to participate in the project over three years. Qualitative data will be collected to assess how student and school socioeconomic factors impact implementation, student engagement, and outcomes. The research will answer the following questions: 1) What effect does program participation have on math mastery? 2) What direct and indirect effects do program completion and supports have on students' mathematics self-efficacy? 3) What direct and indirect effects do program components have on engineering career goals by the end of the program? 4) What direct and indirect effects does math self-efficacy have on career goals? 5) To what extent are the effects of program participation on engineering career goals mediated by math self-efficacy and engineering interest? 6) How do school factors relate to the implementation of the program? 7) What socioeconomic-related factors relate to the regularity and continuation of student participation in the program? The quantitative methods of data analysis will employ descriptive and multivariate statistical methods. Qualitative data from interviews will be analyzed using an emergent approach and a coding scheme guided by theoretical constructs. Project results will be communicated to scholars and practitioners. The team will also share information through school newsletters and parent communication through Baltimore City Public Schools.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Many people with autism are unemployed and isolated because they do not have access to educational opportunities that support them in finding jobs that match their potential. This research seeks to empower adolescents with autism to seek out careers that are well-matched with their strengths and interests. Many people with autism are interested in computing, a marketable skill. This project builds from this interest by developing strategies to effectively engage teenagers with autism. Although people with autism share a diagnosis, each person is unique and has the capacity to become a visionary and transformer in society in their own way. Teenagers with autism will be invited to participate in a game design workshop hosted by an award-winning, not-for-profit Tech Kids Unlimited. Teenagers often enjoy learning how to design games and can learn many useful skills through design. During each workshop, teenagers will rate different teaching strategies using a picture-based survey developed in collaboration with people with autism. It is expected that teenagers with autism who have difficulty focusing to be most engaged by strategies that include multiple types of information (for example, pictures, text, and speech). The team also expects those who are more focused to be most engaged by strategies with fewer sources of information. By developing clear guidelines to help educators match their teaching styles to how different students learn, the project will help them engage youth more effectively. Through an iterative process, the team will revise the game design workshop to make it more engaging for people with different types of autism. New groups of teenagers with autism will participate in improved game design workshops that include an internship in a technology company. An important outcome is to understand which strategies are engaging for young people with autism that help them develop the belief in their skills needed to seek out fulfilling careers. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This Research in Service to Practice project has the following aims: 1) Identify evidence-based strategies to engage youth with autism spectrum disorder (ASD) in informal STEM learning opportunities that are well matched to their attentional profiles, 2) Determine if engaging youth with ASD in informal STEM learning opportunities increases their STEM self-efficacy, and 3) Determine if engagement with STEM internship activities is associated with increased interest in STEM careers and career decision-making self-efficacy. Principles of Universal Design (UD) and Mayer's principles of effective multimedia instruction are frameworks employed to identify instructional strategies that are emotionally engaging for youth with diverse attentional profiles. The degree to which attentional differences contribute to different patterns of emotional engagement with informal STEM learning will be investigated. Guided by assessments of youth's engagement with different learning opportunities, 'diversity blueprints' or specific instructional strategies that help youth with diverse attentional profiles engage will be developed. After identifying strategies to engage neurodivergent (neurologically diverse) youth in informal STEM learning opportunities, the extent to which these strategies generalize to STEM internship sites will be explored. The team will study potential specificity of the types of contexts that promote different types of self-efficacy, with engagement with extracurricular STEM learning opportunities expected to preferentially target STEM self-efficacy while engagement with internships targets career decision-making self-efficacy. Although UD is often endorsed to promote STEM learning among students with disabilities, the proposed research would be the first iterative adaptation of instructional strategies designed to engage neurodivergent teens in informal STEM learning guided by a systematic analysis of how they engage with and feel about instructional strategies. Project deliverables include workshops for local after-school program providers, publications, a project website, and a multimodal guide of the process of developing 'diversity blueprints' and how to apply them for informal STEM educators and researchers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As an emerging field of theory, research, and practice, STEAM (Science, Technology, Engineering, Arts and Mathematics) has received attention for its efforts to incorporate the arts into the rubric of STEM learning. In particular, many informal educators have embraced it as an inclusive and authentic approach to engaging young people with STEM. Yet, as with many nascent fields, the conceptualization and usage of STEAM is somewhat ambivalent and weakly theorized. On the one hand, STEAM offers significant promise through its focus on multiple ways of knowing and new pathways to equitable
Parents and adult caregivers play a significant role in young children's understanding of (and participation in) science, technology, engineering, and mathematics (STEM). Research suggests that early engagement with STEM can have a profound impact on children's use of STEM process skills such as exploration, observation, and problem-solving, as well as future academic success. An immediate yet ongoing challenge facing informal STEM learning providers is to understand how limited resources can be used to support effective STEM learning opportunities and experiences for all children and families. Through a collaboration between researchers, Head Start, two science centers (one rural, one urban), and educators, this project aims to foster STEM access and engagement with specific attention to young children and their caregivers. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This Pilot and Feasibility study will apply an experimental, mixed-methods design to examine parent/caregiver and child (ages 4-5) interactions before, during, and after informal STEM experiences to identify which factors influence children's transfer of learning STEM process skills across multiple informal contexts. Research results will lay the foundation for a future longitudinal study. The project team will ask: (1) What types of parent/caregiver-child engagement at the science center are most predictive of children's application of STEM process skills in subsequent problem-solving tasks and school readiness? (2) How do variations in parent/caregiver-child conversational strategies during the science center visit influence children's memory and learning? and (3) How can informal educators best support Head Start family engagement and children's emerging STEM knowledge? This study will collect data on 240, 4-5-year-old children, with their caregivers, in two different science centers that serve a largely rural and largely urban population. Data sources will include video/audio of caregiver-child interactions at the science centers and at home, as well as children's recall, engagement with a problem-solving task, and school readiness scores. Coding and analysis of the tasks during and after the science center visit will detail mechanisms underlying children's memory, learning, and application of STEM process skills that transfer to the problem-solving task. The project will be implemented by a research-practice partnership, leveraging the expertise of project partners and communities to ensure the use of culturally responsive research practices. This research has the potential to strategically impact how science centers and Head Start grantees work together on Family Engagement programming to achieve equitable STEM learning opportunities, broadening participation for low-income young children and their families.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Developmental perspectives on prejudice provide a fundamental and important key to the puzzle for determining how to address prejudice. Research with historically disadvantaged and advantaged groups in childhood and adolescence reveals the complexity of social cognitive and moral judgments about prejudice, discrimination, bias, and exclusion. Children are aware of status and hierarchies, and often reject the status quo. Intervention, to be effective, must happen early in development, before prejudice and stereotypes are deeply entrenched.
This CAREER proposal focuses on the development of teachers' identities, which are operationalized as beliefs and practices, behaviors, and pedagogical knowledge. The PI uses a qualitative approach, occurring over two phases, to investigate the impact of formal-informal collaborations on identity development over time. The study is grounded in an ecological theoretical approach that incorporates a view of informal learning settings as learner-driven and unique in providing opportunities for interaction with objects during meaning-making experiences among groups of learners. The longitudinal research design includes collection of an array of data, including observations of teaching and learning activities, interviews, survey responses, and archival documents such as student work and videos of classroom experiences. The PI uses a narrative analysis and a grounded theoretical approach to generate themes about beliefs and practices around behaviors and pedagogical knowledge informed by informal science education experiences.
Research findings and related educational activities inform the field's understanding of best practices of integrating informal science activities into science teacher education, including determining appropriate kinds of support for STEM teachers who learn to teach in informal learning environments (ILE). The PI is integrating research findings in the revision of existing courses and the development of new courses and experiences for both new and experienced teachers. The project addresses the need for empirical evidence of impacts of ILE experiences on professional development, and will build capacity of informal science institution and university professionals to provide effective teacher education experiences and new teacher support.