This practitioner guide summarizes lessons learned from a three-year design-based research project focused on using elements of narrative (such as characters, settings, and problem frames) to evoke empathy and support girls' engagement in engineering design practices. The guide includes a summary of the driving concepts and key research findings from this work, as well as design principles for creating narrative-based engineering activities. Six activity case studies illustrate the design principles in action, and facilitation tips and observation tools offer practical guidance in developing
Many Black youth in both urban and rural areas lack engaging opportunities to learn mathematics in a manner that leads to full participation in STEM. The Young People’s Project (YPP), the Baltimore Algebra Project (BAP), and the Education for Liberation Network (EdLib) each have over two decades of experience working on this issue. In the city of Baltimore, where 90% of youth in poverty are Black, and only 5% of these students meet or exceed expectations in math, BAP, a youth led organization, develops and employs high school and college age youth to provide after-school tutoring in Algebra 1, and to advocate for a more just education for themselves and their peers. YPP works in urban or rural low income communities that span the country developing Math Literacy Worker programs that employ young people ages 14-22 to create spaces to help their younger peers learn math. Building on these deep and rich experiences, this Innovations in Development project studies how Black students see themselves as mathematicians in the context of paid peer-to-peer math teaching--a combined social, pedagogical, and economic strategy. Focusing primarily in Baltimore, the project studies how young people grow into new self-definitions through their work in informal, student-determined math learning spaces, structured collaboratively with adults who are experts in both mathematics and youth development. The project seeks to demonstrate the benefits of investing in young people as learners, teachers, and educational collaborators as part of a core strategy to improve math learning outcomes for all students.
The project uses a mixed methods approach to describe how mathematical identity develops over time in young people employed in a Youth-Directed Mathematics Collaboratory. 60 high school aged students with varying mathematical backgrounds (first in Baltimore and later in Boston) will learn how to develop peer- and near-peer led math activities with local young people in informal settings, after-school programs, camps, and community centers, reaching approximately 600 youth/children. The high school aged youth employed in this project will develop their own math skills and their own pedagogical skills through the already existing YPP and BAP structures, made up largely of peers and near-peers just like themselves. They will also participate in on-going conversations within the Collaboratory and with the community about the cultural significance of doing mathematics, which for YPP and BAP is a part of the ongoing Civil Rights/Human Rights movement. Mathematical identity will be studied along four dimensions: (a) students’ sequencing and interpretation of past mathematical experiences (autobiographical identity); (b) other people’s talk to them and their talk about themselves as learners, doers, and teachers of mathematics (discoursal identity); (c) the development of their own voices in descriptions and uses of mathematical knowledge and ideas (authorial identity); and (d) their acceptance or rejection of available selfhoods (socio-culturally available identity). Intended outcomes from the project include a clear description of how mathematical identity develops in paid peer-teaching contexts, and growing recognition from both local communities and policy-makers that young people have a key role to play, not only as learners, but also as teachers and as co-researchers of mathematics education.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Jay GillenMaisha MosesThomas NikundiweNaama LewisAlice Cook
Research suggests that when both science, technology, engineering, and mathematics (STEM) education and social-emotional development (SED) are supported in afterschool, summer, and other informal settings, young people can better develop skills for the future such as leadership, decision-making, and relationship-building so they could have successful careers/participation in STEM. However, researchers and practitioners working in the out-of-school time (OST) sector often do so without connections across these fields. The appeal for more integration of STEM and SED in OST program delivery and data collection has remained abstract and aspirational. This Literature Review and Synthesis project is the next step needed to move the OST field toward the intentional, explicit, and evidence-based integration of STEM and SED in research and practice. The project will create shared understanding necessary to improve program content, staff training, and evaluation. This synthesis will support future research on unified STEM+SED that can lead to more effective, equitable, and developmentally appropriate programming. Improved programming will contribute to talent development, address STEM workforce needs, and promote socioeconomic mobility to benefit children, youth, educators, and society. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project will systematically examine what domains and skills at the interface of STEM+SED are most researched among K-12 youth in informal STEM learning environments, compared to formal STEM educational environments. The team will further explore how gender, race, and other intersectional forms of equity can be added to the STEM+SED equation. The project team will search and appraise empirical and gray literature (2001-2020) to identify the most commonly researched domains and skills at the interface of STEM+SED in informal environments serving K-12 youth. The review and synthesis process will include four steps: search, appraisal, synthesis, and analysis. The search will begin with STEM+SED skills in four foundational domains (agency, belonging, engagement, and reflection) identified previously with experts from the fields of STEM and SED. The search will include all existing, eligible references from formal K-12 settings to contrast commonly studied domains and skills (e.g., perseverance, self-regulation, teamwork, complex problem-solving, self-awareness) in formal versus informal learning environments. The study approach will then compare these domains and skills by the demographics variables noted above. Following the creation of a strong catalog of evidence, information will be synthesized using three “pillars” for building coherence in STEM+SED integration: phenomenon (the knowing), implementation (the doing) and assessment (the result). These pillars will be used to organize and critically analyze the literature. Building conceptual coherence through a systematic review and synthesis of literature from the fields of STEM and SED will lead to greater understanding of STEM+SED in OST practice, highlight the most important content and skills to learn in informal environments, and identify when and how youth should learn specific content and skills at the interface of STEM+SED. Applying coherence to the integration of STEM+SED ensures that the principles and practices are layered carefully, in ways that avoid superficial checklists or duplication of effort and build meaningfully upon young people’s knowledge and skills. The long-term goal is to broker connections and alignment of STEM+SED across schools and OST programs. Recommendations and a roadmap to guide equitable, effective STEM+SED research, practice, and policy will result from this research.
"Making and Tinkering" links science, technology, engineering and mathematics learning (STEM) to the do-it-yourself "maker" movement, where people of all ages "create and share things in both the digital and physical world" (Resnick & Rosenbaum, 2013). This paper examines designing what Resnick and Rosenbaum (2013) call "contexts for tinkerability" within the social design experiment of El Pueblo Mágico (EPM) -- a design approach organized around a cultural historical view of learning and development. We argue that this theoretical perspective reorganizes normative approaches to STEM education
DATE:
TEAM MEMBERS:
Lisa SchwartzDaniela DigiacomoKris Gutierrez
To gather information about national opportunities for out-of-school time science, technology, engineering, and math (OST STEM) learning, Education Northwest conducted a systematic review of OST STEM programs for the Overdeck Family Foundation. The goal of this work was to better understand what programs and program elements have been successful in scaling up to regional and national levels. We were also interested in the evidence that these programs meet their academic and social goals with students, particularly students underrepresented in STEM, and how evidence of effectiveness relates to
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
But many young people face signifcant economic, cultural, historical, and/or social obstacles that distance them from STEM as a meaningful or viable option— these range from under-resourced schools, race- and gender-based discrimination, to the dominant cultural norms of STEM professions or the historical uses of STEM to oppress or disadvantage socio-economically marginalized communities (Philip and Azevedo 2017). As a result, participation in STEM-organized hobby groups, academic programs, and professions remains low among many racial, ethnic, and gender groups (Dawson 2017). One solution to
This paper examines the differences and challenges encountered when trying to create informal blended (virtual and hands-on) engineering design STEM activities. It contrasts the creation of STEM activities for formal and informal learning environments, stressing that the differences extend far beyond the length of the activity or depth of any learning goals. The discussion begins with an examination of differences between the two learning environments that need to be taken into consideration. These differences include the physical environments, organizational structures, and the goals or
This paper discusses findings from the use of the Wise Guys and Gals (WGG) Observation of WGG Youth Protocol in a blended learning environment. The protocol was used to assess youth engagement when completing blended engineering design challenges at two Boys and Girls Clubs. WGG is a project funded through a grant from the National Science Foundation and which brings blended learning design challenges to middle school aged learners in informal STEM (science, technology, engineering, and mathematics) settings. This paper explores the feasibility of using the observation protocol to collect data
Urban environments are remarkable natural laboratories to study ecology and speciation. These learning ecosystems are ecologically diverse and potentially more accessible for urban youth and their families. Unfortunately, disparities in STEM access continue to persist. Transportation, social and financial barriers, and a lack of awareness of STEM opportunities are a few of the inequities that significantly limit participation in STEM programs among urban youth, especially from underrepresented groups. Perceptions of who can meaningfully engage in scientific research remain demographically skewed to affluent, aged, and non-minoritized individuals. In an effort to address these challenges, this pilot study will investigate the feasibility of using remote cameras to survey local, urban wildlife to promote inclusive practices and youth engagement in STEM. A co-created curriculum will be employed, bringing urban ecologists and Detroit youth (6th-8th grade) together to participate in wildlife field experiences to garner and analyze data collected from cameras deployed through the city. It is the unique coupling of the camera surveys with authentic place-based, culturally relevant ecological research that will facilitate the innovative, experiential learning experiences. This pilot study will advance the understanding of the extent to which various facilitation methods and participation in out-of-school time programs like the Wildlife Neighbors program impact youth. From a broader impacts perspective, this work may yield positive environmental literacy outcomes and prove applicable for other urban youth in the country. The research findings would lay the foundation for future research and add novel approaches to the NSF portfolio on urban, out-of-school time environmental education programs for middle school youth using camera surveys to promote inclusivity, engagement in scientific field research, and increase youths' interest in STEM.
Through a strategic partnership between the Applied Wildlife Ecology Lab at the University of Michigan and the Detroit Zoological Society, this pilot will examine the effects of experiential learning through wildlife monitoring in twenty-four Detroit parks on strengthening four aspects of youth's environmental literacy: knowledge of ecology, competencies as researchers, empathy for wildlife, and sense of place. Youth will self-select into one of four facilitation models, each varying in intensity (summer experience, afterschool club) and mode (in-person, remote). Using camera surveys deployed in Detroit parks, youth will be immersed in ecological research, engaging them in the entire scientific process: observation, inquiry, data collection, fieldwork, data analysis and storytelling. Youth pre- and post-surveys, daily reflections on program activities, and parent/guardian questionnaires will assess impacts and experiences of the Wildlife Neighbors facilitation models and program more broadly. The research questions will explore the extent to which participation in Wildlife Neighbors: (a) differs across facilitation intensity and mode, and (b) strengthens environmental literacy among middle school urban youth when engaged in a co-created out-of-school time experiential program using remote cameras to survey local wildlife. Over the two-year pilot duration, approximately 100 youth and their families will participate in the program.
This pilot study is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Well-designed out-of-school time experiences can provide youth with rich opportunities to learn. However, to design effective out-of-school time experiences, it is critical to have a research basis that clarifies the features of programs that support increased youth engagement that then leads to better outcomes for youth. This project explores the features of programming that integrates sports, mathematics and science concepts, and growth mindset for 4th through 8th grade aged Latinx and African American youth. To accomplish this, the investigators refine curricular resources for out-of-school time programs and develop a model for professional learning experiences for informal educators and facilitators to support their implementation of integrated sports and STEM programming. To identify critical features of the programming, the researchers explore the ways that the program activities are implemented in two different contexts as well as the impact of the programming on youth participants' mindset, understanding of science and mathematics concepts, STEM interests, and self-perceived science and mathematics abilities. Additionally, researchers will explore the ways that the sports-themed programming supports (or could better support) girls' engagement.
The project builds on the University of Arizona researchers' existing partnerships with Major League Baseball (MLB) and Boys/Girls Club programs and an existing school-based MLB program for schools to (a) expand and refine Science of Baseball activities to enhance engagement among girls and incorporate growth mindset experiences that focus on the value of effort, determination, and learning from mistakes in both athletics and STEM; (b) study the enactment and outcomes of the program with 4th-8th grade aged youth in the two distinct informal learning settings; and (c) develop and refine a model for professional learning that includes in-person and on-line components for training informal STEM learning facilitators. The work will focus on two study contexts: afterschool programs of Boys and Girls Clubs in AZ, CA, and MO and summer programs of MLB in CA and MO. Participants will include 300 youth and up to 28 informal STEM learning facilitators split across the two contexts. Design-Based Implementation Research (DBIR) will be used to a) iteratively refine the activities and professional development model, and b) study the enactment and outcomes of the program. Research questions focus on outcomes for youth participants (i.e., impact on growth mindset, STEM dispositions, and understanding of science/math concepts), and the elements of effective professional development for informal STEM educators. Outcomes of the project include empirical evidence of what works and what doesn't work in the design, implementation, and professional development for STEM learning programs that integrate sports and growth mindset principles. In addition, outcomes of the project will advance knowledge of how different out-of-school program structures with similar sports-focused STEM programming can similarly (or differentially) support youth learning.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.