The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
PLUM LANDING a digital media PBS Kids series that is designed to motivate six- to nine-year-old children to investigate the natural world. Content developers from WGBH Boston and researchers from the Education Development Center (EDC) used an iterative research and design process to create the Plum Landing Explore Outdoors Toolkit. The Toolkit includes digital media resources (animated stories, live-action videos, an online badging system, a digital game, and an app for families), hands-on science activities, and support materials for parents, caregivers, educators, and program directors to
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
"PLUM RX: Researching a new pathway for bringing active science exploration to urban families" is a project that makes use of public media resources to create innovative opportunities to bring environmental science learning to the hard-to-reach audience of urban families. As part of this project, media producers at WGBH and researchers at EDC worked together to: (1) develop a new pathway for bringing active environmental science exploration to urban families with children ages 6-9; (2) expand PLUM LANDING’s media assets to support urban families and informal educators when engaging in
This report looks across multiple phases of work to discuss the PLUM Rx project’s contribution to broader knowledge about supporting children’s active, outdoor science exploration in informal, urban settings. The PLUM LANDING Explore Outdoors Toolkit that resulted from this work is designed for use by outdoor prescription programs and a broad range of informal education programs serving urban children and families. This report describes (1) the rationale for the design principles that guided Toolkit development, (2) the Toolkit components developed in accordance with the design principles; and
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Mathematics plays a significant role in understanding and participating in science, technology, and engineering (STEM). Research shows that early mathematics experiences in everyday life are critical to the development of children's mathematical knowledge. This project will explore an innovative approach to fostering parent-child math interactions and conversations related to mathematical ideas. The approach will use community-based, exhibit installations called Mathscapes. These are artistic, culturally relevant, easily accessible, physical installations designed to encourage adults and children (ages 3 to 7) to use their immediate environment to playfully explore key early math concepts. The project also addresses a need for research about the cultural experiences and resources that marginalized children and families bring to mathematical conversations. Understanding parent-child interactions about mathematics community settings could result in new knowledge about early math learning among low income children and parents. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This exploratory study will design and investigate an innovative approach to encouraging math talk and math-related interactions between parents and children (ages 3-7) through the creation of MathScapes. These are temporary physical installations designed to use the immediate environment to playfully explore mathematical concepts. This study will be conducted in two Boston neighborhoods that are populated by low-income, non-dominant minority and immigrant families. Adopting a case study approach, the project will use observational methods, discourse analysis of parent/child talk, and interviews to study the interactions of 200 families at two neighborhood Mathscape installations. LENA devices will be used to capture parent/child talk at the Mathscapes while researchers use observational methods to document participant interactions, talk, and gestures. Data sources will include audio recordings of family talk, field notes of family interactions at Mathscape installations, surveys, and interviews. A qualitative approach will be used to produce research findings at multiple levels. The focus of the analysis will be to understand if this approach enhances the quality and quantity of math talk between parents and children. The project will be carried out by a research-practice-community partnership in Boston, Massachusetts that includes community mathematics educators, education researchers, and participating children and families. The design of community installations could promote engagement with math through adult/child conversations in culturally-relevant contexts situated in the local environment. By addressing the cultural experiences and resources of young people, the project could greatly enhance our understanding of how to leverage the resources that children and families bring to engaging with mathematics.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Omowale MosesDanny MartinCatherine O'ConnorNermeen Darshoush
Many urban New Yorkers believe that the Hudson River is so polluted that nothing could possibly live there. In reality, the estuary is thriving, and The River Project (TRP), a marine science field station in lower Manhattan, exists to showcase its vast biodiversity through place-based education. In 2014, TRP began collaborating on a city-wide initiative with New York Harbor Foundation and eight other partner organizations to integrate restoration science into Title I middle school curricula through the Curriculum and Community Enterprise for Restoration Science (CCERS). Teachers in the
DATE:
TEAM MEMBERS:
Elisa CarefMelissa RexAnnie LederbergGaylen Moore
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
Aligning for Impact: Computer Science Pathways Across Contexts [CS-PAC] is an NSF INCLUDES Design and Development Launch Pilot. It broadens participation of students who are underrepresented in computer science by using the convening and policy-making power of the Georgia State Department of Education to coalesce school district leaders to implement K-12 computer science education. The project provides a national model for how to work toward systemic change. With the State Department of Education's coordination, several school districts will collaboratively seek improvements in their own student participation rates. The coordination of data reporting and analysis, resources, communications, and policy promote more equitable participation in computer science education. Research emerging from this project informs other states about how to collaboratively shape computer science education policy and policy implementation.
Using a Collective Impact approach to systemic change, the project creates sustainable institutional change at the community, state, and national levels. Qualitative and quantitative data provide descriptions about how to utilize alignment strategies within Collective Impact in three different contexts: rural, suburban, and urban. Outcomes utilize a regression discontinuity analysis to justify successful implementation as well as qualitative analysis of implementation efforts that were deemed most effective by all stakeholders. The project outputs directly affect over 88,000 students across five districts and indirectly affect over 1.7 million in Georgia alone. The culminating project goal is the development of a coherent framework for aligning K-12 computer science education pathways.