This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
Presentation slides and narration for the NARST 2022 Annual Conference. In this presentation we summarize findings from our interviewed with undergraduate STEM majors who identify as Latine, homing in on the ways in which they characterize "STEM" and "STEM people" and their descriptions of K-12 experiences that contributed to their characterizations of these concepts.
Student engagement is an important predictor of choosing science-related careers and establishing a scientifically literate society: and, worryingly, it is on the decline internationally. Conceptions of science are strongly affected by school experience, so one strategy is to bring successful science communication strategies to the classroom. Through a project creating short science films on mobile devices, students' engagement greatly increased through collaborative learning and the storytelling process. Teachers were also able to achieve cross-curricular goals between science, technology
DATE:
TEAM MEMBERS:
Kaitlyn MartinLloyd DavisSusan Sandretto
resourceevaluationProfessional Development, Conferences, and Networks
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As an emerging field of theory, research, and practice, STEAM (Science, Technology, Engineering, Arts and Mathematics) has received attention for its efforts to incorporate the arts into the rubric of STEM learning. In particular, many informal educators have embraced it as an inclusive and authentic approach to engaging young people with STEM. Yet, as with many nascent fields, the conceptualization and usage of STEAM is somewhat ambivalent and weakly theorized. On the one hand, STEAM offers significant promise through its focus on multiple ways of knowing and new pathways to equitable
Engaging with Tinkering is a highly stimulating and complex experience and invites rich reflections from museum practitioners and teachers. "Tinkering as an inclusive approach for building STEM identity and supporting students facing disadvantage or with low science capital” presents the reflective practice process and tools designed by the "Tinkering EU: Building Science Capital for All" project aiming to understand in more depth the potential impact of using a Tinkering approach with students facing disadvantage. Using tools specifically designed to help teachers observe their students
The summative evaluation report for Project TRUE focuses on program implementation, participant experiences, organizational capacity outcomes and project scale-up over the five-year project.
Appendix includes logic model and instruments.
This video presents reflections on SCIENCES: Supporting a Community’s Informal Education Needs—Confidence and Empowerment in STEM. SCIENCES brought together Eden Place Nature Center and the Chicago Zoological Society to collaboratively support environmental conservation and lifelong scientific learning in the Fuller Park neighborhood of Chicago.
The SCIENCES project began in 2013 and focused on adapting existing educational programs into a suite of environmentally focused science learning opportunities for professional, student, and public audiences in the Fuller Park neighborhood
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically