This summary brief captures highlights from the second year of the NSF-funded WaterMarks project. The technical evaluation report for this same project period can be found on the main project page. The purpose of this document is to communicate key updates (as observed by the evaluation team) in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the second year of the NSF-funded WaterMarks project. It reflects a current summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward.
This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Operation Full STEAM is an exploratory outreach project of the Cade Museum designed to close achievement gaps for underserved elementary school students in Alachua County, Florida. It provides hands-on learning experiences in science, technology, engineering, art, and math (STEAM) for students as they move from second to fifth grade in three Title I schools. The museum is implementing the project in collaboration with the Alachua County School District and corporate and community partners. This phase of the project will see the students through 4th and 5th grade where standard 5th grade science testing in the schools will measure the impact of the program. In addition to improving academic performance, the project aims to cultivate greater interest in STEAM disciplines among students from culturally and socioeconomically diverse backgrounds, inspire the pursuit of further education, and contribute to a more inclusive and equitable innovation economy.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The Jackson Hole Children’s Museum will expand its K–5th grade STEAM programs, which serve more than 1,300 students in Teton County School District #1. The STEAM programs provide inquiry-based, hands-on programming to all K–5 District students in accordance with the Wyoming State Science Standards. An additional 500 students are reached through homeschool groups, summer school, childcare and therapy organizations, and nearby Idaho schools. Each two-hour program opens with interactive, student-centered, scientific method lab stations. Students are then challenged to use newly acquired vocabulary and knowledge to complete a hands-on building project. The program is designed to contribute to increasing science and engineering literacy in the community and to support the development of students’ 21st century skills.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
Kidzeum of Health and Science will partner with Springfield, Illinois School District 186 to create a two-week STEAM (Science, Technology, Engineering, Art, and Math) residency for approximately 1,000 second graders in the district. The residency will take place at Kidzeum during the 2021-2022 school year. The program will include a curriculum created by teachers, school administrators, and museum staff, featuring a collaborative STEAM project that builds on Kidzeum exhibit content. Literacy, physical education, music, social studies, and social-emotional wellness will also be included in the curriculum as the Kidzeum tests the hypothesis that museums can benefit young learners and their families by serving as a place for longer term, immersive education programs. Southern Illinois University School of Medicine will provide project evaluation and subsequent reporting.
The Westchester Children’s Museum will develop Full STEAM (Science, Technology, Engineering, Art, and Math) Ahead, an integrated, module-based sequence of hands-on STEAM workshops adaptable for both in-person and virtual teaching for high-need 2nd to 6th grade students at Thomas Cornell Academy in Yonkers, NY and Waterside School in Stamford, CT. Project activities include program development, preparation, delivery, and evaluation to create programs that are replicable and sustainable while leveraging the museum’s resources to demonstrate how it can support their communities in need during unprecedented times. Full STEAM Ahead anticipates reaching 300 students from low-income and economically disadvantaged families.
The Whaling Museum & Education Center will expand its educational programming to benefit underserved and high-risk students in grades 2 to 5, as well as their teachers and families. The museum will develop, implement, market, and evaluate core components of its programming to reach nearly 3,000 students and 50 teachers. Museum educators will present hands-on activities in nearby schools, using real and replica artifacts and other learning materials. They will also deliver workshops for teachers at the museum to help them incorporate primary resources from the museum's collection into their curricula. A family day event will showcase what students learned from the in-class visit through displays of art projects and science posters. Other project activities will include free afterschool library programs exploring STEAM and history topics and an increase in the number of scholarships to the museum's summer camp program.