The Springfield Science Museum will increase participation in informal science learning by making its educational programs and learning spaces more accessible and inclusive. Museum staff will undergo Disability Inclusion and Universal Design training to redesign and enhance a core multi-use learning space and principle STEM program that can remove physical, cognitive, and social barriers to learning. External evaluators will measure access needs and learning outcomes before and after project upgrades in order to track progress and develop a scalable model of inclusive practice for all the museum’s science programming. The result will be an improved educational experience for visitors of all ages, abilities, and backgrounds.
The Discovery Museums will develop and implement a continuous improvement process to improve the impact of its STEM programming by strengthening staff skills in using evaluation data. The project will begin with a series of training sessions for learning programs staff based on feedback from youth regarding the quality of the museum's program delivery and an assessment of staff competencies in positive youth development. Participating staff will benefit from a deeper understanding of data and the ability to build ongoing evaluation and positive youth development practices into their program presentations in a way that supports Social-Emotional Learning outcomes. The project will potentially result in a process and set of tools to quantify the impact of STEM programming that can be shared with other informal learning organizations.
The Science Museum of Virginia will launch a three-year initiative that empowers participants to effect change in their neighborhoods using citizen science as a tool. The museum will lead a team of residents, business owners, government officials, nonprofits, and health system partners in assessing air quality concerns at the neighborhood level and implementing evidence-based solutions. The museum will also introduce a new platform and interactive software system to display air quality data from this project as well as other visualizations reflecting citizen science data captured in other initiatives. An external evaluator will conduct front-end and formative evaluation to address challenges as they occur and assist the museum in disseminating learnings from the project to the field. The project is designed to build community consensus on strategies necessary to build resilience to climate change while strengthening the museum’s position as a catalyst for science-based decision-making.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Pacific Science Center will develop new evaluation tools to assess the impact of Tinker Tank, a visitor-directed, hands-on design space in which participants are challenged to use their creativity, problem solving, and experience to understand the processes of design, engineering, and science. The project will allow the museum to determine which tools, adapted from both informal learning settings (such as timing and tracking studies, observations, surveys, and focus groups) and formal settings (such as design journals, digital portfolios, and badging),are most suitable for providing meaningful data about the learning and engagement occurring in its makerspace. By adjusting and refining the evaluation tools and methods, the museum will be able to measure learning in its makerspace, determine the extent to which it is achieving the goals and objectives of its Tinker Tank, and guide planning for expansion of making activities into different areas of its exhibition floor.
The Bay Area Discovery Museum will address the need for STEM education by delivering engineering outreach programming to schools and libraries throughout the San Francisco Bay Area. The museum's mobile engineering lab, Try It Truck, will introduce the engineering design process to students and teachers in grades K-5 with hands-on activities (both on and off the truck) where they can collaborate, experiment, and design solutions to engineering challenges. The Try It Truck will serve 21,600 children, parents, and educators throughout the Bay Area, with at least 50 percent of all participants coming from underserved communities and Title I schools. The museum will work with an external evaluator to design survey instruments for both formative and summative evaluation, analyze summative evaluation data, and produce a report. Museum staff will share project results with colleagues at national and statewide conferences.
The Children's Museum of the Upstate will expand its STEAM outreach programming to benefit both teachers and students in the Greenville County Schools. The museum will serve 2,000 students through STEAM programs held on-site at their elementary schools, with a focus on curriculum areas where standardized test scores indicate that students are struggling. A new program for preschoolers will be piloted in the school district's six child development centers. The pre-school classes will visit the museum for a field trip that includes free exploration time and a tailored storytime lesson. The museum will also present four teacher workshops reaching 400 educators to assist them in teaching STEAM topics. An independent evaluator will conduct an evaluation of the outreach programming and develop assessment tools to help determine how the curriculum can support student achievement and result in improved standardized test scores.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This report shares the results of a year-long study of the impact of IMLS grants (1998-2003) though programs that served youth aged 9-19. Nearly 400 museum and library programs were surveyed about their goals, strategies, content, audience, and structure, as well as about their impact, effectiveness, and outcomes.
IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
Diversity, equity, accessibility, and inclusion (DEAI) have become central concerns for museums. Across the field, leaders are asking—with increasing urgency—how museums can diversify their visitors, staff, and boards; create welcoming and inclusive environments and workplaces; and ensure that museum offerings reflect a broad range of interests, experiences, and needs.
Museums have approached DEAI efforts in different ways and at different levels, from developing special exhibits and events for specific audiences to offering staff diversity training to board development. Despite more than