This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The poster shares work conducted as part of the Modeling Zoos and Aquariums as Inclusive Communities of Science for Autistic Individuals (MoZAICS) project and specifically sharing details of the MoZAICS access and inclusion framework (e.g., definitions, structure/levels of the framework).
The McWane Science Center (MWSC) will create a new exhibition experience entitled “Dropping Science: Hip-Hop Interactive” that will capture the elements of the popular music genre using interpretive experiences. Project activities include exhibit content development; development of a formal evaluation plan; exhibit prototyping; remedial evaluation, and a final exhibit design plan. An important project goal is to develop the process for creating lasting, reciprocal relationships with the local African American community and throughout the region, thus creating an exhibit space that connects underrepresented audiences to STEM and establishes MWSC as a true community partner. The outcome of this project will be a new interactive experience that was co-developed with and representative of MWSC’s local community that helps MWSC connect with and engage local visitors in science through a more culturally and personally relevant lens.
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
This by the project external evaluation partner presents findings from the first phase of the Co-Created Public Engagement with Science project (CC-PES). The CC-PES project has sought to bring together informal science education institutions, civic partners, and community partners to create forums that address socio-scientific issues that are important to audience being served. The project is designed to lead these collaborative teams through three key steps of public engagement with science: agenda setting (identifying the topic of interest and designing a forum to address it), decision
RK&A conducted prototype testing for the Game Changers exhibition with a general public adult audience (18 years and older). The Game Changers exhibition is being developed by the Lemelson Center for the Study of Invention and Innovation at the National Museum of American History.
With assistance from Access Smithsonian, RK&A conducted prototype testing for the Game Changers exhibition with nine adults who identify as having low vision or limited mobility. The Game Changers exhibition is being developed by the Lemelson Center for the Study of Invention and Innovation at the National Museum of American History.
The Science Museum of Virginia will launch a three-year initiative that empowers participants to effect change in their neighborhoods using citizen science as a tool. The museum will lead a team of residents, business owners, government officials, nonprofits, and health system partners in assessing air quality concerns at the neighborhood level and implementing evidence-based solutions. The museum will also introduce a new platform and interactive software system to display air quality data from this project as well as other visualizations reflecting citizen science data captured in other initiatives. An external evaluator will conduct front-end and formative evaluation to address challenges as they occur and assist the museum in disseminating learnings from the project to the field. The project is designed to build community consensus on strategies necessary to build resilience to climate change while strengthening the museum’s position as a catalyst for science-based decision-making.
With input from its community and benchmarking against other natural history museums across the nation, the Delaware Museum of Natural History will transform its exhibits from static, taxonomy-based dioramas to interactive, ecosystem-driven engagement areas with more relevant STEM content and stories. The museum will work with an exhibit design firm to develop interpretive content, exhibit design, and related elements. Project activities will also include testing of exhibit prototypes and workshops for museum staff on best practices in evaluation. A final design development package will be presented to the Board of Trustees for approval and the museum will change its name to the Delaware Museum of Nature and Science.
Through the T523: Formative Evaluation for Educational Product Development course, our team conducted a semester-long formative evaluation for the Museum of Science, Boston (MoS) Gaia Exhibit. The Gaia Exhibit (Gaia) is a new, temporary art installation located in the MoS’s Blue Wing exhibition hall. Gaia that strives to inspire appreciation for the earth and climate change awareness. The exhibit displays imagery of the Earth’s surface on a twenty feet diameter, three-dimensional globe. Additional exhibit elements include projected questions on the floor to prompt reflection and exhibit-
The Pacific Science Center will develop new evaluation tools to assess the impact of Tinker Tank, a visitor-directed, hands-on design space in which participants are challenged to use their creativity, problem solving, and experience to understand the processes of design, engineering, and science. The project will allow the museum to determine which tools, adapted from both informal learning settings (such as timing and tracking studies, observations, surveys, and focus groups) and formal settings (such as design journals, digital portfolios, and badging),are most suitable for providing meaningful data about the learning and engagement occurring in its makerspace. By adjusting and refining the evaluation tools and methods, the museum will be able to measure learning in its makerspace, determine the extent to which it is achieving the goals and objectives of its Tinker Tank, and guide planning for expansion of making activities into different areas of its exhibition floor.
In offering museum active, multi-sensorial experiences, digitally responsive exhibits are an important part of museums' strategy for attracting visitors. Such exhibits are popular, but museums lack understanding of visitors' immediate emotional and physical experience of them. Museums' approach to exhibition evaluation favours the methods of interview and questionnaire, which are not well suited to gathering feedback on the complex mix of audio, kinesthetic and visual experience encountered in digital environments. In addressing a lack of knowledge in the museum studies literature concerning