Identifying causal relationships is an important aspect of research and evaluation in visitor studies, such as making claims about the learning outcomes of a program or exhibit. Experimental and quasi-experimental approaches are powerful tools for addressing these causal questions. However, these designs are arguably underutilized in visitor studies. In this article, we offer examples of the use of experimental and quasi-experimental designs in science museums to aide investigators interested in expanding their methods toolkit and increasing their ability to make strong causal claims about
Although discussions of museums often revolve around exhibits, educators in these spaces have the potential to create in-depth, social learning experiences beyond what is possible at exhibits alone. There is still little empirical research, however, to inform how we understand, approach, and improve museum facilitation practices. In this study, we sought to address this gap by quantifying the impact of facilitation by trained educators working with visitors at interactive museum exhibits and comparing this to visitor engagement and learning outcomes for families without educator support. Using
Staff facilitators in museums and science centers are a critical but often overlooked component of the visitor experience. Despite assertions about the important role they play in visitor learning, there continues to be almost no research to understand staff facilitation in these settings or identify effective practices. To address these gaps, we conducted a design-based research study to describe the work of experienced museum educators and iteratively refine a model of staff facilitation to support family learning at interactive math exhibits developed through a prior project. The resulting
The Oregon Museum of Science and Industry (OMSI), located in Portland, is a hands-on science museum. In 2013, OMSI received funding from the National Science Foundation for the project Researching the Value of Educator Actions for Learning (REVEAL) to study how museum educators can better help families learn math while interacting with museum exhibits. Through REVEAL, OMSI was able to partner with Adelante Mujeres, a non-profit community organization located in Forest Grove that educates and empowers Latina women and their families. Here we share some of the lessons learned from the
The REVEAL project is an NSF funded project to learn about how facilitation impacts family’s experiences of math exhibits. The goal of the project was to iteratively develop and refine a theoretical model of how staff facilitation deepens and extends family mathematical discourse at interactive exhibits. This model underwent rigorous testing and ultimately provided the evidence and research-based tools to support PD efforts for informal STEM educators. As part of this testing the learnings from developing at OMSI (Oregon Museum of Science and Industry, in Portland, Oregon) were applied in an
Many museum professionals believe that immersive exhibits—those that surround visitors—provide more attractive, engaging and effective learning experiences than tabletop exhibits. We investigated this claim by comparing visitors’ experiences of the two exhibit types, using pairs of exhibits that differed in scale (immersive vs. tabletop), but shared the same content and similar visitor activity. We randomly selected, videotaped, interviewed, and sent follow-up surveys to sixty families who experienced immersive exhibits and sixty families who experienced tabletop exhibits. We found that each
The impact of two science enrichment programs on the science attitudes of 330 gifted high school students was evaluated using a multimethod, multiperspective approach that provided a more comprehensive evaluation of program impact on science attitudes than did previous assessments of science programs. Although pre-post comparisons did not indicate positive impact on science attitudes, other measures provided strong evidence of program effectiveness. Program benefits were greater among girls, those who had more supportive families and teachers, and those who entered the programs with greater
This paper explores the importance of iterative design and evaluation in developing playful learning experiences in museums. According to research, play has five defining aspects: it is structured by constraints, active without being stressful, focused on process not outcome, self-directed, and imaginative (Gray 2008). For each of these aspects, we demonstrate how an iterative process of development and formative testing improved several museum exhibits, engendering more playful learning experiences for visitors. We focus on the assessment element of the design-test process, offering in detail
The article provides information and suggestions for coordinating a Family Science Day, an informal science event for science, technology, engineering, and mathematics (STEM) education. Suggestions include integrating art into STEM experiments to create STEAM projects, securing content experts for the event, and creating a manageable timeline.
DATE:
TEAM MEMBERS:
Sara McCubbinsBethany ThomasMichael Vetere
In this article, Jeff Hayward of People, Places & Design Research outlines the evaluation process by summarizing the evaluation of "The Estimating Game," a traveling exhibit developed by the Children's Museum of Boston. The study assessed the effectiveness of the exhibit as installed at the Children's Museum, the effectiveness of "mock-ups" of parts of the exhibit as they were developed, and the effectiveness of teaching children the concept of estimating.
There is a recognized need to rigorously examine the efficacy of approaches to supporting informal learning. In this study, we used a 2 × 2 factorial experimental design to test the impact of a computer guide on 3 proximal measures of visitor learning at an interactive math exhibit. In total, 128 families were systematically assigned to engage with the exhibit either with or without access to a supplementary computer kiosk. Visitor groups with access to the computer spent longer, on average, at the exhibit and engaged in more mathematical behaviors compared to other groups. However, based on
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryScott PattisonScott EwingAngela Frey
Although studies in a variety of settings suggest that participant reactions to the research context can threaten the validity and generalizability of study findings, there have been almost no investigations of participant reactivity in museums. In this experimental study, the authors compared the behaviors and learning outcomes of visitors at two versions of an interactive mathematics exhibit who had either been actively recruited by a data collector or passively recruited using posted signage. They assessed the amount of time visitors spent at the exhibit, the number of mathematical exhibit