This is a handout from the session "Evaluation in Practice: Stories from the front-line" at the 2014 ASTC Conference held in Raleigh, NC. The handout provides brief overviews from each of the three presenting institutions and compiles a list of evaluation resources mentioned in the session.
DATE:
TEAM MEMBERS:
Sarah CohnWhitney OwensRachel CarpenterJen Lokey
To better help museum visitors make sense of large data sets, also called “big data”, this study focuses on what museum visitors felt individual layers of a visual (alone and in combination with other layers) were communicating to them as the visual was constructed or deconstructed layer by layer. A second, smaller study, collected data to better understand how adult visitors would construct large data visualizations. This study was concerned with how people make sense of “big data” in their daily lives and how they engage with reference systems. The primary study used four different “big data
To better understand how audiences in public spaces, in this case those in a museum setting, relate to and make sense of the phrases “Big Data” and “Data Visualizations”, this study investigated visitors understanding of these terms. This formative study used intercepts; approaching adult visitors and inviting them to participate in a very brief interview. If the person agreed, they were asked additional questions. The first question asked about awareness of the phrase, “Big Data” or for a very small comparison group, “Data Visualization.” Visitors were then asked “How would you explain “Big
This tool was created by Museum of Science, Boston Design Challenges educators and the Research and Evaluation team, intended to record observations of children’s engagement in the engineering design process during participation in design-based activities in a science museum setting. It consists of a checklist of behaviors corresponding with steps of the engineering design process, previously developed for the program based on state and national standards, educator input, and past evaluator observations. The behavioral checklist matches to parts of the engineering design process, including
At the Conner Prairie Interactive History Park, visitors to the Create.Connect exhibition can use “make and test” activities developed in collaboration with the Science Museum of Minnesota. As one part of the evaluation of this exhibition, the team identified five indicators that suggest learning and that the activities should promote. The team did not expect the presence of these behaviors to guarantee that learning was occurring, but the activities were designed to promote learning through these behaviors and their absence would signal problems. These indicators are an example of one way a
Museum educators rarely experience ongoing training. They tend to rely on their past experiences of teaching and learning to guide their interactions with learners. Allen and Crowley describe the implementation of a new school trip program that challenged museum educators’ beliefs. The program involved a five-month process of reflective practice and the iterative testing of student-centered, inquiry-based facilitation approaches.
This paper explores how people from low-income, minority ethnic groups perceive and experience exclusion from informal science education (ISE) institutions, such as museums and science centers. Drawing on qualitative data from four focus groups, 32 interviews, four accompanied visits to ISE institutions, and field notes, this paper presents an analysis of exclusion from science learning opportunities during visits alongside participants’ attitudes, expectations, and conclusions about participation in ISE. Participants came from four community groups in central London: a Sierra Leonean group (n
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. Using STEM America (USA) is a two-year Pathways project designed to examine the feasibility of using informal STEM learning opportunities to improve science literacy among English Language Learner (ELL) students in Imperial County, California.
The Gallery of California Natural Sciences hosted four preview events before officially opening all sections. The target audiences for the evaluation of developing exhibits were Members and the general public with a focus on families. Researchers collected qualitative data in response to prototypes and developing exhibits for the Introduction and Oakland Sections, as well as for the developing Now and Then and Coastal Issues Lounges, and for the prototyping of live gallery animations. An exit survey was also administered to capture narrative, qualitative responses to visitors’ experience of
DATE:
TEAM MEMBERS:
Oakland Museum of CaliforniaMary T. Faria
These are samples of observation/interview testing instruments that were used in front end studies with recruited visitors to experience habitat case "interventions" such as guide cards and question prompts; and understanding concepts for a digital interactive.
DATE:
TEAM MEMBERS:
Oakland Museum of CaliforniaMary T. Faria
This report summarizes findings from an evaluation of the NSF-funded project: Two Eyes, 3D. Through collaborations with two museums, the project sought to develop and test learning outcomes for stereoscopic (3D) resources. More specifically, the external evaluation—conducted by Rockman Et Al—sought to determine the perceived value of using stereoscopic technology within museums and planetariums, uncover best practices for implementation of stereoscopic resources, and further explore best practices for research partnerships within museum settings.
DATE:
TEAM MEMBERS:
American Association of Variable Star ObservrsJennifer Borland
The concept of engagement across the learning sciences and in museums draws from research on visitor interests, motivations, and behaviors. Such involvement by museum visitors reveals institutional and field expectations about museum efficacy and demonstrated impact. However, engagement is a concept with different uses and interpretations across institutions and fields. If we are going to talk about visitor engagement in museums specifically, it is incumbent on museum educators to understand and address the values that are associated with this idea. What does engagement look like and sound
DATE:
TEAM MEMBERS:
Indiana UniversityChildren's Museum of IndianapolisElizabeth WoodBarbara Wolf