This report presents the findings from a front-end evaluation for an exhibition about tuna, which is currently under development at the Monterey Bay Aquarium. Visitors were intercepted on the second floor of the Aquarium and invited to view tuna in the big tank from the lower level of the Aquarium and to review, and ultimately select, one of six prototype interpretive panels, all of which were about different aspects of tuna. The evaluation goals for this study were to determine: • what visitors overall reactions are when they view the tuna in the big tank from the lower level of the aquarium
Hidden Villa is a non-profit 1,600-acre organic farm and wilderness preserve dedicated to inspiring a just and sustainable future through multicultural and environmental education programs for children, youth and the community. In 2004, Hidden Villa hired an evaluation specialist to develop and implement an evaluation framework, and to design appropriate evaluation instruments for its environmental education programs. The following report documents in detail the process of and findings from the 2004 evaluation activities with the Hidden Villa Environmental Education program or HVEEP.
The Citizen Science Embedded Assessment project will explore the use of embedded assessment to measure participant science inquiry skill development within the context of citizen science projects. Citizen science (CS) projects partner volunteers with scientists to participate directly in research endeavors. Embedded assessments (EAs) assess participant skills and performance that are directly integrated and are indistinguishable from day-to-day activities. As such, EAs allow learners to demonstrate their science competencies through tasks that are integrated seamlessly into the learning experience itself. The CS field has a growing inventory of self-assessment tools, however, the evaluation of citizen science (and other informal science projects) using such subjective assessments can be remarkably improved when these are used in combination with objective measures of knowledge, skills or other resources participants gain through their participation. Science skills, such as data collection and analysis, are particularly important for CS projects because of their focus on the scientific process and their need for rigorous data collection. Despite the focus on skill gains, CS projects rarely measure such improvements. Embedded assessments (EAs) offer a critical method for understanding the impacts of these participatory learning environments. The project will develop and field test EAs on citizen science topics with an environmental science focus. It will also design training to support their use by individual projects. The project has three primary research foci: (1) identifying common and unique science inquiry skills targeted by CS projects, and how skills are currently being measured to document project impact; (2) identifying the opportunities and challenges present in developing and administering EA tools customized for CS projects to assess science inquiry skills; and (3) assessing whether EA tools created for a CS project can provide project leaders with a better understanding of their project's impact on participant science inquiry skills. The project will address these questions with a needs assessment of research and evaluation studies within the CS community and case studies to develop and test EAs customized for three identified and interested CS projects.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
This paper examines how students, teachers, and parents evaluate residential fieldwork courses. As in prior research, findings from questionnaire data indicate that fieldwork effects social, affective, and behavioural learning. More surprisingly, focus group interviews captured increases in cognitive learning as well. This paper underscores the value of out-of-school experiences, particularly for students from under-resourced backgrounds.
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. It describes a project that will expand the functions and applications of FieldScope, a web-based science information portal currently supported by the National Geographic Society (NGS). The goal is to create a single, powerful infrastructure for Public Participation in Science Research (PPSR) projects that any organization can use to create their own project and support their own community of participants.
DATE:
TEAM MEMBERS:
National Geographic SocietyMary Ford
A major goal for the Garibay Group is to provide the team with a working document that could help inform their thinking in developing the new Gallery of Natural Sciences. This report is an analysis and synthesis of the literature on dioramas. The review focused on the question: "What do we know about visitor outcomes at habitat dioramas and how are those outcomes achieved?"
This final report summarizes the findings from three summative evaluation activities conducted by Serrell & Associates and the Oakland Museum of California with visitors to the newly renovated, reinstalled, and reinterpreted Gallery of California Natural Sciences in April and July 2014: the stay-time study, the cued questionnaire study, and the personal connections study.
DATE:
TEAM MEMBERS:
Serrell & AssociatesBeverly SerrellMary T. Faria
The Gallery of California Natural Sciences hosted four preview events before officially opening all sections. The target audiences for the evaluation of developing exhibits were Members and the general public with a focus on families. Researchers collected qualitative data in response to prototypes and developing exhibits for the Introduction and Oakland Sections, as well as for the developing Now and Then and Coastal Issues Lounges, and for the prototyping of live gallery animations. An exit survey was also administered to capture narrative, qualitative responses to visitors’ experience of
DATE:
TEAM MEMBERS:
Oakland Museum of CaliforniaMary T. Faria
This study assessed visitor outcomes from attending presentations by members of the National Network for Ocean Climate Change Interpretation [NNOCCI] community of practice at four test aquariums and two control site aquariums where climate change interpretation is delivered by professional environmental educators who have not received NNOCCI training. Four unique self-complete surveys were developed, each collecting comparable demographic data and then each uniquely querying: obligations to act on climate change information for people, animals or the ocean; confidence that actions will result
DATE:
TEAM MEMBERS:
New England Aquarium CorporationJohn Fraser
This poster was presented at the 2014 AISL PI Meeting held in Washington, DC. The project creates a STEM ecosystem in a severely under-resourced urban community. The Chicago Zoological Society, which operates Brookfield Zoo, is expanding a community partnership with Eden Place Nature Center in Chicago’s Fuller Park Neighborhood and offering a full suite of environmental science learning opportunities for teachers, youth, families, and adults. A research component is led by the University of Illinois at Chicago.
This is an overview of audience research and evaluation pertaining to the exhibition "Living With Hurricanes: Katrina and Beyond". The process of investigating the perceptions of audiences and visitors was mostly designed to inform the interpretive planning process. Then, after the exhibit opened to the public in late October 2010, the intent was to describe and assess the experiences of visitors. Ten audience/visitor studies were conducted over a seven-year period, five of which were designed to inform the planning process and five of which were conducted after the exhibition opened to