With funding from the National Science Foundation, NOVA/WGBH Boston with the participation of 14 U.S. and 4 international science museums have produced an IMAX/OMNIMAX film titled, Special Effects. The 40-minute film shows the techniques and methods that special effects filmmakers use along with their understanding of the human visual system to create movie illusions. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent did the program appeal to adult viewers? To what extent did the program achieve its intended viewing goals? What
With funding from the National Science Foundation, NOVA/WGBH Boston with the participation of 14 U.S. and 4 international science museums have produced an IMAX/OMNIMAX film titled, Special Effects. The 40-minute film shows the techniques and methods that special effects filmmakers use to create movie illusions. Multimedia Research implemented a summative evaluation with students focused on the following major outcomes: To what extent did the program appeal to student viewers? To what extent did the program achieve its intended viewing goals? Did the implementation of school-based activities
Earth & Sky is a 90 second radio science series about environmental sciences, earth sciences and astronomy. Multimedia Research implemented a summative evaluation of the series, utilizing a survey mailed to respondents to a radio contest held just prior to the broadcast of Earth & Sky in eight commercial radio markets. A total of 152 surveys were returned (43% return rate). The survey is in the report Appendix. The series makes science accessible and interesting to the listening audience and generates excitement about science. The programs were perceived as affecting listeners'
In this paper, Harris Shettel, museum evaluation consultant, examines the rise of controversial museum exhibitions. Shettel argues that controversial subject matter should not be avoided, but rather presented in exciting, interesting and challenging ways that avoid controversy. Shettel points to the "Prisoners of War: Soviet Prisoners in Germany - German Prisoners in the Soviet Union" exhibition as an exemplar. The various ways exhibit evaluation studies can play an important role avoiding controversy are also identified.
DATE:
TEAM MEMBERS:
Harris ShettelVisitor Studies Association
In this paper, researchers at the Brookfield Zoo present a case study in evaluating a technology project involving partnerships between museums and formal education. THe focus is on the multiple-method design, which was required in order to work with all participants, from funders to educators, to teachers and students. A set of tools, from traditional surveys through teacher-led performance assessments, was used to measure student learning, teacher satisfaction, and effective implementation of technology and museum content into quality Web pages. The authors share their experiences to help
DATE:
TEAM MEMBERS:
H. Elizabeth Stuart PerryCarol D. Saunders
In this paper, researchers from the University of North Carolina at Asheville, Denver Museum of Natural History (DMNH), and Colorado State University, present findings from two studies that established a link between certain design features commonly found in museum environments and the state of psychological flow. Study one observed visitor behavior in a museum hall at DMNH before and after renovation. The study found that after the design changes, visitors attended more to the exhibits. Study two, a post-hoc survey analysis, investigated which design features in particular are responsible for
In this paper, John H. Falk, of Science Learning, inc., provides a brief overview of brain research and suggests implications for the museum field in terms of to define and measure learning.
This paper presents background information, methodology and findings from an exploratory study conducted in 1996 by researchers at Colorado State University, Department of Natural Resource Recreation and Tourism. Researchers examined museum home page format and suggest criteria for future assessment of WWW home pages and their effectiveness. The appendix of this paper includes the Home Page Evaluation Criteria Template form used in the study.
This Handbook is geared to the experienced researcher who is a novice evaluator. It orients the researcher to evaluation practice, with an emphasis on the use of qualitative techniques to augment quantitative measures.
The project conducts action research to learn more about how different groups use technology in meaningful ways, develops approaches that significantly increase access for underrepresented groups, and proposes ways in which technology might be modified or redesigned to engage, address, and represent diverse populations. The project targets children and young people from groups underrepresented with technology, informal and formal educators, community groups and organizations, researchers, policymakers and funders, industry, and the public. Products include: a report on the state of access of underrepresented groups to technology; case studies; guides to increasing community access to technology; guidelines about how to be critical viewers, users, and makers of technology; report on the issues involved in producing diverse and equitable technology design; exemplars and ideas for diversifying technology design; suggestions for software publishers and industry; commissioned papers on issues of access and design for particular underrepresented groups; an agenda for action; and interactive World Wide Web site; and a popular press book that synthesizes the knowledge gained through this project.
DATE:
-
TEAM MEMBERS:
ellen wahlYolanda GeorgeEric JollyLaura JeffersAndres Henriquez
The New York Hall of Science, in collaboration with the Lawrence Hall of Science, is producing and evaluating an application of recently available technology, the random-access audio player, which offers the promise of improving the effectiveness of learning at science-technology center interactive exhibits. The audio "tours" that are being produced and tested will have varying degrees of branching and layering appropriate to the nature of each exhibit unit design. A "highlights" audio tour will be created for the Lawrence Hall of Science and an audio tour focusing on a single group of light, color, and vision exhibits will be created for the New York Hall of Science. The audio tours will be tested with two different categories of audience at each site: the general public on weekends and schools groups on weekdays. Alan Friedman, Director of the New York Hall of Science, will be the Principal Investigator. The Lawrence Hall of Science will be represented by Brooke Smith. The audio tours will be written and produced by Steve Tokar, the producer of Science Today a daily radio science program on the CBS radio network. Beverly Serrell, Director of Serrell & Associates, will conduct the evaluation of the audio tours at each site.
Research Communications Ltd. will develop research designs, measurement, and analysis techniques for the assessment of the impacts of informal science learning television programming and other media. Experts in the fields of psychology, science education, communications research, and evaluation and testing will develop methodologies and instruments to: better assess impact on attitudes, cognition, and behavior for specific audiences, take into account the idea that informal science learning may take a variety of forms, and better assess cumulative impacts of television and other media on informal science learning. The PI's for the project will be Valerie Crane, President of RCL, and Beth Rabin and Suzanne Carter, both on the RCL staff. Advisors would include experts in research on children's television programming such as Ellen Wartella and Keith Mielke, specialists in inquiry-based learning and formal and informal science curricula such as Matthew Schneps, and specialists in evaluation and testing such as Edward Chittenden.
DATE:
-
TEAM MEMBERS:
Valerie CraneBeth RabinSuzanne Carter