In this paper, Britt Raphling from the Adler Planetarium discusses how evaluation can be used to help focus interactive multimedia options so that exhibits meet both content objectives and visitor experience objectives. This paper outlines an "ideal" evaluation process tailored specifically to the challenges of developing interactive multimedia elements in museums. It requires exhibit developers, programmers, visitors and the evaluator to participate in a series of five steps designed to ensure the most effective possible outcome.
In this article, Jacksonville State University's Stephen Bitgood presents a literature review of successful interactive exhibits. Bitgood outlines guidelines for designing interactive exhibits, focusing on two aspects of interactive exhibits: stages of evaluation; and design of the exhibit in terms of the physical device, labels for instruction and explanation, and the visitor-exhibit interface.
In the title of this very brief article, Marilyn Hood, of Hood Associates, poses the question "Can aquariums, zoos and museums use TV to educate?" and then goes on to cite a Ohio State University study. The study found that high school students may retain information from watching TV as well as they do from listening to a classroom lecture.
This CRPA project produced a human-like avatar exhibit for the Orlando Science Center that verbally communicates with middle and high school grade visitors, engaging them in the subjects of computer science, artificial intelligence, and engineering. Human-like characteristics include features to match the demographics of the Center's clientele and verbal communication in the English language. In addition to discussing how avatars are developed and how artificial intelligence works, the avatar image will answer questions from the visitors on selected topics, including subjects from the media models of Avatar and IBM's Watson event on Jeopardy. Considerable planning and research has gone into this project to make sure that the avatar is life-like and can engage in realistic dialog. The avatar images will resemble real individuals who have diverse demographic characteristics in order to enhance the human-computer interface. The system is designed to deal with background noise and antagonistic visitors. Evaluation at all levels (front-end, formative, and summative) will make the exhibit most effective and facilitate the goals of the project which are to inform the target audience on STEM subjects. The desire to have electronic analogs of humans has been a goal for half of a century. This project builds on prior research in this area and is one of the most sophisticated contemporary models in the field. It is anticipated that this work may contribute to future applications in education and assistance for individuals with disabilities. Moreover, engagement with the avatar may ignite curiosity among young visitors and stimulate interest in science careers.
In 2009, The HistoryMakers was awarded a four-year grant from The National Science Foundation (DRL-0917612) to create ScienceMakers: African Americans and Scientific Innovation (ScienceMakers). ScienceMakers builds upon The HistoryMakers’ extant oral history archives by allowing for new interviews with 180 of the nation’s top African American scientists and facilitating dissemination of the information. The overall goal of this endeavor is to increase awareness in the general public of the contributions of African American scientists (i.e., short-term outcomes), thereby ultimately leading to
Museums continue to invest in and experiment with internet technologies and increasingly with social software environments (i.e., social networking). These technologies have the potential to lead to a number of important intellectual and social outcomes such as learning, community building, and greater public understanding of, in our case, science. It is the possibility of supporting learning in digital environments that is the focus of this research project. In our previous work, online facilitation has emerged as a big deal and perhaps determines successful online museum environments from unsuccessful environments. To study facilitation, we seek to understand facilitation styles and their outcomes in two distinct but representative museum environments. The first, Science Buzz at Science Museum of Minnesota, is a popular website identified by the field to be exemplary because of its educational value and its use of Web 2.0 functionality. The second case is the more distributed use of social software at the North Carolina Museum of Life and Science (MLS). Instead of creating learning platforms that are hosted internally, MLS is experimenting with building learning communities where people are already gathering on the web like Flickr, Twitter, and YouTube. We anticipate being able to identify clear, replicable facilitation styles and to identify outcomes associated with those styles.
We are a non-profit, open access journal dedicated to publishing high quality scientific research articles from high school students. Our mission is to promote the advancement of high school education by displaying the research conducted by students across the country and the schools in which their research was performed. Our journal is developing a blog in which students can conduct peer review of each other's articles and teachers can exchange ideas on how to improve their programs. Schools with advanced science curriculum can contribute ideas and curriculum to schools with less developed programs, thus increasing the overall quality of science education in this program. We are requesting members of the Informal Science community, whose programs involve laboratory research, to submit articles to our journal.
Realizing the power of CyberLearning to transform education will require vision, strategy, and an engaged, talented community. Activities are needed to energize the community, refine and sharpen the path forward, and provide a more active and ongoing forum for clarifying the big ideas and challenging questions. In response to this need, SRI International, together with the Lawrence Hall of Science and with key support from the National Geographic Society, will organize a set of activities to advance a shared vision of the future of learning, encompassing the systems, people, and technology dimensions mutually necessary for any scalable and lasting advances in education. The innovative format for these activities is inspired by the TED talks, Wikipedia, and social networking. As in TED, a small set of leading researchers will be selected to give very short, very high quality, stimulating talks. These CyberLearning Talks will be featured at a 1-day summit meeting in Washington, DC, streamed so that local cyberlearning research communities may participate at a distance, and posted on a website. As in Wikipedia, CyberLearning Pages will be created, each page featuring a synopsis of a big idea in CyberLearning and the relevant research challenges. The 1-day conference will be followed by a small 1-day workshop focusing on how to evaluate cyberlearning efforts, identify progress, and identify important new directions. Finally, to disseminate and stimulate conversation about both the video talks and Wikipedia entries, a presence for the community will be created on social networking sites. The target outcomes of the effort will be (i) a cyberlearning research community with participants from across the many current constituent communities, and fostered awareness and appreciation of the broad range of expertise and interests across that wider community; (ii) foundations for sustained discussion of big ideas, insights, and challenges to help this new community define a more engaged, crisper vision of its own future, (iii) a community resource that can become a site for interconnecting stakeholders in the CyberLearning community and supporting investigators in improving field-generated proposals, and (iv) an emerging sense of direction for CyberLearning among a wider audience of leaders. Such community building and awareness is expected to foster collaborations that will lead to innovative and research-grounded ways of using technology to transform education -- formal and informal and across a lifetime.
Several years ago, Kansas City leaders decided to boost future economic growth by developing science and engineering skills in the area’s work force. There was a problem though: Kansas City’s workers and students weren’t very interested in science and engineering. So, five organizations, including a library and museum, founded KC Science, INC to improve science literacy in the bi-state Kansas City metropolitan region. Partners included the Johnson County (KS) Library as the lead partner; Science City, the region’s premier science museum; KCPT, the local public television station; Science Pioneers, a group that produces educational materials and activities for teachers and students; and Pathfinder Science, an online collaborative community of teachers and students engaging in scientific research. The group received a 2006 Partnership for a Nation of Learners* grant from the Institute of Museum and Library Services (IMLS) and the Corporation for Public Broadcasting (CPB) because the community partnership’s focus on science-related careers and lifelong learning helped build a foundation for an informed citizenry.
Researchers at Michigan State University, University of Washington, Science Museum of Minnesota, and Museum of Life and Science found that there are clear indicators of learning in Science Buzz (www.sciencebuzz.org), the online museum environment studied as part of the Take 2 project. People who participate in conversations through the Buzz blog demonstrate an interest in science, and they leverage their own experiences and identities in order to share science knowledge with others. Researchers utilized indicators of learning as identified in the National Academies report on Learning Science in Informal Environments. Aspects of learning that were particularly important for an online environment like Science Buzz were interest in science, participating in science through the use of language, and identifying as someone who knows about or uses science. Researchers found that Science Buzz participants had a strong interest in scientific issues, utilized argumentation strategies--an important scientific practice--and identified with the importance of science in their lives. In particular: (1) Interest in scientific issues, caring about scientific issues, identifying personally with scientific issues were commonly evident in Science Buzz; (2) There is widespread use of argumentation in relation to scientific issues, an important scientific practice, although the quality of the scientific reasoning associated with these argumentation practices varies; (3) The co-construction of identity between online participants and the host museum is a potentially powerful outcome, as it suggests that online learning environments can facilitate longer-term relationships; (4) The analytical tools developed by this project advance our ability to understand learning in online environments; (5) While some indicators of learning are present, others, such as reflecting on science or co-constructing science knowledge with others, are not present. For museums, encouraging museum staff to engage digital tools and online participants is relatively easy. However, measuring online activity with regard to complex outcomes like learning is extremely difficult. Perhaps the most useful outcome of the Take 2 project, therefore, is a tool that will enable museums to make sense of online activity in relation to powerful outcomes like learning.
The broad purpose of this project is to contribute to capacity-building efforts—to strengthen the evaluation of programs and learning experiences in informal science education (ISE). We focus on improving the quality of summative evaluations, which have been called upon to inform decision-making and practice, contribute knowledge to the field, and help make the case for the value of informal learning. We previously developed a framework that synthesizes key elements of a high-quality summative evaluation. The framework has three dimensions: (a) examine the underlying rationale of the program, exhibition, experience, or intervention being evaluated; (b) balance methodological rigor with sensitivity to the informal context; and (c) prioritize uses of the evaluation by addressing stakeholders’ needs. Evaluators may draw on all three dimensions to provide summary judgments on the value of what was evaluated. We extend our work in two ways: (1) Examine how the framework could be used as a guiding lens for planning or conducting future or current summative evaluations. We will work with partners in informal science institutions to support and document their evaluation activities along the dimensions of evaluation quality, with the intent of improving the framework and creating concrete exemplars of its application in practice. (2) Conceptualize alternative models for enhancing professional training in ISE evaluation. We will research current programs and practices for building technical evaluation capacity, looking for promising and innovative approaches that include apprenticeship or “hands-on” experiences. This 18-month project (January 2015 through June 2016) is funded by the Gordon and Betty Moore Foundation.
Goodman Research Group, Inc., (GRG), Cambridge, MA, conducted the formative evaluation of The Music Instinct project. The NSF-funded project aims to bring to PBS viewers the strong evidence of the connections between music and science, as well as to facilitate a deeper understanding of both fields. The Music Instinct project, presented by WNET/Thirteen, in collaboration with Mannes Productions, includes a two-hour television program, a website, and ancillary educational materials. The purpose of the formative evaluation is to obtain timely information to support and guide the producers as they
DATE:
TEAM MEMBERS:
Rucha LondheMiriam KochmanNivedita RanadeIrene F GoodmanWNET/ThirteenMannes Productions Inc.