RK&A conducted a summative evaluation of five climate change and resiliency programs at the Science Museum of Virginia (SMV). The summative evaluation was the culmination of a three-year grant from the National Oceanic and Atmospheric Administration (NOAA)—front-end and formative evaluations were completed in the two years prior. The goal of this evaluation was to test the extent to which the programs achieved the intended visitor outcomes defined in SMV’s Impact Framework.
How did we approach this study?
The summative evaluation focused on five programs—the Digital Dome theater’s
The Tech Museum of Innovation (The Tech) in San Jose, California proposes to partner with NOAA to integrate Science On a Sphere (SOS) into The Tech's Exploration gallery and to facilitate the development of informal and formal learning programs. Exhibits and programs at The Tech focus on the integration of emerging technologies into hands-on visitor experiences. In 2004, The Tech partnered with NOAA, the Maryland Science Center (MSC), and a consortium of national science centers to explore the potential and effectiveness of SOS as a method of engaging and informing the general public about NOAA-related sciences. Initial testing of SOS at the Maryland Science Center revealed that SOS is a visually compelling and engaging medium for conveying complex scientific information to museum visitors. Ninety-eight percent of visitors tested regarded a facilitated SOS program as a good or excellent experience with strong visitor retention suggesting the potential of SOS as a compelling visitor tool. However, when the experience was not facilitated this retention dropped dramatically. Support from NOAA will enable The Tech to test SOS and NOAA data in a number of formats to determine the most effective ways to utilize this incredible technology. The results of this evaluation will be shared with other museums using SOS to improve its reach in teaching informal audiences and promoting interest in both STEM content and NOAA research. The SOS exhibit will bring together scientists, technologists, informal education specialists, and young users to unlock the educational potential of NOAA's datasets and further NOAA's educational plan. Hands-on experiences using SOS will engage visitors in meaningful explorations of NOAA data. The Tech Museum will make SOS accessible to people of all ages, backgrounds, and educational levels. All panel text, audio, and captions will be presented in both English and Spanish to allow greater accessibility for local audiences. SOS will provide the programming platform upon which to explore the educational opportunities of this gallery as it illustrates how data collected with remote sensing technologies is helping us understand and make predictions about our dynamic environment and the future of our planet. SOS will illustrate how these data collecting technologies assist us in developing our knowledge about our planet and its solar system.
The Science Museum of Virginia has assembled a unique team of federal, state, and private institutions to create The Earth System Display Center based on the Science on a Sphere (SOS) platform. The goal of the Center is to capture the visitor's attention and spur interest in climate change literacy and how impacts on a local scale can have an aggregate effect globally. Of particular significance are a docent training program to stimulate and facilitate visitor interaction with the Sphere through dialogue, and formative and summative evaluation of the impact of docent led Sphere experiences with the general public. SOS will anchor a new data display center for examining global impacts of energy consumption, stormwater management, agriculture practices, and climate change - tying together Earth system themes from four major projects now underway at the Science Museum in Richmond, Virginia. Use of NOAA data sets and the Sphere as a dynamic presentation tools coupled with flatscreens will enable the conveyance of local and statewide trends and issues into a compelling global context.
Through the Planet Earth Decision Theater project, the Science Museum of Minnesota and its partners will upgrade the museums current SOS exhibit with new SOS learning experiences, produce for the SOS community a new SOS film about the role of humans as the dominant agents of global change and two new presenter-led SOS programs based on the film with one version utilizing an audience feedback mechanism called iClickers. SMM also will complement its Planet Earth Decision Theater and the Maryland Science Center s SOS exhibit with the addition of Rain Table (a new interactive scientific visualization platform) at both locations to further reinforce the Anthropocene messages of the new SOS film and programs. SMM will conduct extensive evaluations of the new SOS film, programs and Rain Tables. SMM s partners on this project include the NOAA Environmental Visualization Lab, University of Minnesota's National Center for Earth-surface Dynamics, University of Minnesota's Antarctic Geospatial Information Center, University of Minnesota's Institute on the Environment, Maryland Science Center, Oregon Museum of Science and Industry, Institute for Learning Innovation, George Mason University s Center for Climate Change Communication, and the Electronic Visualization Laboratory at University of Illinois-Chicago.
The Institute for Learning Innovation (ILI) will undertake a rigorous study of the public learning impact of the Science on a Sphere (SOS) museum education program that was began by NOAA in 2005. As proposed, this study will identify and evaluate the range and depth of SOS audience impacts and outcomes to provide the essential baseline understanding for its ongoing and future uses. The study will further explore the role and impact of data visualization in contemporary society as an effective means of deepening public understanding of such complex issues as Earth natural systems.
Summative evaluation of the Worldviews Network, a NOAA-funded project comprised of institutions trying to create an innovative approach for engaging the public with topics of human induced global change. The project's approach sought to 1) leverage the power of immersive environments within informal science institutions (ISIs), such as planetariums and portable domes, by 2) incorporating visualizations of scientific data sets about relevant social-ecological issues as they relate to "planetary boundaries," framed by 3) a systems-based narrative approach that incorporated cosmic, global, and
The Science Museum of Minnesota prototyped interpretive approaches to using an innovative scientific visualization system developed by the National Oceanic and Atmospheric Administration (NOAA) called Science On a Sphere (SOS). SOS is composed of a wide variety of visualizations projected onto a six-foot sphere creating animated, whole-planet views of the Earth, other planets in our solar system, and their moons. Visualizations of the Earth cover topics such as weather, climate, topography, earth system dynamics, and geophysical processes. A challenge of SOS is making the content accessible
In May of 2006, Science on a Sphere (SOS) was set up in a permanent exhibit space at the Science Museum of Minnesota. With the new installation of the Sphere, came the addition of a variety of features that were not included in the initial front-end study. These new features included an expanded playlist, new audio for some of the visualizations, accompanying labels projected on the wall describing the visualization, indication on the labels of what image will be playing next, and seating for visitors so they can sit and view the sphere. The new master playlist was composed of three smaller
During January 2007, the Science Museum of Minnesota carried out a study to gather visitor feedback on a variety of potential interpretive features of Science on a Sphere. Visitor preferences related to the use of interpretive labels and graphics directly on the Sphere and the speed in which visualizations rotate were studied. A total of 51 visitors were interviewed. Key findings include: 1. Three quarters of visitors preferred descriptive labels to be directly on the Sphere. 2. If labels were projected on the Sphere, almost all the visitors wanted them to disappear after a period of time. 3
The Science Museum of Virginia (SMV) contracted with Randi Korn & Associates, Inc. (RK&A) to evaluate Sphere Corps, a Science on a Sphere program about climate change developed by SMV with funding from the National Oceanic and Atmospheric Administration (NOAA). The study was designed around RK&A's belief that organizations must be intentional in their practice by continually clarifying purpose, aligning practices and resources to achieve purpose, measuring outcomes, and learning from practice to strengthen ongoing planning and actions. To this end, the Sphere Corps project included five phases
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Science Museum of Virginia
In 2010, the National Oceanic and Atmospheric Administration awarded the Science Museum of Minnesota (SMM) an Environmental Literacy Grant for Science Education. Over the course of four years, SMM’s Planet Earth Decision Theater project developed new Science on a Sphere (SOS) programming, films and other scientific visualizations all intended to increase public understanding of the major role that humanity now plays in creating large-scale global change. Evaluation Questions 1. Are the components interesting and enjoyable? 2. Are visitors aware of the components’ main messages? 3. Do visitors