This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
Many urgent environmental challenges, from soil degradation and water pollution to global climate change, have deep roots in how complex systems impact human well-being, and how humans relate to nature and to each other. Learning In and From the Environment through Multiple Ways of Knowing (LIFEways) is based on the premise that Indigenous stewardship has sustained communities on these lands since time immemorial. This project is collaboratively led by the Indigenous Education Institute and Oregon State University’s STEM Research Center, in partnership with Native Pathways and the Reimagine Research Group, Swinomish Indian Tribal Community, Oregon Museum of Science and Industry, World Forestry Center, and a national park network in the Pacific Northwest. The aim of this partnership is to deepen the informal learning field’s understanding of how Indigenous ways of knowing are currently or can be included in outdoor learning environments such as parks, nature preserves, and tribal lands. The project will share practices that center Indigenous worldviews to build awareness of their value and enhance STEM learning in outdoor settings. These approaches engage Native community members in continuing their traditional knowledge and practices, and help non-Native audiences learn from the dynamic interrelationships of the environment in authentic, respectful ways.
Conventional outdoor education is mostly grounded in Western concepts of “conservation” and “preservation” that position humans as acting separately from nature. This Research in Service to Practice project will identify “wise practices” that honor Indigenous ways of knowing, and investigate current capacities, barriers and opportunities for amplifying Indigenous voices in outdoor education. A team of Native and non-Native researchers and practitioners will draw upon Indigenous and Western research paradigms. Methods include Talk Story dialogues, a landscape study using national surveys, case studies, and a Circle of Relations to interpret and disseminate research findings. LIFEways will also document partnership processes to continue to build on the Collaboration with Integrity framework between tribal and non-tribal organizations (Maryboy and Begay, 2012). Findings from the LIFEways project will be shared broadly through a series of webinars, local and national meetings, conferences, and publications.
The goal of this project is to understand and support the development of evidence-based public engagement with science (PES) strategies within STEM research organizations. It specifically seeks to understand how scientists, institutional leaders, and staff within the NSF’s Long Term Ecological Research (LTER) Network make decisions about the design and implementation of PES activities. The LTER Network includes 28 varied sites across North America and provides a unique opportunity to study PES decision-making within scientific organizations. The project is especially interested in the degree to which these types of organizations consider the interests and assets of local communities, including underrepresented communities. This project will lead to increased capacity for effective, evidence-based PES in an essential sector of the nation’s STEM research infrastructure. The project is a collaboration between PES practitioners within the LTER Network and PES researchers at Michigan State University and Oregon State University.
The project will address three primary research questions: (1) How do scientists, institutional leaders, and staff view and make decisions about the design and implementation of PES? (2) To what degree do PES activities and PES strategies consider the interests and assets of local communities, including those underrepresented in STEM? (3) How, and to what degree, can scientists, institutional leaders, and staff develop shared PES strategies aimed at enhancing reciprocal exchanges and ongoing relationships with communities? The project design includes: (a) surveys and interviews with LTER scientists, institutional leaders, and staff; (b) case studies coupled with strategic engagement planning to investigate the community contexts of PES; (c) a PES working group with LTER scientists and PES-related staff to integrate research and practice; (d) a PES monitoring system for tracking PES activities at LTER sites; and (e) an external advisory board of PES experts and representatives of other STEM research organizations to promote accountability of the work and broaden its impact beyond the LTER Network. The overall hypothesis is that it is possible to improve the effectiveness of PES through a focus on helping scientific organizations develop PES strategies in collaboration with relevant communities.
Few people realize that the largest part of our planet’s biosphere remains virtually unexplored and unknown. This enormous habitat, accounting for an area of 116 million square miles or the equivalent size of roughly 30 times the area of the United States, is the abyssal zone of the deep ocean. The abyssal sea floor, at about 6000 ft., contains more than four times as much habitat for animal life as all of the dry mountains, forests, deserts, plains and jungles combined. Microscopic larvae in the deep ocean, are essential for the renewal and replenishment of life and they repopulate areas damaged by human activities such as mining and trawling, and they make marine protected areas both feasible and important. The National Science Foundation has funded intensive studies of oceanography related to larval recruitment for decades. However, findings from this large NSF investment of personnel, technology and funding have never been widely presented to the public. This project proposes to remedy this by developing a 40 minute giant screen film to be shown in science centers across the country, supported by virtual reality and augmented reality learning tools. The film will cover select deep ocean science expeditions using the deep-sea vehicles Alvin and ROV Jason. Content will include elements of the research process, activities related to the design and operation of deep-sea vehicles as well as interviews with scientists and technologists. The companion activities, Deep-Ocean Pilot (a VR-360° viewing station) and Plankton Quest (an AR biology treasure hunt) will extend the audience experience of the deep ocean out of the giant screen theater and into the surrounding museum environment. The website and social media will extend awareness and resources into homes. The project will be appropriate for a broad general audience, with particular appeal for the target audience of women and girls (ages 7-20). The larval biologist team is led by the PI at the University of Oregon, in collaboration with scientists from North Carolina State University, Western Washington University and the University of Rhode Island. Several young women scientists will be featured in the film providing role models. The production company, Stephen Low Productions, Inc. will use the latest technology on the Alvin and other cinematic tools to capture the visual images in the abyss. Collaborating museums will participate in the development and implementation of the Virtual and Augmented Reality learning tools as well as showing the film in their theaters.
Broader impact project goals include 1) Advancing public awareness of the abyssal ocean, the role of microscopic larvae, and what scientists are learning from expeditions that use deep submergence technologies; 2) Introducing public audiences and young women specifically to the wide range of STEM-related occupations encompassed in the field of ocean exploration and research; and 3) Advancing STEM learning research and practice in the area of immersive media in conveying STEM concepts and enhancing audience identification with STEM. Oregon State University’s STEM Research Center will build new knowledge by conducting formative and summative evaluation of the film and its associated support products (e.g., Virtual and augmented reality activities, website resources), addressing the following evaluation questions: 1)What do audiences take away from their experience in terms of fascination/interest, awareness and understanding related to ocean science exploration? 2) To what degree does the film alone or in combination with supplemental experiences trigger career awareness in girls and young women, and youth of racial/ethnic backgrounds? 3) To what degree do immersive experiences (a sense of “being there”) contribute to learning from the film? 4) How enduring are outcomes with audiences past the onsite immediate experience? Formative evaluation will be designed as ongoing improvement informed by empirical evidence in which evaluators work with team members to answer decision-relevant questions in a timely and project-focused way. The summative evaluation will be structured as an effectiveness study using mixed methods and ascertaining whether key programmatic outcomes have been reached and the degree to which particular program elements will have contributed to the results.
DATE:
-
TEAM MEMBERS:
Craig YoungAlexander LowStephen LowGeorge von DassowTrish Mace
The Marine Discovery Center, a new, interactive 16,000 sq. ft. exhibition space will replace Feiro Marine Life Center’s existing 40-year-old facility. The planning of this accessible exhibition experience will prioritize engaging visitor connections to the ocean environment by improving scientific literacy skills, increasing awareness of historical and recent regional Tribal knowledge, encouraging stewardship actions in the marine environment, and developing deeper understandings of important local species. The Marine Discovery Center is a joint venture of Feiro Marine Life Center, the National Oceanic and Atmospheric Administration (NOAA)’s Olympic Coast National Marine Sanctuary, and Olympic Coast National Marine Sanctuary Foundation.
The McCormick Bridgehouse & Chicago River Museum will create a mobile cart with hands-on, immersive experiences and educational materials to expand programming to the open-air plaza in front of the museum. To educate visitors about the Chicago River ecosystem, the museum will develop and deliver three live science experiences utilizing the mobile outdoor cart, which will include a 3-D model of a watershed. Additionally, the museum will contract with photographers and a graphic designer to generate content for educational displays and curriculum. By creating a mobile cart with hands-on, immersive experiences and educational materials, the Bridgehouse Museum will reach more diverse audiences on the plaza, which extends onto the Chicago Riverwalk.
The University and Jepson Herbaria at the University of California, Berkeley will develop a series of virtual workshops that promote experiential learning and discovery in the fields of botany, ecology, and conservation biology. The workshops and accompanying recordings will address critical environmental issues. Geared toward lifelong learners, recordings of the lecture portions of the twelve workshops will be made available online and free of charge. The workshops and videos will provide high-quality, museum-based educational resources that demonstrate the value of museum collections and how those collections are used in research and education. By bringing environmental education to a broader audience, this program will educate participants about how each member of a community can contribute to local efforts to protect natural resources.
Monroe County’s Seneca Park Zoo will modernize the guest experience in the zoo’s Animal Hospital to increase accessibility and promote visitor engagement. The project will address existing barriers to visitor participation and engagement by updating the educational graphics and incorporating new technology into the exhibit to create a multisensory experience that engages visitors of all education levels, interests, and abilities. The modernized Animal Hospital will benefit the zoo’s 400,000 annual visitors and help accomplish its strategic goals of compelling storytelling and providing exceptional educational experiences to inspire conservation action.
The Westmoreland Sanctuary Nature Center and Museum will develop an interactive educational museum exhibition to teach visitors about pond ecology, watershed health, and sustainable resource management and encourage them to become more involved in environmental conservation. The museum will use its pond ecology curriculum, which comports with Next Generation Science Standards, to educate approximately 10,000 visitors annually. The interactive exhibition will include a touchable model of a pond’s edge; a roll-out specimen drawer with additional taxidermy such as a green heron, frog, spotted salamander, or freshwater clam; and a microscope with slides of rainwater so students can see the “life” in a drop of water. Multi-level, take-home reading materials aimed at elementary, middle/high school, and adult learners will further promote science literacy and provide concrete ways individuals can get involved in their communities to support sustainable aquatic ecosystems.
The Saginaw Chippewa Indian Tribe of Michigan's Ziibiwing Center of Anishinabe Culture and Lifeways will organize a four-day educational symposium to build a better understanding of Native American culture and history. The project will begin with a forum to foster dialogue on the 200th anniversary of the Treaty of Saginaw. The forum will discuss the treaty's impact on sovereignty and relationships between natives and non-natives and the loss of continuity of language, culture, and the practice of traditional art forms. The forum will include representatives from the 25 tribes whose children attended the Mount Pleasant Indian Industrial Boarding School. The representatives will share cultural stories and traditional methods through birch bark, black ash, elm and sweet grass basket making. The symposium will conclude on Michigan Indian Day with science, technology, engineering, art and math (STEAM) activities for area students.
With input from its community and benchmarking against other natural history museums across the nation, the Delaware Museum of Natural History will transform its exhibits from static, taxonomy-based dioramas to interactive, ecosystem-driven engagement areas with more relevant STEM content and stories. The museum will work with an exhibit design firm to develop interpretive content, exhibit design, and related elements. Project activities will also include testing of exhibit prototypes and workshops for museum staff on best practices in evaluation. A final design development package will be presented to the Board of Trustees for approval and the museum will change its name to the Delaware Museum of Nature and Science.