This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
This is a poster created for the 2019 annual meeting of the American Geophysical Union. Below is the accepted abstract of the poster:
The Long Term Ecological Research (LTER) network spans 28 sites across North America and beyond. Here we share work from two LTER sites in the northeastern US—the Harvard Forest, MA and the Hubbard Brook Experimental Forest, NH—where boundary organizations have been developing a framework for embedding effective public engagement and knowledge co-production into these long-term studies. Here we share this framework and how it has been developed and applied in
Informal learning institutions (ILIs) create opportunities to increase public understanding of science and promote increased inclusion of groups underrepresented in Science, Technology, Engineering, and Math (STEM) careers but are not equally distributed across the United States. We explore geographic gaps in the ILI landscape and identify three groups of underserved counties based on the interaction between population density and poverty percentage. Among ILIs, National Park Service lands, biological field stations, and marine laboratories occur in areas with the fewest sites for informal
Final External Evaluation Report for Informal STEM Learning at Biological Field Stations, an NSF AISL Exploratory Pathways project, which studied the pedagogical and andragogical characteristics of informal educational outreach activities at field stations. This report summarizes the project team’s major research activities and the contextual factors that supported that work.
Appendix includes interview protocol.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Innovations in Development project addresses the need to broaden girls' participation in STEM studies and career pathways. While women make up 47% of the U.S. workforce, they hold only 28.3% of STEM jobs and only 1 in 10 employed engineers and scientists are minority women. Girls of low socioeconomic status start losing interest and confidence in STEM during middle school, and this decline often continues as girls get older. Multiple sociocultural barriers contribute to girl's loss of confidence including gender and ethnic stereotypes; lack of culturally responsive programming; limited exposure to women role models; and few or no hands-on STEM experiences. This project builds upon the success of SciGirls, the PBS television show and national outreach program, which provides professional development on research-based gender equitable and culturally responsive teaching strategies designed to engage girls in STEM. It is a collaboration between Twin Cities Public Television, the Cornell Lab of Ornithology, and the National Park Service. The project's goal is to create media-rich citizen science experiences for girls, particularly girls of color and/or from rural areas, which broaden their STEM participation, build positive STEM identities and increase girls' understanding of scientific concepts, while leveraging citizen science engagement at national parks. Project deliverables include 1) creating five new PBS SciGirls episodes that feature real girls working with women mentors in 16 National Parks, 2) producing five new role model videos of women National Park Service STEM professionals, nationally disseminated on multiple PBS platforms, 3) providing professional development for educators and role models. This project will increase access to STEM education for girls of color and/or from rural areas, inspiring and preparing them for future STEM workforce participation. It will build the capacity of educators and National Park Service women role models to create educational and professional programs that are welcoming to girls of varying racial, ethnic, socioeconomic, and geographic backgrounds. SciGirls' massive reach to diverse audiences via PBS broadcast and multiple PBS digital platforms will amplify public scientific literacy, particularly for 21st- century audiences that connect, learn and live online.
The research study conducted by the Cornell Lab of Ornithology will address these questions: 1) To what extent does the use of culturally responsive and gender equitable multimedia in citizen science programming affect girls' learning outcomes, and contribute to the development of positive STEM identity' 2) how will their experiencing citizen science in the parks influence girls' connection to nature? At the beginning of the project all participating girls (n=160) will complete a survey on their interest in science, efficacy for doing science, and knowledge of citizen science and project-specific subject matter. Researchers will use the suite of DEVISE instruments most of which have been validated for youth to measure these constructs. To measure connection to nature, researchers will use the Connection to Nature Index, a scale developed for children. Interviews with the girls will be used to obtain qualitative data to supplement the survey data. Pre-post data will be analyzed to determine the influence of the culturally responsive media and experiences on girls' STEM identities. Researchers will share findings with the project evaluator to triangulate data between educators' implementation of the strategies and girls' learning outcome providing a more holistic picture of the overall program.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Identifying private gardens in the U.K. as key sites of environmental engagement, we look at how a longer-term online citizen science programme facilitated the development of new and personal attachments of nature. These were visible through new or renewed interest in wildlife-friendly gardening practices and attitudinal shifts in a large proportion of its participants. Qualitative and quantitative data, collected via interviews, focus groups, surveys and logging of user behaviours, revealed that cultivating a fascination with species identification was key to both ‘helping nature’ and wider
DATE:
TEAM MEMBERS:
Nirwan SharmaSam GreavesAdvaith SiddharthanHelen AndersonAnnie RobinsonLaura Colucci-GrayAgung Toto WibowoHelen BostockAndrew SalisburyStuart RobertsDavid SlawsonRené van der Wal
In November 2016, within an Environmental studies course at the University of Venice, students carried out an experiment aimed at collecting scenarios of the Venetian coast's future starting from lessons learnt during the episode of storm surge 50 years ago (Aqua Granda ‘flood’). The students built scenarios able to anticipate the effect of sea level rise on coastal areas in Venice, based not only on scientific input but also on a methodology called “Futurescape city Tours” (FCT) involving inhabitants of the barrier islands of Lido and Pellestrina. This paper will explore three main questions
DATE:
TEAM MEMBERS:
Alba L’AstorinaAlessia GhezziStefano GuerzoniEmanuela Molinaroli
Char Associates conducted an evaluation of the four-year, NSF-funded project, Interpreters and Scientists Working on Our Parks (iSWOOP). The project brought interpreters and scientists together in multi-day professional development sessions at five national parks with the purpose of showcasing scientific research that usually goes unseen and unappreciated by park visitors. iSWOOP coordinated the development and delivery of digital libraries including animations, still photos, thermal and high-speed videos, and maps to give visual support to explanations of particular scientific studies. In
The night skies and the planet on which we live can be inspirational to young and old alike. In the run up to its 200th anniversary in 2020, the U.K.'s Royal Astronomical Society has put together a £1 million scheme to fund outreach and engagement activities for groups that are less well served in terms of access to astronomy and geophysics. This article outlines the projects funded and the impact they are starting to have.