RISES (Re-energize and Invigorate Student Engagement through Science) is a coordinated suite of resources including 42 interactive English and Spanish STEM videos produced by Children's Museum Houston in coordination with the science curriculum department at Houston ISD. The videos are aligned to the Texas Essential Knowledge and Skills standards, and each come with a bilingual Activity Guide and Parent Prompt sheet, which includes guiding questions and other extension activities.
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The McCormick Bridgehouse & Chicago River Museum will create a mobile cart with hands-on, immersive experiences and educational materials to expand programming to the open-air plaza in front of the museum. To educate visitors about the Chicago River ecosystem, the museum will develop and deliver three live science experiences utilizing the mobile outdoor cart, which will include a 3-D model of a watershed. Additionally, the museum will contract with photographers and a graphic designer to generate content for educational displays and curriculum. By creating a mobile cart with hands-on, immersive experiences and educational materials, the Bridgehouse Museum will reach more diverse audiences on the plaza, which extends onto the Chicago Riverwalk.
This pilot and feasibility project will explore whether participation in informal science initiatives like citizen science, which is a form of Public Participation in Scientific Research, can foster or enhance participant attachment to the natural places participants investigate via these programs. The project also examines if participant attachment to place influences the development or application of critical thinking skills among adult learners. Critical thinking skills and the factors that enhance critical thinking skills are important areas of inquiry within the informal STEM learning community. Existing scholarship suggests that three components may be linked: (1) feelings of connection to specific places, (2) intentional exploration and investigation of those places (in this case via citizen science), and (3) understanding of complex socio-ecological systems, which is predicated on critical thinking skills ability. However, the degree to which these aspects are related to each other, the scale at which they occur (local to global), and the specific dimensions of place connection or informal science experiences implicated is not known. Working with the Coastal Observation and Seabird Survey Team (COASST) citizen science program, this project advances collaboration among experts from disparate fields to examine if and how citizen science contributes to increases in connection to place and higher-order critical thinking skills among participants and the potential links between those hypothesized outcomes. The ultimate goal of the project is to inform design of Public Participation in Scientific Research programming that optimizes participant learning, interest, and retention; produces societal outcomes like critical thinking in support of science literacy; and creates high quality data of the scale and grain needed to address questions and issues across the basic-applied science continuum.
This research focuses on the degree to which Public Participation in Scientific Research, specifically citizen science, may foster the presence or intensity of place attachment felt by participants for the sites and settings investigated through these programs and to what extent place attachment may be linked to higher order critical thinking skills among adult learners. A three-pronged mixed-methods research strategy will include: (1) a re-analysis of existing survey and interview data for markers of three-dimensional (personal, social, natural) place attachment as well as critical thinking skills and dispositions; (2) an assessment survey to test for the presence and intensity of place attachment and critical thinking skills; and (3) in-depth interviews to better understand the qualitative nature and development of place attachment and critical thinking skills in a citizen science context. The survey and interview sample will be drawn from participants in the COASST citizen science program and will be stratified into four groups as a function of time engaged in the program, including new, novice, and long-term participants. An independent external advisory board and a committee of visitors comprised of experts in informal science, education, and sense of place will critique and help guide this work. Results are expected to reveal important factors that impact the learning and behavioral outcomes of informal STEM initiatives by probing questions about the essential experiences, exposures, and COASST program components that facilitate deeper critical thinking skills and place attachment. Synthesizing theoretical frameworks from the fields of geography, science education, and educational psychology while testing a unique methodological approach to best measure critical thinking skills and place attachment in an informal citizen science setting will enhance knowledge-building among research and practitioner communities.
In a globalized and increasingly technologically complex world, the ability of citizens to interrogate and interpret scientific evidence, views, and values is critical. That is, scientific literacy is essential for the maintenance of robust and healthy economic, social, and environmental systems in the twenty-first century. Informal science learning fills an important gap in national educational efforts to cultivate a scientifically literate populace as research suggests that formal science training is not always capable of fostering the type of higher order critical thinking skills that undergird such scientific competency. This project aims to strengthen infrastructure and build capacity among informal science practitioners by clarifying whether specific aspects and forms of Public Participation in Scientific Research, especially those relating to people-place connections, are implicated in the development and/or application of critical thinking skills in STEM settings. This effort may expand opportunities to strengthen informal science learning program outcomes, including the cultivation of numerous 21st century skills like information literacy and social skills like conflict management. Through a greater understanding of the individual components that shape informal learning experiences and outcomes, this project also has the potential to support the broadening of participation in STEM fields by providing the groundwork for further research on whether or not underrepresented or traditionally marginalized groups of people experience and/or relate differently to both the "places" most common in citizen science and the practice of informal science programming itself.
The Ice Worlds media project will inspire millions of children and adults to gain new knowledge about polar environments, the planet’s climate, and humanity’s place within Earth’s complex systems—supporting an informed, STEM literate citizenry. Featuring the NSF-funded THOR expedition to Thwaites glacier, along with contributions of many NSF-supported researchers worldwide, Ice Worlds will share the importance of investments in STEM with audiences in giant screen theaters, on television, online, and in other informal settings. Primary project deliverables include a giant screen film, a filmmaking workshop for Native American middle school students that will result in a documentary, a climate storytelling professional development program for informal educators, and a knowledge-building summative evaluation. The project’s largest target audience is middle school learners (ages 11-14); specific activities are designed for Native American youth and informal science practitioners. Innovative outreach will engage youth underserved in science inspiring a new generation of scientists and investigative thinkers. The project’s professional development programs will build the capacity of informal educators to engage communities and communicate science. The Ice Worlds project is a collaboration among media producers Giant Screen Films, Natural History New Zealand, PBS, and Academy Award nominated film directors (Yes/No Productions). Additional collaborators include Northwestern University, The American Indian Science and Engineering Society, the Native American Journalism Association, a group of museum and science center partners, and a team of advisors including scientific and Indigenous experts associated with the NSF-funded Study of Environmental Arctic Change initiative.
The goals of the project are: 1) to increase public understanding of the processes and consequences of environmental change in polar ecosystems, 2) to explore the effectiveness of the giant screen format to impart knowledge, inspire motivation and caring for nature, 3) to improve middle schoolers’ interest, confidence and engagement in STEM topics and pursuits—broadly and through a specific program for Native American youth, and 4) to build informal educators’ capacity to share stories of climate change in their communities. The main evaluation questions are 1) to what extent does the Ice World film affect learning, engagement, and motivation around STEM pursuits and environmental problem solving 2) what is the added value of companion media for youth’s giant screen learning over short and longer term, and 3) what are the impacts of the culturally based Native American youth workshops.
The evaluation work will involve a Native American youth advisory panel and a panel of science center practitioners in the giant screen film’s development and evaluation process. Formative evaluation of the film will involve recruiting youth from diverse backgrounds, including representation of Native youth, to see the film in the giant screen theater of a partner site. Post viewing surveys and group discussions will explore their experience of the film with respect to engagement, learning, evoking spatial presence, and motivational impact. A summative evaluation of the completed film will assess its immediate and longer term impacts. Statistical analyses will be conducted on all quantitative data generated from the evaluation, including a comparison of pre and post knowledge scores. An evaluation of the Tribal Youth Media program will include a significant period of formative evaluation and community engagement to align activities to the needs and interests of participating students. Culturally appropriate measures, qualitative methods and frameworks will be used to assess the learning impacts. Data will be analyzed to determine learning impacts of the workshop on youth participants as well as mentors and other stakeholder participants. Evaluation of the community climate storytelling professional development component will include lessons learned and recommendations for implementation.
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
This project will engage community members and youth in 13 rural, tribal, and Hispanic communities in the Four Corners Region of the south western U.S. with the science and cultural assets of water. Water is a significant and scarce resource in this geographic area. The Four Corners Region experiences low annual precipitation and high year-to-year fluctuations in water availability. Thus, water is a topic of great interest to community members, whose lives are shaped by water-related events such as drought, flood, and wildfires. Rural tribal, and Hispanic communities are often underserved with respect to science programming; their public libraries often function as the local science center. The project's inter-disciplinary team will develop, deploy, research, and evaluate an interactive traveling exhibit for small libraries, designed around regional water topics and complemented by interactive programming and community engagement events. Additionally, the team will build local capacity by fostering a community of practice among the host librarians, including participation through a support system--the STAR Library Network--to increase their science programming.
This project creates a traveling exhibit and complementary programming around water topics. Through an exhibit co-design model, communities will provide input in the exhibit development, identify water topics that are critical to them, and engage the multi-generational audiences. The exhibit merges the captivating attraction of water with the underlying science content and community context, giving patrons the opportunity to explore these topics through active learning stations, informational panels, citizen science-based activities, and an interactive regional watershed model. Artistic representations of water will be developed by community groups and incorporated into the exhibit as a dynamic display element.
Project goals are to:
Spark interest in and increase understanding of water as a critical resource and cultural asset across rural, tribal, and Hispanic communities in the Four Corners Region.
Increase availability of and access to engaging programming for underserved rural, tribal, and Hispanic communities focusing on the science and cultural aspects of water in the Four Corners Region.
Build capacity for libraries to implement water-focused science programs, and increase available science learning and science communication resources tailored to these informal learning settings.
Foster a Community of Practice (CoP) for participating librarians to support the development of their programming and content knowledge.
Advance the body of research on informal learning environments and their role in developing community members' science ecosystems and science identities, particularly in library settings.
The project team will rigorously assess the extent to which program approaches and components stimulate patrons' interest in science, increase science knowledge, and support building a personal science identity. The model is based on the STEM Learning Ecosystems Framework. Robust evaluation will guide the program development through a front-end needs assessment and iterative revision cycles of implementation strategies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Polar Literacy: A model for youth engagement and learning will foster public engagement with polar science. The project targets middle-school aged underserved youth and polar research scientists, with the goal to increase youth interest in and understanding of Polar Regions, and to hone researchers' science communication skills. The project will develop affordable and replicable ways of bringing polar education to informal learning environments, extend our understanding of how polar education initiatives can be delivered to youth with maximum effect, and design a professional development model to improve the capacity for Polar Region researchers to craft meaningful broader impact activities. Polar Literacy will create and test a model which combines direct participation by scientists in after-school settings, with the use of curated polar research data sets and data visualization tools to create participatory learning experiences for youth. Beyond the life of the project funding, many of the project deliverables (including kits, videos, and other resources) will continue to be used and disseminated online and in person through ongoing work of project collaborators.
Polar Literacy: A model for youth engagement and learning will advance the understanding of informal learning environments while leveraging the rich interdisciplinary resources from polar investments made by the National Science Foundation (NSF). The project's key audiences -- polar researchers, informal educators, and out-of-school time (OST) youth in grades 4-7 (ages 9-13) -- will connect through both place-based and internet-based experiences and work collaboratively to generate a flexible, scalable, and transferable education model. The project will 1) design OST kits and resource guides (focused on Polar Literacy Principles) and include "Concept in a Minute" videos designed to highlight enduring ideas, 2) provide professional development for informal educators, 3) synthesize a club model through adaptation of successful facets of existing informal learning programs, and 4) create Data Jam events for the OST Special Interest (SPIN) clubs and camp programs by modifying an existing formal education model. A research design, implemented at four nodes over three years, will answer three research questions to evaluate the impact of professional development on informal educators, as well as the impact of programs on youth, and the effectiveness of the model. In addition to the project team and collaborators who are informal education practitioners, an advisory board composed of experts in youth programming, informal education, and evaluation will guide the project to ensure that it advances the body of informal STEM learning research.
Polar Literacy is an Advancing Informal STEM Learning (AISL) Innovations in Development project in response to the Dear Colleague Letter: Support for Engaging Students and the Public in Polar Research (NSF 18-103). Polar Literacy is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. This project has co-funding support from the Antarctic section of the Office of Polar Programs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Janice McDonnellOscar SchofieldCharles LichtenwalnerJason Cervenec
This project develops and examines place-based learning using mobile augmented reality experiences for rural families where museums and science centers are scarce yet where natural resources are rich with outdoor trails, parks, and forestlands. The collaborative research team, with members from rural libraries, outdoor learning centers, learning scientists at Penn State University, and rural communities in Pennsylvania, will develop augmented reality and mobile learning resources for families and children aged from 4 to 12. The goal is to help people see what is not visible in real-time in order to learn about life and earth sciences based on local watersheds, trees, and seasonal cycles that are familiar and relevant to rural communities. To accomplish this goal, the project team will create scientifically meaningful experiences for rural families and children in their out-of-school time through three iterations of research and design. Although there is evidence that augmented reality can support learning, little empirical research has been conducted to determine what makes one type of augmented learning experience more effective than others in outdoor learning spaces. This project will produce research findings on the utility of augmented reality for science learning with families and youths outdoors. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants
Through a four-year design-based research study, researchers will investigate three research questions. (1) How can outdoor learning experiences be enhanced with augmented reality and digital resources in ways that make science more visible and interesting?; (2) How do different forms of augmentations on trails and in gardens support science learning? 3) What social roles do children and parents play in supporting each other's science learning and connections to rural communities? Data collection includes video-recordings of children and families in the outdoors, learning analytics of people's behavior, and interviews with rural families. The project's research design will allow for the development of theory, which supports rural families learning science within and about their communities. At the end of the project, the team will offer generalizable design principles for technologically-enhanced informal learning for outdoor displays, gardens, and trails.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.