This document summarizes lessons learned from implementing Leap into Science: Cultivating a National Network for Informal Science and Literacy (Leap into Science) from 2017-2023.
The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
The Arctic Harvest-Public Participation in Scientific Research (which encompasses the Winterberry Citizen Science program), a four-year citizen science project looking at the effect of climate change on berry availability to consumers has made measurable progress advancing our understanding of key performance indicators of highly effective citizen science programs.
DATE:
TEAM MEMBERS:
Angela LarsonKelly KealyMakaela Dickerson
This guidebook will help you plan your action project. The initial brainstorm pages will help you consider where to start, and the Action Project Framework will navigate you through steps to get to your destination: the completion of your project!
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.
This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
This Innovations in Development project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Specifically, this project connects Native Hawaiian youth ages 12-17 and their family members to STEM by channeling their cultural relationship with ʻāina, the sustaining elements of the natural world including the land, sea, and air. This project seeks to: broaden participation of Native Hawaiian youth who have been historically underrepresented in STEM; actively uphold Native Hawaiian ways of knowing and traditional knowledge; articulate the science rooted in cultural wisdom; and bring STEM into the lives of participants as they connect to the ʻāina. In partnership with six ʻāina-based community organizations across Hawaiʻi, this project will develop, implement, and study ʻāina-centered environmental education activities that explore solutions to local environmental problems. For example, in one module youth and their families will explore of a section of a nearby stream; identify and discuss the native, non-native, and invasive species; remove invasive species from a small section of the stream and make observations leading to discussions of unintended consequences and systemic impacts; ultimately, learners will meet at additional local waterways to engage in similar explorations and discussions, transferring their knowledge to understanding the impacts of construction on local streams and coral reefs. To this effort, the community-based organizations bring their expertise in preserving Hawaiian culture and sustainable island lifestyle, including rural and urban systems such as farming and irrigation traditions and the restoration of cultural sites. University of Hawai’i faculty and staff bring expertise in Environmental Science, Biology, Hawaiian Studies and Problem-Based Learning Curriculum Development. This project further supports organizational learning and sharing among the six community-based organizations. Grounded in Hawaiian ʻAʻo, where learning and teaching are the same interaction, community-based organizations will create a Community of Practice that will co-learn Problem-Based Learning pedagogy; co-learn and engage in research and evaluation methods; and share experiential and traditional knowledge to co-develop the ʻāina-based environmental education activities.
This project is uniquely situated to study the impact of community-led culturally relevant pedagogy on Hawaiian learners’ interests and connections to environmental science, and to understand ʻāina-based learning through empirical research. Research methods draw on Community-Based Participatory Research and Indigenous Research Methods to develop a collaborative research design process incorporated into the project’s key components. Community members, researchers, and evaluators will work together to examine the following research questions: 1) How does environmental Problem-Based Learning situate within ʻāina-based informal contexts?; 2) What are the environmental education learning impacts of ʻāina-based activities on youth and family participants?; and 3) How does the ʻāina-centered Problem-Based Learning approach to informal STEM education support STEM knowledge, interest and awareness? The evaluation will employ a mixed-methods participatory design to explore program efficacy, fidelity, and implementation more broadly across community-based sites, as well as program sustainability within each community-based site. Anticipated project outcomes are a 15-week organizational learning and sharing program with six ʻāina-based community organizations and 72 staff; the design and implementation of 18 activities to reach 360 youth and at least one of their family members; and the launch of an ʻāina-based STEM Community of Practice. The project’s research and development process for ʻāina-centered environmental education activities will be shared broadly and provide a useful example for other organizations locally and nationally working in informal settings with Native or Indigenous populations.
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.
The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Space Science Institute’s (SSI) National Center for Interactive Learning (NCIL), in partnership with the American Society for Civil Engineers (ASCE) and the University of Virginia (UVA), was awarded a grant from the National Science Foundation (NSF) to develop and implement a 3-year program, Project BUILD (Building Using an Interactive Learning Design). Project BUILD aims to bring together public library staff from six libraries (three rural and three urban) and professional engineers from ASCE to engage youth in grades 2-5 and their families in age-appropriate, technology-rich
Escape rooms are an engaging and increasingly popular game format in which a team of players is “locked” in a room and challenged to solve a series of narrative-embedded puzzles encoded in the room’s artifacts in order to “escape” within a set period of time. The University of California Museum of Paleontology, with partners University of Kansas Natural History Museum and the California Academy of Sciences, aim to develop, evaluate, and disseminate a “serious game” (i.e., a game designed for a purpose other than entertainment) based on the escape room model. Our traveling/loanable pop-up escape room and associated extension activities will engage diverse families (ages 8 and up) in museums and libraries in solving a biomedical mystery that teaches fundamental concepts in biology, engages critical-thinking and collaboration skills, and stimulates interest in biomedical careers. STEM Escape will address NGSS-aligned content central to medical research – in particular, it will communicate basic concepts regarding evolutionary relationships, a topic with relevance to a wide variety of medical applications, such as determining the source of emerging infectious diseases, tracking the progression of disease within a host, and identifying new medicines. The project is designed to lay the groundwork for extended family interactions surrounding scientific content and biomedical careers. The immersive game will be supplemented by a set of solo and docent-led follow-up activities that reinforce key concepts and emphasize connections between players’ experience in the game and biomedical research careers. Learners will also receive takeaway media (e.g., activity book) that highlights a diverse set of NIH-funded researchers whose work directly relies on evolutionary patterns/processes. Caregivers will have the option of receiving a follow-up email with free at-home activities. The themed inflatable pop-up room will be wheelchair-accessible and all materials will be bilingual in English and Spanish. The STEM Escape experience will be developed with and for the diverse audiences visiting urban/suburban natural history museums and libraries, as well as with and for rural families, whom we will reach through rural libraries. The project will also produce and evaluate a suite of support materials to facilitate institutional adoption and deployment of the experience. Nine host sites across the country have committed to hosting the room (with an additional two sites in the planning stages), and after the life of the grant, the room will continue to make an impact as a rentable traveling exhibit. Long term, this project will improve the public’s understanding of medically relevant evolutionary content, increase interest in biomedical careers, particularly among underserved groups targeted, and improve our understanding of how immersive games can be used to serve educational objectives.
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families