This document summarizes lessons learned from implementing Leap into Science: Cultivating a National Network for Informal Science and Literacy (Leap into Science) from 2017-2023.
The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
Sciencenter will use a co-development process to strengthen rural engagement with hands-on and inquiry-based STEM for families and children. The museum will initiate the project in partnership with Moravia Central School District and Groton Public Library. The project team will also collaborate with advisors who have expertise in reaching rural audiences. Project activities will increase the museum's understanding of rural communities' needs around STEM. The museum will work with additional rural partners to develop activities and programs that meet identified needs. An external evaluator will track project progress and measure results. This evaluator will also train the museum's staff on data collection and recording methods. Data analysis throughout the project will support changes in programs and activities as needed.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Despite the rich scientific evidence of adaptations and their evolutionary basis, there are concerning public misconceptions about evolution, processes of natural selection, and adaptations in the biodiverse world. Such misconceptions begin early. Younger elementary school children are often resistant to the idea that one “kind” of animal could descend from a completely different kind of animal, and they see features as having always existed. Other misconceptions lead to an inaccurate belief that changes in individual organisms acquired in a lifetime are passed directly on to offspring or that entire populations transform as a whole. These cognitive biases and "intuitive” misunderstandings can persist into adulthood. This Innovations in Development project will counter that narrative through an informal science project focusing on the blue whale one of nature’s most spectacular stories of adaptation. It is a species that lives life at extremes: a long-distance migrator, a deep diver, an extravagant eater, the largest animal to ever exist. With its awe-inspiring size and rich mosaic of anatomical, physiological, and behavioral specializations, it serves as a bridge to an enriched understanding of universal concepts in elementary biology and can begin to dispel the deeply rooted misconceptions. The project deliverables include a giant screen film documenting the field work of research scientists studying the blue whales in the Indian Ocean and Gulf of Mexico; multi-platform educational modules and programs that will build on the blue whale content from the film for use in science center programs and rural libraries; and professional development webinars that will offer content utilization and presentation skills for ISE facilitators. Project partners include California Science Center, STAR Library Education Network, HHMI Tangled Bank Studios and SK Films.
The external evaluation studies will gather data from 20 participating rural libraries and 6 science museums. A formative evaluation of the film will be conducted in a giant screen theater setting with 75 families. After viewing a fine-cut version of the film they will complete age-appropriate post-viewing surveys on the film’s engagement, storytelling, content appeal and clarity, and learning value in communicating key science concepts. An external summative evaluation will include three studies. Study 1 will assess the implementation of the project at the 26 organizations, addressing the question: To what extent is the project implemented as envisioned in the libraries and science center settings? Baseline information will be collected, and later partners will complete post-grant surveys to report on their actual implementation of the project elements. In addition, the study will examine outcomes relating to professional development. Study 2 will be an evaluation of the film as experienced by 400 youth and parents in science centers and examining the question: To what extent does experiencing the film engage youth and parents and affect their interest, curiosity, and knowledge of blue whales, adaptations, and the scientific process? Study 3 will examine: To what extent and how does experiencing an educational module (virtual field trips, hands on activities, augmented reality) affect youth and parents’ interest, curiosity, and knowledge of adaptations and scientific process?
This guide compiles lessons learned by seven Portal to the Public Network (PoPNet) sites as well as remaining challenges and recommendations for organizations planning similar efforts in the future. PoPNet sites used the Portal to the Public Guiding Framework to build relationships with local scientists, prepare them for public engagement using Portal to the Public training materials, and feature them at public programs.
Face-to-face conversations between scientists and public audiences in an informal learning environment provide a valuable opportunity to support public engagement with scientific research. These types of experiences have significant benefits for members of the public and for scientists. For public audiences, interacting face-to-face with a scientist can expand awareness of the range of careers in science, spark new questions about scientific topics, and increase interest in learning more about the scientist’s topic (Tisdal, 2011; Ong, 2014). Scientists, too, are positively impacted by this
This study addresses the increasing interest in family learning in informal settings by investigating strategies to better engage families in science talk and practices. As part of a larger design-based research study, we examine how scientists and parents use think-pair-share discussion prompts to support families’ understandings about local community water sources and facilitate experimentation with a surface and underground water model. Grounded in sociocultural theory of learning, we focus on parent-child interactions and family sensemaking. We analyzed four water quality workshops with 44
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will develop a national infrastructure of state and regional partnerships to scale up The Franklin Institute's proven model of Leap into Science, an outreach program that builds the capacity of children (ages 3-10) and families from underserved communities to participate in science where they live. Leap into Science combines children's science-themed books with hands-on science activities to promote life-long interest and knowledge of science, and does so through partnerships with informal educators at libraries, museums, and other out-of-school time providers. Already field-tested and implemented in 12 cities, Leap into Science will be expanded to 90 new rural and urban communities in 15 states, and it is estimated that this expansion will reach more than 500,000 children and adults as well as 2,700 informal educators over four years. The inclusion of marginalized rural communities will provide new opportunities to evaluate and adapt the program to the unique assets and needs of rural families and communities.
The project will include evaluation and learning research activities. Evaluation will focus on: 1) the formative issues that may arise and modifications that may enhance implementation; and 2) the overall effectiveness and impact of the Leap into Science program as it is scaled across more sites and partners. Learning research will be used to investigate questions organized around how family science interest emerges and develops among 36 participating families across six sites (3 rural, 3 urban). Qualitative methods, including data synthesis and cross-case analysis using constant comparison, will be used to develop multiple case studies that provide insights into the processes and outcomes of interest development as families engage with Leap into Science and a conceptual framework that guides future research. This project involves a partnership between The Franklin Institute (Philadelphia, PA), the National Girls Collaborative Project (Seattle, WA), Education Development Center (Waltham, MA), and the Institute for Learning Innovation (Corvallis, OR).
Abstract: We aim to disrupt the multigenerational cycle of poverty in our rural indigenous (18% Native American and 82% Hispanic) community by training our successful college students to serve as role models in our schools. Poverty has led to low educational aspirations and expectations that plague our entire community. As such, its disruption requires a collective effort from our entire community. Our Collective unites two local public colleges, 3 school systems, 2 libraries, 1 museum, 1 national laboratory and four local organizations devoted to youth development. Together we will focus on raising aspirations and expectations in STEM (Science, Technology, Engineering and Mathematics) topics, for STEM deficiencies among 9th graders place them at risk of dropping out while STEM deficiencies among 11th and 12th graders preclude them from pursuing STEM majors in college and therefore from pursuing well paid STEM careers. We will accomplish this by training, placing, supporting, and assessing the impact of, an indigenous STEM mentor corps of successful undergraduate role models. By changing STEM aspirations and expectations while heightening their own sense of self-efficacy, we expect this corps to replenish itself and so permanently increase the flow of the state's indigenous populations into STEM majors and careers in line with NSF's mission to promote the progress of science while advancing the national health, prosperity and welfare.
Our broader goal is to focus the talents and energies of a diverse collective of community stakeholders on the empowerment of its local college population to address and solve a STEM disparity that bears directly on the community's well-being in a fashion that is generalizable to other marginalized communities. The scope of our project is defined by six tightly coupled new programs: three bringing indigenous STEM mentors to students, one training mentors, one training mentees to value and grow their network of mentors, and one training teachers to partner with us in STEM. The intellectual merit of our project lies not only in its assertion that authentic STEM mentors will exert an outsize influence in their communities while increasing their own sense of self-efficacy, but in the creation and careful application of instruments that assess the factors that determine teens' attitudes, career interests, and behaviors toward a STEM future; and mentors' sense of self development and progress through STEM programs. More precisely, evaluation of the programs has the potential to clarify two important questions about the role of college-age mentors in schools: (1) To what degree is the protege's academic performance and perceived scholastic competence mediated by the mentor's impact on (a) the quality of the protege's parental relationship and (b) the social capital of the allied classroom teacher; (2) To what degree does the quality of the student mentor's relationships with faculty and peers mediate the impact of her serving as mentor on her self-efficacy, academic performance, and leadership skills?
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
This white paper is the product of the CAISE Formal-Informal Partnerships Inquiry Group, which began work during a July 2008 ISE Summit organized by CAISE. Their examination of what the authors call "the hybrid nature of formal-informal collaborations" draws on relevant theoretical perspectives and a series of case studies to highlight ways in which the affordances of formal and informal settings can be combined and leveraged to create rich, compelling, authentic, and engaging science that can be systematically developed over time and settings.