The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
The Children’s Museum will collaborate with six Hartford Public Library branches, three Hartford Family Centers, and the Connecticut Children’s Medical Center to provide hands-on Science, Technology, Engineering, Arts, and Mathematics (STEAM) - based programs to over 1,000 local 3 to 14-year old children and their care givers. Program design and development will include planning for field trips to the museum. All participants will be given age-specific, supplemental STEAM materials to continue their learning activities at home, and families can attend more than one week of library programs, or more than three Saturdays of family center programs. The goal will be to help urban Hartford youths find new pathways toward responsible citizenry and fiscal stability.
Miami Children's Museum will redesign its Construction Zone Gallery into a STEM-learning space providing children, primarily ages eight and under, with a stimulating and interactive experience. The exhibition will incorporate 13 distinctive exhibition components, allowing full engagement in a variety of STEM-based learning activities. The museum will conduct focus group activities with field interpreters, specialists and educators working in STEM fields to guide and refine content development of the script and exhibition layout, followed by testing of the themes, programming activities, exhibition props and tools, software concepts, and learning outcomes. The project team will develop accompanying programming for children to be presented at the museum and at area public libraries. All components of the exhibition will support Florida's Early Learning Standards, and will meet the evolving educational needs of its youngest learners.
This project develops and examines place-based learning using mobile augmented reality experiences for rural families where museums and science centers are scarce yet where natural resources are rich with outdoor trails, parks, and forestlands. The collaborative research team, with members from rural libraries, outdoor learning centers, learning scientists at Penn State University, and rural communities in Pennsylvania, will develop augmented reality and mobile learning resources for families and children aged from 4 to 12. The goal is to help people see what is not visible in real-time in order to learn about life and earth sciences based on local watersheds, trees, and seasonal cycles that are familiar and relevant to rural communities. To accomplish this goal, the project team will create scientifically meaningful experiences for rural families and children in their out-of-school time through three iterations of research and design. Although there is evidence that augmented reality can support learning, little empirical research has been conducted to determine what makes one type of augmented learning experience more effective than others in outdoor learning spaces. This project will produce research findings on the utility of augmented reality for science learning with families and youths outdoors. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants
Through a four-year design-based research study, researchers will investigate three research questions. (1) How can outdoor learning experiences be enhanced with augmented reality and digital resources in ways that make science more visible and interesting?; (2) How do different forms of augmentations on trails and in gardens support science learning? 3) What social roles do children and parents play in supporting each other's science learning and connections to rural communities? Data collection includes video-recordings of children and families in the outdoors, learning analytics of people's behavior, and interviews with rural families. The project's research design will allow for the development of theory, which supports rural families learning science within and about their communities. At the end of the project, the team will offer generalizable design principles for technologically-enhanced informal learning for outdoor displays, gardens, and trails.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This study explored the effect of depth of learning (as measured in hours) on creativity, curiosity, persistence and self-efficacy. We engaged ~900 parents and 900 students across 21 sites in Washington, Chicago, Los Angeles, New York, Alabama, Virginia and the United Arab Emirates, in 5-week (10-hr) Curiosity Machine programs. Iridescent trained partners to implement the programs. Thus, this analysis was also trying to establish a baseline to measure any loss in impact from scaling our programs and moving to a “train-the-trainer” model. We analyzed 769 surveys out of which 126 were paired. On
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will develop a national infrastructure of state and regional partnerships to scale up The Franklin Institute's proven model of Leap into Science, an outreach program that builds the capacity of children (ages 3-10) and families from underserved communities to participate in science where they live. Leap into Science combines children's science-themed books with hands-on science activities to promote life-long interest and knowledge of science, and does so through partnerships with informal educators at libraries, museums, and other out-of-school time providers. Already field-tested and implemented in 12 cities, Leap into Science will be expanded to 90 new rural and urban communities in 15 states, and it is estimated that this expansion will reach more than 500,000 children and adults as well as 2,700 informal educators over four years. The inclusion of marginalized rural communities will provide new opportunities to evaluate and adapt the program to the unique assets and needs of rural families and communities.
The project will include evaluation and learning research activities. Evaluation will focus on: 1) the formative issues that may arise and modifications that may enhance implementation; and 2) the overall effectiveness and impact of the Leap into Science program as it is scaled across more sites and partners. Learning research will be used to investigate questions organized around how family science interest emerges and develops among 36 participating families across six sites (3 rural, 3 urban). Qualitative methods, including data synthesis and cross-case analysis using constant comparison, will be used to develop multiple case studies that provide insights into the processes and outcomes of interest development as families engage with Leap into Science and a conceptual framework that guides future research. This project involves a partnership between The Franklin Institute (Philadelphia, PA), the National Girls Collaborative Project (Seattle, WA), Education Development Center (Waltham, MA), and the Institute for Learning Innovation (Corvallis, OR).
Maker Corps is a program delivered by the Maker Education Initiative (Maker Ed) to increase organizational capacity to develop and deliver maker programing. Since its inception in 2013, the program has grown to support over 100 organizations by providing professional development, connections to a community of other maker educators and individualized support. Over time the program elements have changed in response to feedback from participants, collaboration with evaluators and shifts in focus for Maker Ed’s goals. In the spirit of maker education – tinkering, observing, responding, iterating –
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
In partnership with Future Makers and several Maryland public libraries, the Maryland State Department of Education’s Division of Library Development and Services (DLDS) will teach children ages 4 to 7 the basic principles of programming through the use of Primo, an open-source robotics platform. With Primo, children use blocks to create algorithms that guide a robot through a maze. This will establish a foundation for learning more advanced programming skills later on, set early learners on the path to fluency in computer science, and establish a stronger mindset in computational thinking through play and experimentation. As Primo does not rely on a computer screen, the program will be replicable in a variety of environments; the curriculum will also be inclusive to young children with varying degrees of ability.
The Minnesota Children's Museum, in collaboration with the American Library Association will develop a project to engage children ages two through seven years old and their parents in exploring mathematics through hands-on, book-based math activities in libraries and children's museums across the country. The main elements of the project are: 1. A 1200 square foot exhibit at the Minnesota Children's Museum; 2. A traveling exhibit to ten children's museums over a six month period; 3. Five smaller versions of the exhibit will travel to 75 libraries sponsored by the American Library Association. Each library that apply for the exhibit must present a plan in which 50 percent of their exhibit audience will be children and families of the under-represented, lower income groups, and racial and/or ethnic groups. 4. Programs and materials will be designed to provide parents with the means to actively participate in their children's math education. The collaboration of the Minnesota Children's Museum and the American Library Association draws together two organizations whose natural constituencies are parents with young children. Project 1,2,3 is designed to be national in scope and creates multiple formats within which families can enjoy exploring math. Its goals and objectives reflect four messages: start early, math is everywhere, parental involvement and get into books. The project Principal Investigator (PI) Ms. Jeanne W. Vergeront received her Bachelor of Arts and Masters of Science in Child and Family Studies and Environmental Design, respectively from the University of Wisconsin, Madison. Currently, she serves as the Vice President, Educational Projects at the Minnesota Children's Museum in St. Paul, Minnesota.
Mother Goose Asks Why? is a program of the Vermont Center for the Book currently being brought to 1200 parents in Vermont. Centered around exemplary children's literature and science activities, the program provides a series of four reading/discussion/activity sessions to parents of preschool children. Through exploration of basic questions such as "What Is It?", "How Many?", and "How Do You Know?", parents gain experience, skills, and confidence to introduce science to their 3-7 year old children. The Vermont Center hopes to expand this program to twelve additional states, the District of Columbia, and the U.S. Virgin Islands. Before initiating this expansion, however, the Center needs to address two issues: 1) how to create appropriate strategies for reaching, recruiting, and retaining families in locations that are quite different from Vermont, and 2) how to create an evaluation strategy that will assess parental behavior and attitudinal changes over time. Toward this end, the Center will gather representatives from the participating expansion sites and experts in family outreach to examine local issues and differences, to establish local contacts, and to begin development of effective implementation strategies for the sites. They also will work with The Network, Inc., a national education evaluation and research organization, to produce concrete measurements for parental behavior changes.
DATE:
-
TEAM MEMBERS:
Sally AndersonJoan NagyGregory DeFrancis
The Vermont Center for the Book currently reaches over 1,000 parents in Vermont through the informal science education program, Mother Goose Asks "Why?." Through the program, exemplary children's literature and related science activities are brought to parents of preschool children in a series of four reading/discussion/activity sessions. Participants explore such questions as "What Is It?", "How Many", "How Do You Do It?", and "How Does It Grow?" and gain the expertise and confidence to introduce science to their 3-7 year old children. Many of the parents involved are reached through programs such as Head Start, Adult Basic Education, and Parent Centers. In this current project, the Vermont Center for the Book with make the program available to parents in 12 other states, the District of Columbia, and the Virgin Islands by equipping their state libraries and state centers for the book to conduct the program in local libraries and library service outreach sites in housing projects, on Native American reservations and in prisons. The Vermont Center will train library professionals in the content and process of the program and provide technical support as the new sites begin implementation of the program. At the same time, the Vermont Center will create another program, "You Can Count on Mother Goose," that will be based in books and activities through which parents can introduce their preschool children to basic mathematics ideas. Once created and field-tested, this new program will be disseminated to all of the participating sites.
DATE:
-
TEAM MEMBERS:
Sally AndersonJoan NagyGregory DeFrancis