The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
Future educational robots are emerging as social companions supporting learning. By socially interacting with such a robot, learners can potentially reason and talk about the things they are learning and receive help in seeing the relevance of STEM in their daily lives. However, little is known about how to design educational robots to work with youth at home over a long period of time. This project will develop an informal science learning program, called STEMMates, in collaboration with a local community center, for youth with little interest in science. The program will partner learners with an in-home learning companion robot, designed to read books with youth and provide science activities for them at the community center, where youth will engage in exciting and personally relevant science learning. As the learner reads books, the robot will make comments about what is happening in the book to help connect the reading to the science activities at the community center. The overarching goals of STEMMates are to: (a) positively support youth's individual interest in science and future science learning, (b) connect in-home learning experiences with out-of-school community-based learning, (c) bridge the gap between formal and informal engagement and learning in science, and (d) encourage the participation of youth who are underrepresented and who have low interest in STEM learning. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to and evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments.
Researchers will work with youth and staff at the community center, alongside experts in informal science learning, to design the program and then test how learners respond to reading with the robot and participating in the science activities and whether this program has a lasting impact on their science interest. Social interactions with a robot may help distribute cognitive load during learning activities to help youth reason about STEM and also supplement learning by improving feelings of value and belongingness in order to facilitate lasting interest development. Following a mixed-methods research approach using qualitative and quantitative data-collection techniques, the research team will investigate the following research questions: (1) What social and interest-development supports and activities can be utilized as socially situated interest scaffolds in an informal and in-home, augmented reading and science activity program to promote individual interest and learning in science for low interest learners? How can a social robot best facilitate this program? (2) How do learners perceive and interact with the robot in authentic, in-home, long-term situations, and how does this interaction change over time? (3) Does working with a robot designed with socially situated interest scaffolds increase individual interest in science when compared to a pre-intervention baseline, and do these effects impact future (long-term) interest and engagement in formal science learning? To answer these research questions, researchers will implement the science learning program during an 11-week summer deployment and utilize an AB single-case research design. Interview-based qualitative data and self-report surveys to examine the learner?s perception of the robot and their evolving interest in science and quantitative data on science learning using pre-/post-measure comparisons will be collected. Log data of time-on-task, reading rate, book selection and reading goal attainment will also be collected by the robot. The outcomes of this project will lay the groundwork for future investigations of the design of social robots for a diversity of learner populations and their use in different informal learning settings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will develop a national infrastructure of state and regional partnerships to scale up The Franklin Institute's proven model of Leap into Science, an outreach program that builds the capacity of children (ages 3-10) and families from underserved communities to participate in science where they live. Leap into Science combines children's science-themed books with hands-on science activities to promote life-long interest and knowledge of science, and does so through partnerships with informal educators at libraries, museums, and other out-of-school time providers. Already field-tested and implemented in 12 cities, Leap into Science will be expanded to 90 new rural and urban communities in 15 states, and it is estimated that this expansion will reach more than 500,000 children and adults as well as 2,700 informal educators over four years. The inclusion of marginalized rural communities will provide new opportunities to evaluate and adapt the program to the unique assets and needs of rural families and communities.
The project will include evaluation and learning research activities. Evaluation will focus on: 1) the formative issues that may arise and modifications that may enhance implementation; and 2) the overall effectiveness and impact of the Leap into Science program as it is scaled across more sites and partners. Learning research will be used to investigate questions organized around how family science interest emerges and develops among 36 participating families across six sites (3 rural, 3 urban). Qualitative methods, including data synthesis and cross-case analysis using constant comparison, will be used to develop multiple case studies that provide insights into the processes and outcomes of interest development as families engage with Leap into Science and a conceptual framework that guides future research. This project involves a partnership between The Franklin Institute (Philadelphia, PA), the National Girls Collaborative Project (Seattle, WA), Education Development Center (Waltham, MA), and the Institute for Learning Innovation (Corvallis, OR).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program supports new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This project will meet this goal through rigorous research and the broad implementation of an environmental science literacy professional development and learning program for informal educators and youth engaged in outdoor science programs (OSP). With growing support from the literature and the Next Generation Science Standards (NGSS), much attention has been placed on creating and leveraging interdisciplinary science learning opportunities beyond science classrooms. As such, an estimated 300 residential OSPs currently exist in the United States. Unfortunately, the informal educators often charged with facilitating these deep and impactful science learning experiences often lack robust formal training in evidenced-based, age-appropriate environmental science content knowledge and pedagogy specific for the youth in their programs. This issue is often more pronounced in under-resourced and under-served programs and communities. This project will directly address these pervasive challenges in the field by not only providing much needed science focused professional development and resources to informal educators but also by specifically targeting and training informal leaders and educators serving youth in predominately rural areas, low-income communities, and underrepresented communities.
Approximately 200 OSP leaders at 100 OSPs around the country will participate in a week-long, intensive training in the professional development model at one of five regional residential leadership institutes. OSP leaders will then redeliver the training to the approximately 1,500 OSP educators/field instructors in their home institutions. The OSP educators/field instructors will then use what they learn through the professional development to facilitate the environmental science learning program (i.e., curriculum, field experiences, resources, pedagogy) to over 1 million youth (grades 3-8) enrolled in their residential outdoor science programs. In addition, a rigorous implementation study, efficacy study and evaluation will be conducted. The implementation study will investigate: (a) Which of the professional learning model practices were implemented and (b) What successes and challenges the programs faced implementing the model. The mixed methods efficacy study will explore: (a) if outdoor science programs contribute to the development of science learning activation and environmental literacy? and (b) what are the features of these experiences that are correlated with increases in science learning activation and environmental literacy. Approximately 25-35 youth will be randomly selected from each of 50 randomly selected sites to participate in the efficacy study. The data and findings from the research and evaluation produced by this project will contribute to a relatively sparse knowledge and research base specific to youth efficacy and implementation processes and practices across nearly 1/3 of the estimated 300 existing residential outdoor science programs in the United States.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. In this project, the primary goal of Geo-literacy Education in Micronesia is to demonstrate the potential for effective intergenerational, informal learning and development of geo-literacy through an Informal STEM Learning Team (ISLT) model for Pacific island communities. This will be accomplished by means of a suite of six informal learning modules that blend local/Indigenous approaches, Western STEM knowledge systems, and active learning. This project will be implemented across 12 select communities in the Republic of Palau, the Federated States of Micronesia - which consists of the four States of Chuuk, Kosrae, Pohnpei, and Yap - and the Republic of the Marshall Islands. Jointly, these entities are referred to as the Freely Associated States (FAS). Geo-literacy refers to combining both local knowledge and Western STEM into a synthesized understanding of the world as a set of interconnected, dynamic physical, biological, and social systems, and using this integrated knowledge to make informed decisions. Applications include natural resource management, conservation, and disaster risk reduction. The project will: (1) demonstrate that the recruitment and development of an ISLT model is an effective method of engaging communities in geo-literacy activities; (2) increase geo-literacy knowledge and advocacy skills of ISLT participants; (3) produce and disseminate geo-literacy educational materials and resources (e.g., place-based teaching guides, geospatial data systems, educational apps, 2-D and 3-D models, and digital maps); and (4) provide evidence that FAS residents use these geo-literacy educational materials and resources to positively influence decision-making.
DATE:
-
TEAM MEMBERS:
Corrin BarrosKoh Ming WeiDanko TabrosiEmerson Odango
In this article, we invite you to expand your vision of what it means to work at the intersections of formal and informal science and literacy education by describing how educators have collaborated to create programs that blend science and literacy in schools, in museums, and across these two spaces. In 2012, K–12 teachers from the National Writing Project (NWP) began working with the Association of Science-Technology Centers (ASTC) and science museum educators in the National Science Foundation–funded Intersections project, which is being evaluated by Inverness Research. NWP is a network
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. Makerspaces are social spaces with tools, where individuals and groups conceptualize, design, and make things using new and old technologies. Literacy practices are the ways people use representational texts to navigate and make sense of their worlds. They are used in particular contexts with particular goals. By “representational texts” we mean written words, talk, photographs, diagrams, videos, schematics, computer code, electrical circuit diagrams
Math off the Shelf (MotS) was designed to help those who work in public libraries put math into what they do with grades K-6 children and their families. Public libraries exist in virtually every community in the nation, and increasingly, families rely on them as a free, safe place for children to spend time in the absence of other care. As such, they are an ideal venue for reaching a large and diverse population with math. MotS has: (1) developed research-based English/Spanish materials for informal educators working in public libraries, available for free online (2) supported implementation and institutionalization at libraries across the nation (3) engaged informal educators working in libraries in conducting outreach via state and national library association meetings, webinars, and community and youth agencies (4) conducted evaluation on project impact, as described in the summative evaluation report attached. Dissemination to professional communities will constitute the remaining project work. External evaluation, conducted by Char Associates, identified dramatic changes in attitudes about math and its role in the library, in the amount of math that librarians offer to children and families, and in librarians' communication about math with patrons and peers. Development partners include the library systems of Queens NY, San Jose CA, St Louis MO, Westchester County NY, and dozens of libraries in AZ, CT, FL, and MA.
This project is a full-scale development project that builds upon a pilot program funded by the NSF in 2007 (LEAP into Science/Pilot), developed by The Franklin Institute (FI) in collaboration with The Free Library of Philadelphia. By connecting children’s literature and hands-on science activities in out-of-school settings, LEAP/Pilot has promoted student and family engagement in science and literacy in Philadelphia for over six years. In 2011, a cohort of ten national sites joined the initiative to pilot LEAP into Science resources in multiple out-of-school time contexts and within unique institutional partnerships. The 10 sites, consisting of 27 institutional partnerships representing a diverse group of organizations (museums, libraries, K-12 school districts, universities, and public media). Through continued collaboration in Philadelphia and with these national cohort sites, LEAP into Science: Engaging Diverse Community Partners in Science and Literacy is leveraging the relationships, experiences, and resources initiated in LEAP /Pilot to address the needs of new audiences, meet partners’ requests for enhanced professional development, and study the efficacy of this program in different out-of-school time structures and populations across the country. The result will be an adaptable program that more effectively reaches diverse audiences in science and literacy through community partners, as well as a stronger understanding of implementation for improved sustainability.
Mother Goose Asks Why? is a program of the Vermont Center for the Book currently being brought to 1200 parents in Vermont. Centered around exemplary children's literature and science activities, the program provides a series of four reading/discussion/activity sessions to parents of preschool children. Through exploration of basic questions such as "What Is It?", "How Many?", and "How Do You Know?", parents gain experience, skills, and confidence to introduce science to their 3-7 year old children. The Vermont Center hopes to expand this program to twelve additional states, the District of Columbia, and the U.S. Virgin Islands. Before initiating this expansion, however, the Center needs to address two issues: 1) how to create appropriate strategies for reaching, recruiting, and retaining families in locations that are quite different from Vermont, and 2) how to create an evaluation strategy that will assess parental behavior and attitudinal changes over time. Toward this end, the Center will gather representatives from the participating expansion sites and experts in family outreach to examine local issues and differences, to establish local contacts, and to begin development of effective implementation strategies for the sites. They also will work with The Network, Inc., a national education evaluation and research organization, to produce concrete measurements for parental behavior changes.
DATE:
-
TEAM MEMBERS:
Sally AndersonJoan NagyGregory DeFrancis