The following summative report describes overarching evaluation findings from the evaluation of Leap into Science, including future considerations for the Leap into Science program team (program team). The report aims to summarize takeaways from 2018-2023 and report on overall insights pertaining to the core evaluation questions of interest.
Tinkering experiences in informal learning spaces can engage families in engineering practices and support learning (Pagano et al., 2020). Further, reflections after informal learning experiences can reveal and extend children’s memory and learning (Pagano et al., 2019), but reflections vary by age, culture, setting, program, and other factors (Fivush et al., 2006). We examined how the conversational structure and engineering content of families’ reflections vary across multiple museum visits and across different types of tinkering programs (e.g., open-ended vs. function-focused).
Tinkering activities designed for parents and children can foster spatial thinking, which benefits spatial skill development (Ramey et al., 2020). During tinkering activities, families may be challenged to use tools and materials to solve open-ended problems (Bevan, 2017). The problems specified by different tinkering challenges can highlight intrinsic or extrinsic spatial information (Chatterjee, 2008; Mix et al., 2018). In this project we asked, how does the spatial information highlighted by a tinkering challenge affect the quality of families’ spatial thinking?
DATE:
TEAM MEMBERS:
Naomi PolinskyElena FiegenKaitlyn HurkaCatherine HadenDavid Uttal
The tinkering process of making, testing, and iteratively redesigning projects can teach children about engineering concepts (Marcus et al., 2021; NGSS, 2013), but there is variability in how tinkering programs are designed. Storytelling may make children’s learning experiences personally meaningful and narratively organized, thereby supporting memory (Bruner, 1996). We designed multiple story-based tinkering programs and examined how the types of story characters and goals introduced in the tinkering programs would relate to the content of families’ talk in post-tinkering reflections.
In this project, we asked whether storytelling during tinkering might support children’s engagement in STEM and how that may differ across boys and girls. According to Bruner (1996), stories can help children to organize experiences by adding coherence, increasing understanding, and facilitating learning. We observed associations between story and STEM in two contexts: home and museum exhibit.
Given the important role of autonomy support in children’s motivation and learning, this study asked whether parents’ use of autonomy supportive language (vs. controlling language) was associated with children’s engagement in science, technology, engineering, and mathematics in a bi-directional manner during an at-home tinkering activity.
We present the assets that collaboration across a land grant university brought to the table, and the Winterberry Citizen Science program design elements we have developed to engage our 1080+ volunteer berry citizen scientists ages three through elder across urban and rural, Indigenous and non-Indigenous, and formal and informal learning settings.
DATE:
TEAM MEMBERS:
Katie SpellmanJasmine ShawChristine VillanoChrista MulderElena SparrowDouglas Cost
We used a youth focused wild berry monitoring program that spanned urban and rural Alaska to test this method across diverse age levels and learning settings.
DATE:
TEAM MEMBERS:
Katie SpellmanDouglas CostChristine Villano
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
Children’s and parents’ spatial language use (e.g., talk about shapes, sizes and locations) supports children’s spatial skill development. Families use spatial language during playful construction activities. Spatial language use varies with construction activity design characteristics, such as the activity’s play goals. What is the connection between the building materials used and the spatial conversations families have during a construction activity?
DATE:
TEAM MEMBERS:
Evan VlahandreasClaire MasonNaomi PolinskyDavid UttalCatherine Haden