This is the summative evaluation report for the “Understanding the Physics of Collaborative Design and Play,” a collaboration between researchers and children’s museum practitioners to design and build a physics-based children’s museum exhibit to provide opportunities for children and their caregivers to tinker with play related to the STEM concepts of momentum, mass, velocity, friction, and balance in the context of informal learning related to skateboarding. The exhibit, “The Science of Skateboarding” at the Iowa Children’s Museum, was designed and fabricated as a result of this grant.
In
DATE:
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This study explored the effect of depth of learning (as measured in hours) on creativity, curiosity, persistence and self-efficacy. We engaged ~900 parents and 900 students across 21 sites in Washington, Chicago, Los Angeles, New York, Alabama, Virginia and the United Arab Emirates, in 5-week (10-hr) Curiosity Machine programs. Iridescent trained partners to implement the programs. Thus, this analysis was also trying to establish a baseline to measure any loss in impact from scaling our programs and moving to a “train-the-trainer” model. We analyzed 769 surveys out of which 126 were paired. On
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will develop and test intergenerational science media resources for parents that are participating in adult education programs and their young children. The materials will build on the research-based and successful children's television program, Fetch with Ruff Ruffman. The target audience includes parents enrolled in adult education programs who lack a high school diploma or are in English as a Second Language classes. These resources will support parents' engagement in science activities with their children both in the adult education settings as well as at home. Adult and family educators will receive professional development resources and training to support their integration of the parent/child activities. Project partners include the National Center for Families Learning, Kentucky Educational Television, and Alabama Public Television,
The goals of the Ruff Family Science project are to: (1) investigate adult education settings that feature an intergenerational learning model, in order to learn about the unique characteristics of adults and families who are enrolled in these programs; (2) examine the institutional circumstances and educator practices that support joint parent/child engagement in science; (3) iteratively develop new prototype resources meet the priorities and needs of families and educators involved in intergenerational education settings; and (4) develop the knowledge needed to create a fuller set of materials in the future that will motivate and support diverse, low-income parents to investigate science with their children. The research strategy is comprised of three main components: Phase 1: Needs Assessment: Determine key motivations and behaviors common to adult education students who are also parents; surface obstacles and assets inherent in these parents' current practices; and examine the needs and available resources for supplementing parents' current engagement in family science learning. Phase 2: Prototype Development: Iteratively develop two prototype Activity Sets, along with related educator supports and training materials, designed to promote joint parent-child engagement with English and Spanish-speaking families around physical science concepts. Phase 3: Prototype Field Test: Test how the two refined prototype Activity Sets work in different educational settings (adult education, parent education, and parent and child together time). Explore factors that support or impede effective implementation. Sources of data for the study include observations of adult and parent education classes using an expert interview protocol, focus groups, adult and family educator interviews, and parent surveys.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
EDC’s Center for Children and Technology (CCT), a nonprofit research and development organization (cct.edc.org), conducted the formative evaluation of the BAS project for the last three years. Iridescent has assisted CCT researchers in the successful implementation of the evaluation (e.g., organizing site visits and meetings with partners, administering surveys, collecting consent forms). As discussed in more details below, Iridescent has always taken seriously the evaluation findings and recommendations, and has acted upon them to make program improvements. This research partnership has led
In this article, Jacksonville State University's Stephen Bitgood discusses an evaluation study of a "Falling Feather" gravity-themed exhibit at a science museum. Bitgood shares key findings from the evaluation, which revealed several problems with the exhibit.
This article highlights findings from a study conducted by researchers at Jacksonville State University that assessed group visitor behavior at four exhibits at the Anniston Museum of Natural History. Researchers studied if male and female adults behave differently at exhibits when they are with a child than when they are with another adult as well as whether or not adult behavior was consistent across different types of exhibits.
DATE:
TEAM MEMBERS:
Stephen BitgoodChifumi KitazawaAndrea CavenderKaren Nettles
In 2012, Concord Evaluation Group (CEG) conducted an evaluation of the impact of Peep and the Big Wide World (Peep) resources on Spanish-speaking families with preschool-aged children. The three-pronged evaluation included a National Family Study in which 112 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who did not use the Peep resources. It also included an In-Depth Family Study -- an experiment conducted in the metro Boston area in which 36 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who
Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
The EDC Center for Children and Technology (CCT), a nonprofit international research organization, conducted the formative evaluation of the first year's implementation of the Be A Scientist! (BAS) project. The goal of this five-year afterschool family science program project is to provide quality science and engineering courses to underserved families in New York City and Los Angeles. It targeted underserved first graders and their families in the Spring 2010. Guiding by formative research questions (e.g., X) and using multi-method research approach (e.g., X), CCT researchers uncovered
Visitors to the Science Museum of Minnesota provided feedback on the books, How Small Is Nano? and Is That Robot Real? in order to assess the books and their ability to impart knowledge of nanoscience. The visitors, 63 adults in all, read one of the books to the child or children accompanying them, then answered a series of questions about their experience including their interest in and enjoyment of the book they read, as well as the age appropriateness of the book. The report compares and contrasts the two books throughout.