This NSF INCLUDES Design and Development Launch Pilot will improve math achievement among elementary school students of color in public schools in Albuquerque, New Mexico. Recognizing the need to coordinate efforts related to students' math and science achievement, key stakeholders formed the NM STEM Ecosystem, a dynamic network of cross-sector partners committed to making real impact on STEM education and degree attainment in Albuquerque. The NM STEM Ecosystem identified the math achievement gap between low-income students of color and their more economically-advantaged peers as the Broadening Participation (BP) Challenge it would address first. While math achievement gaps between students of color and Caucasian students appear nationally, the situation is particularly dire in New Mexico. In order to keep doors open to future STEM careers, it is crucial that learning pathways for math are articulated early and that these pathways honor families' cultural ways of knowing. The innovative strategy of Math Families & Communities Empowering Student Success (Math FACESS) is to use a collective impact approach to close the math achievement gap by connecting formal and informal STEM educators around a coherent, multi-faceted program of early mathematics teaching and learning that empowers parents and teachers to support children's mathematical development. Implementation of Math FACESS includes four major components: 1) Teachers at two pilot schools will participate in professional development related to Math Talk and Listening; 2) Parents at the pilot schools will participate in parent workshops and community-based activities focused on supporting their children's math achievement; 3) Project partners will implement community-based family activities organized around a theme of Twelve Months of Math; and 4) Ecosystem partners will study what worked and what didn't, in order to identify best practices that can be shared with system leaders to scale effective practices and increase impact.
The near-term objectives for Math FACESS are: 1) improve students' attitudes, practices, and achievement in math; 2) improve parents' attitudes, practices, and confidence in math and increase their utilization of family math resources; 3) improve data-sharing among partners related to math participation and achievement; and 4) create pathways within the Ecosystem for family math learning. The effectiveness of the collective impact model and impacts on partner organizations also will be assessed. Through the math FACESS Launch Pilot, the NM STEM Ecosystem plans to: 1) demonstrate the power of a collective impact social innovation framework to address a systemic community condition -- in this case, the math achievement gap; 2) contribute to theory-of-change research that demonstrates student achievement can be affected by working with parents and teachers; and 3) provide a model that values different ways of knowing and uses cultural context in the design of STEM learning opportunities for students, families, and schools.
DATE:
-
TEAM MEMBERS:
Joe HastingsArmelle CasauObenshain KorenKersti TysonAngelo Gonzales
WNET, working with Education Development Center, will lead a small scale Innovations in Development effort to develop, research, and evaluate a new model to engage underserved families in STEM learning. The new endeavor, Cyberchase: Mobile Adventures in STEM, will build on the proven impact of the public media mathematics series Cyberchase and the growing potential of mobile technology and texting to reach underserved parents. WNET will produce two new Cyberchase episodes for 6-9 year olds, focused on using math to learn about the environment. Drawing on these videos and an existing Cyberchase game, the team will produce a bilingual family engagement campaign that will combine an in-person workshop followed by a 6-8 week "text to parent" campaign, in which parents receive weekly text messages suggesting family STEM activities related to the media content. The engagement model will be piloted in three cities with large low-income/Latino populations, along with one texting campaign offered without the workshop. This project will build knowledge about how to deploy well-designed public media assets and text messaging to promote fun, effective STEM learning interactions in low-income families. While past research on educational STEM media has tended to focus on children, especially preschool age, this project will focus primarily on text messaging for parents, and on learners age 6-9, and the wider scope of parent/child STEM interactions possible at that age.
The primary goal of the project will be to develop, test and refine a family engagement model that includes a face-to-face workshop, rich narrative Cyberchase content, and text-message prompts for parents to engage in short, playful STEM activities with children. The project team will explore which features of the mobile text-and-media program have most value for low-income and Latino families and prompt STEM learning interactions, including a comparison of workshop-based and text-only variants. The project will have three phases: needs assessment and preliminary design; an early-stage test in New York and development and testing of media; and three late-stage tests in contrasting locations, two including workshops and one "text-only," and analysis of findings. Ultimately, the project will share knowledge with the field about the opportunities and challenges of using mobile texting and public media to reach underserved families effectively. This knowledge will also inform a future proposal for production and outcomes research, which, based on the study results, may include a scaled-up version in ten locations and a ten-city Randomized Control Test. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The Peg + Cat ELM2 project sought to combine robust media-integrated teacher training in both math content and facilitation of classroom and family engagement activities with transmedia resources that parents and children could utilize at home. This cohesive approach resulted in increases in teachers’ confidence in and knowledge about their mathematics instruction, parents’ engagement in activities and conversations with their children around math, and children’s positive and persistent attitudes towards math, as reported by their parents. Taken together, these findings suggest that the Peg +
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
This project will capitalize on the power of story to teach foundational computational thinking (CT) concepts through the creation of animated and live-action videos, paired with joint media engagement activities, for preschool children and their parents. Exposure at a young age to CT is critical for preparing all students to engage with the technologies that have become central to nearly every occupation. But despite this recognized need, there are few, if any, resources that (1) introduce CT to young children; (2) define the scope of what should be taught; and (3) provide evidence-based research on effective strategies for bringing CT to a preschool audience. To meet these needs, WGBH and Education Development Center/Center for Children and Technology (EDC/CCT) will utilize an iterative research and design process to create animated and live-action videos paired with joint media engagement activities for parents and preschool children, titled "Monkeying Around". Animated videos will model for children how to direct their curiosity into a focused exploration of the problem-solving process. Live-action videos will feature real kids and their parents and will further illustrate how helpful CT can be for problem solving. With their distinctive visual humor and captivating storytelling, the videos will be designed to entice parents to watch alongside their children. This is important since parents will play an important role in guiding them in explorations that support their CT learning. To further promote joint media engagement, hands-on activities will accompany the videos. Following the creation of these resources, an experimental impact study will be conducted to capture evidence as to if and how these resources encourage the development of young children's computational thinking, and to assess parents' comfort and interest in the subject. Concurrent with this design-based research process, the project will build on the infrastructure of state systems of early education and care (which have been awarded Race to the Top grants) and local public television stations to design and develop an outreach initiative to reach parents. Additional partners--National Center for Women & Information Technology, Code in Schools, and code.org (all of whom are all dedicated to promoting CT)--will further help bring this work to a national audience.
Can parent/child engagement with digital media and hands-on activities improve children's early learning of computational thinking? To answer this question, WGBH and EDC/CCT are collaborating on a design-based research process with children and their parents to create Monkeying Around successive interactions. The overarching goal of this mixed-methods research effort is to generate evidence that supports the development of recommendations around the curricular, instructional, and contextual factors that support or impede children's acquisition of CT as a result of digital media viewing and hands-on engagement. Moving through cycles of implementation, observation, analysis, and revision over the course of three years, EDC/CCT researchers will work closely with families and WGBH's development team to determine how children learn the fundamentals of CT, how certain learning tasks can demonstrate what children understand, how to stimulate interest in hands-on activities, and the necessary scaffolds to support parental involvement in the development of children's CT. Each phase of the research will provide rich feedback to inform the next cycle of content development and will include: Phase 1: the formulation of three learning blueprints (for algorithmic thinking, sequencing, and patterns); Phase 2: the development of a cohesive set of learning tasks to provide evidence of student learning, as well as the production of a prototype of the digital media and parent/child engagement resources (algorithmic thinking); Phase 3-Part A: pilot research on the prototype, revisions, production of two additional prototypes (sequencing and patterns); Phase 3-Part B: pilot research on the three prototypes and revisions; and Phase 4: production of 27 animated and live-action videos and 18 parent/child engagement activities and a study of their impact. Through this process, the project team will build broader knowledge about how to design developmentally appropriate resources promoting CT for preschool children and will generate data on how to stimulate interest in hands-on activities and the necessary scaffolds to support parental involvement in the development of children's CT. The entire project represents an enormous opportunity for WGBH and for the informal STEM media field to learn more about how media can facilitate informal CT learning in the preschool years and ways to broaden participation by building parents' capacity to support STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The animated series PEEP and the Big Wide World (PEEP), developed by WGBH Boston, is designed to teach science and math to children aged three to five years old. WGBH recently completed a total redesign of the PEEP website that was intended make the site more accessible to Spanish-speakers, more supportive of extended informal science and math exploration, and more functional for users of tablets and mobile devices. This work included:
• The transformation of PEEP into a fully dual language website via the translation of all games and website text into Spanish and the debut of a new Spanish
Pacific Science Center will expand its Science, Technology, Engineering and Math—Out-of-School Time (STEM-OST) model to new venues in the Puget Sound region to improve science literacy and increase interest in STEM careers for youth. STEM-OST brings hands-on lessons and activities in physics, engineering, astronomy, mathematics, geology, and health to elementary and middle school children in underserved communities throughout the summer months. The center will modify lessons and activities to serve students in grades K-2, align the curriculum with the Next Generation Science Standards, and increase the number of Family Science Days and Family Science Workshops offered to enhance parent involvement in STEM learning. The program will employ a tiered mentoring approach with outreach educators, teens, and education volunteers to increase interest in STEM content and provide direct links between STEM and workforce preparedness.
WGBH Educational Foundation will create PEEP'S WORLD/EL MUNDO DE PEEP, a Web-based "Digital Hub," in both English and Spanish, to significantly increase the impact of the extensive collection of proven preschool science and math assets from the Emmy Award-winning TV show PEEP AND THE BIG WIDE WORLD®. This project will: (1) redesign the PEEP Web site, creating interactive media experiences that will contextualize existing content and take advantage of new Web design; (2) provide professional development for preschool educators; and (3) reach a new audience of family childcare educators, one that is woefully underserved when it comes to educational resources about science. Dissemination through a network of national organizations, including National Association of Family Child Care, National Association of Child Care Resource and Referral Agencies, National Head Start Association, National Education Association, AVANCE, and Committee for Hispanic Children and Families, will help engage the maximum number of educators and parents in the project. PEEP'S WORLD/EL MUNDO DE PEEP will provide resources for targeted audiences. Specifically these resources will provide: Children with multiple ways to engage with science or math content areas, including interactive games, animated stories, and live-action videos; Parents with guided experiences to facilitate their child's math and science play; Center-based preschool educators with a media-rich, year long science curriculum and professional development materials; and Family childcare educators with curriculum modules, integrated with media, focused on six science content areas, and professional development materials for home-care settings in English and in Spanish. The University of Massachusetts's Donahue Institute will conduct a formative evaluation of the family childcare educator resources: 200 Spanish-speaking and 200 English-speaking educators will pilot the curriculum modules and professional development videos. Concord Evaluation Group, Inc. will conduct a summative evaluation, consisting of a Family Web Site Experiment and a National Observational Study, to assess the extent to which the project is successful at achieving its intended impacts. A multifaceted national dissemination plan will include a robust social media strategy, implemented by a Spanish-speaking online community manager, to reach parents, and collaborations with early childhood education statewide systems to reach educators. The projects intended impacts are to: (1) help English- and Spanish-speaking preschoolers effectively apply science and mathematical inquiry and process skills; (2) empower English- and Spanish-speaking parents to feel more equipped and inclined to facilitate science and math exploration with their preschoolers; and, (3) provide center-based and family childcare educators with resources for incorporating math and science into their curricula and boosting their confidence in teaching these subjects. While many parents know how to read to their children, they do not typically know how to approach science or math investigations with their pre-schoolers. After parents, preschool educators are the most important promoters of a young child\'s learning. Yet, center-based and family childcare educators do not receive significant training in science, and thus lack confidence when conducting preschool science activities. By providing parents and educators resources for approaching preschool science and math, which meet their specific needs, PEEP will help alleviate these challenges.
This poster from the 2014 AISL PI Meeting presents Peg + Cat, a research and development project that explores the mechanisms that initiate and support innovation in early childhood education, especially by combining informal learning via public media and technology with teacher and family interactions to maximize children's math learning.
This research and development project explores the mechanisms that initiate and support innovation in early childhood education, especially in combining informal learning via public media and technology with teacher and family interactions to maximize children's math learning. Deliverables include 27 episodes of Peg+Cat, an animated math adventure series on PBS, 8 related online games and apps, summer math institutes and school-year training for preschool/Head Start teachers, and complementary activities and resources to support parent's knowledge and practice and student's engagement, interest, and learning of foundational math concepts. The research agenda will test several hypotheses regarding the strategies to extend teacher's math content knowledge and pedagogy and parent/ caregiver's understanding and valuing of math. A key question will focus on how coupled learning opportunities (professional development for teachers, transmedia, and support for families) enable and sustain children's engagement and learning in math. Formative evaluation of the media components will use focus groups of 3-5 year olds to assure develerables are engaging and accessible. The summative evaluation by Rockman et al will focus on how well the project met its overall goals including the project implementation, and impacts on Head Start teachers, parents/caregivers, and preschoolers. The project's transmedia deliverables will reach millions of preschoolers through daily PBS broadcasts and online games and apps. Fifty Head Start teachers will participate in the two-year professional development program and will be using new content knowledge and pedagogy to teach 550 Head Start children in southwest Pennsylvania and engage their parents/caregivers. The Head Start infrastructure will provide further dissemination of the project's findings and resources.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
In this article, Jeff Hayward of People, Places & Design Research outlines the evaluation process by summarizing the evaluation of "The Estimating Game," a traveling exhibit developed by the Children's Museum of Boston. The study assessed the effectiveness of the exhibit as installed at the Children's Museum, the effectiveness of "mock-ups" of parts of the exhibit as they were developed, and the effectiveness of teaching children the concept of estimating.