Most students who pursue math have chosen to do so by high school. Elementary and middle school experiences are thus vitally important in attracting students to STEM. Research consistently points to after-school as a golden opportunity to increase students' exposure to high-quality math learning opportunities and to develop the key influencers of math participation and persistence: interest and identity. However, more research on how and under what conditions after-school programs can foster these factors is needed. The role of identity in math education has been particularly neglected. The proposed research project addresses this gap by studying the implementation and outcomes of After-School Math PLUS (ASM+), an after-school math program designed to address all aspects of math identity and thus have a positive effect on this key influencer of math participation and achievement. "Improving Math Identity" is a Research-in-Service to Practice project funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. The team will study the impact of ASM+ through a rigorous randomized controlled trial of 30 elementary-level after-school sites in South Carolina serving predominately low-income and minority students (15 treatment using ASM+; 15 control using Mixing in Math). Sites selected into the study must serve fourth and fifth graders and must operate five days a week. Through an implementation study, data will be collected in order to assess the program and understand the experiences of group leaders and students in the ASM+ program and at comparison sites. Data sources include surveys, interviews, observations, and administrative data collected from the treatment and control sites. The study will investigate how and to what extent ASM+ develops fourth and fifth grade students' math identity and increases math engagement and interest. It will explore whether increasing identity, engagement, and interest leads to greater skill development and academic achievement. This research is being conducted by IMPAQ International LLC, a social science and public policy research and evaluation firm in collaboration with Educational Equity at FHI 360, a global development and education organization. The research addresses the need to enhance students' math identity at an early age and, as a result, change students' educational and career aspirations. The ultimate goal is to broaden participation in STEM by underrepresented groups. Results will inform the development of interventions designed to motivate and retain students in STEM, particularly in informal settings. Knowledge gained from this research will be broadly disseminated to practitioners, researchers, program developers, and policy makers.
DATE:
-
TEAM MEMBERS:
Cheri FancsaliMerle FroschlBarbara Sprung
Research shows that participation and interest in science starts to drop as youth enter high school. This is also the point when science becomes more complex and there is increased need for content knowledge, mathematics capability, and computer or computational knowledge. Evidence suggests that youth who participate in original scientific research are more likely to enter and maintain a career in science as compared to students who do not have these experiences. We know young people get excited by space science. This project (STEM-ID) is informed by previous work in which high school students were introduced to scientific research and contributed to the search for pulsars. Students were able to develop the required science and math knowledge and computer skills that enabled them to successfully participate. STEM-ID builds on this previous work with two primary goals: the replication of the local program into a distributed program model and an investigation of the degree to which authentic research experiences build strong science identities and research self-efficacies. More specifically the project will support (a) significant geographic expansion to institutions situated in communities with diverse populations allowing substantial inclusion of under-served groups, (b) an online learning and discovery environment that will support the participation of youth throughout the country via online activities, and (c) opportunities for deeper participation in research and advancement within the research community. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and understanding of, the design and development of STEM learning in informal environments. STEM-ID will serve 2000 high school youth and 200 high school teachers in afterschool clubs with support from 30 undergraduate and graduate students and 10 college/university faculty. Exploratory educational research will determine the broad mechanisms by which online activities and in-person and online peer-mentor teacher-scientist interactions influence science identity, self-efficacy, motivation, and career intentions, as well as a focused understanding of the mechanisms that influence patterns of participation. Youth will be monitored longitudinally through the first two years of college to provide an understanding of the long-term effects of out-of-class science enrichment programs on STEM career decisions. These studies will build an understanding of the best practices for enhancing STEM persistence in college through engagement in authentic STEM programs before youth get to college. In addition to the benefits of the education research, this program may lead participants to discover dozens of new pulsars. These pulsars will be used for fundamental advances such as for testing of general relativity, constraining neutron star masses, or detecting gravitational waves. The resulting survey will also be sensitive to transient signals such as sporadic pulsars and extragalactic bursts. This project provides a potential model for youth from geographical disparate places to participate in authentic research experiences. For providers, it will offer a model for program delivery with lower costs. Findings will support greater understanding of the mechanisms for participation in STEM. This work is being led by West Virginia University and the National Radio Astronomy Observatory. Participating sites include California Institute of Technology, Cornell University, El Paso Community College, Howard University, Montana State University, Penn State University, Texas Tech University, University of Vermont, University of Washington, and Vanderbilt University.
This Small Business Innovation Research (SBIR) Phase I project will demonstrate the feasibility of engaging children ages 8 to 13 in the wonders of science and the application of scientific principles through the transmedia SCIENTASTIC! project. The study will also demonstrate that the television series will help students answer questions and solve problems for themselves and their community. The American public supports the advancement of scientific knowledge and our investment in scientific research leads the world. However, Americans are falling behind in educating the next generation of scientists. Late elementary school is an ideal time to capture students' attention and engage them in STEM activities. Using rigorous evaluation techniques we will show that SCIENTASTIC! encourages hands-on learning by exploration, questioning and thinking. The innovative television program and integrated companion resources provide scientific role models and demonstrate the scientific process in an entertaining way. The associated web site, Apps, Web 2.0 repository and teaching aids allow students, teachers, and parents to further explore concepts introduced in the show. Preliminary analysis reveals that the SCIENTASTIC! target audience liked the show, would watch the show and learned from the show. Further analysis will demonstrate that the transmedia approach increases viewer interest and learning. The broader impact/commercial potential of this project will play a transformative role in encouraging students to take STEM courses in college, pursue scientific careers, and become a scientifically informed electorate. By developing the story beyond the story, transmedia SCIENTASTIC! has strong commercial value. Dissemination through public television allows for a potential audience of 250 million people. Commercial and noncommercial sponsorships will be sold with associated on-air credits. Additional direct funding will be sought from industries with interests in promoting science and health literacy. A commercial version of the program will be offered to cable networks on a licensing basis, with DVDs, Apps and study guides sold to schools, homeschoolers, and parents. With a broad and commercially viable dissemination, SCIENTASTIC! will show children the joys of science by demonstrating and engaging in hands-on, team- based learning in real-world contexts. This process will improve student retention and will show that SCIENTASTIC! introduces new ways to learn. The SCIENTASTIC! project will evaluate teaching techniques information that will be shared with policy-makers, educational institutions, and teachers to improve education nationwide. By spreading successful methods for engaging children in math and science, SCIENTASTIC! shoiuld have significant societal benefit creating a generation of scientifically educated decision-makers.
Planet Earth Television (PET) created Scientistic!, a television series that focuses on a young girl's scientific investigations of the world around her. The pilot episode, Sticks and Stones, explored bones and how they heal. A website and iPad app were also developed to supplement the program. REA evaluated the impact of the television program, website, and app on youth's knowledge about and interest in science and specific topics related to bone health and healing. REA recruited youth (grades 1-7) to participate either at home with their families or in a classroom with their teachers. REA
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will develop and research an integrated children's media and early childhood educator professional development strategy to prepare preschoolers with social-emotional skills that provide a foundation for later math learning success. The social-emotional skills include persistence, risk-taking, regulating anxieties, and collaborating to solve problems. Media components include Peg+Cat television episodes, videos, games and apps distributed through PBS broadcast and online. The integrated professional development model is designed to impact these educators' understanding of math and develop their skills for fostering in children a positive math mindset. Additional resources include a new Peg+Cat summer day camp at the Carnegie Science Center in Pittsburgh. The project partners include a media company, The Fred Rogers Company; researchers at the University of Pittsburgh and St. Vincent College; and the evaluator, Rockman et al. This project is unique in its focus on integrating social-emotional skills with early math learning and educator skill development. It will fill an important niche in the research literature and has the potential to impact media practice which is undergoing significant change as new digital tools and technologies become available for learning. Both standardized and researcher-developed measures will be used to assess learning outcomes, including early childhood educators' attitudes and quality of instruction, as well as children's interest and engagement in math. The research design includes iterative data collection to inform the development and refinement of the professional learning for teachers. The mixed methods approach will include classroom observations, interviews and focus groups with educators, and parent questionnaires. Key questions include: does exposure to Peg+Cat positively relate to children's use of social-emotional skills during math learning activities? Does educators' exposure to the professional development training improve their attitudes and abilities to infuse math instruction with social-emotional skills? Does having an educator who received Peg+Cat training impact children's engagement and interest in math?
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project is a time sensitive educational response to the 7.8 magnitude earthquake that struck Nepal on April 25, 2015 and was followed by major aftershocks. This project builds on the intense worldwide interest in that disaster by developing and distributing media resources for the public and educators explaining the scientific research into tectonic and fluvial processes of this highly vulnerable region encompassing the Himalayas of Nepal, the Ganges-Brahmaputra River Delta of Bangladesh and India, and the mountains of northeastern India. Project deliverables include PBS NewsHour broadcasts and online stories, short videos for classroom use, 3D/2D videos for public screenings in museums, Earth Magazine blogs and articles, and DVDs. Making new research understandable and accessible to the public is an important activity of the U.S. research enterprise. NSF is making a substantial investment in earth sciences research to increase knowledge of the conditions and processes that periodically cause earthquakes, landslides, and flooding. This education project leverages those investments and the public interest in the recent Nepal earthquake with a major public engagement opportunity that has the potential for reaching millions of students, teachers, and the public both in the U.S. and in other vulnerable regions.
Capitalizing on the appeal of the PBS KIDS project PLUM LANDING, PLUM RX will research and develop resources to help families and educators infuse environmental science learning into outdoor prescription programs, while ensuring they are appropriate for broad use in other informal settings. The growing outdoor prescription movement is designed to increase the amount of time children spend outside in nature. Programs are structured so that health care providers write "prescriptions" for children to engage in outdoor activity, and informal educators "fill" these prescriptions by facilitating youth and family participation in outdoor activities. There is preliminary evidence that these programs are getting kids outside, but best practices for transitioning "get outside" programs to become "get outside and learn about the environment" programs remain unidentified. PLUM RX is designed to build this knowledge and create resources that are responsive to the needs of both English and Spanish-speaking urban families. The project will work with informal educators and families through multiple cycles of implementation and revision, testing and refining PLUM LANDING resources (animations, videos, games, hands-on science activities, and support materials for informal educators and families), with the goal of designing an effective and accessible PLUM RX Toolkit for national dissemination. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. The proposed research is designed to ensure that the PLUM RX Toolkit--the resources and support materials--will meet the needs of educators working in non-specialized urban settings. Education Development Center (EDC) and WGBH developers will collaborate on design-based research at three urban outdoor prescription programs serving low-income families: Philadelphia Nature Rx in Philadelphia, PA; Outdoors Rx in Boston, MA; and Portland Rx Play in Portland, OR. Moving through cycles of implementation, observation, analysis, and revision, the research team will work closely with educators, families, and developers to determine how the programmatic and structural features of the learning environment, the actions of the educators, and the intervention itself can most effectively support children and families' outdoor exploration in urban contexts. Toolkit materials will include resources for kids and families (including Spanish-speaking families) and informal educators (including those who work with families and directly with children in out-of-school settings). Directors from the three urban outdoor prescription programs will contribute to every phase of the research process, including recruiting families and youth who will participate in a weekly sequence of activities. The overarching focus of the analysis process will be on systematically describing the interaction between two dimensions of implementation: What happened during pilot implementations, and the factors that constrained or supported implementation as planned; and the quality of what happened, which will be defined with reference to the intended impacts. EDC will use a structured descriptive coding process to analyze the qualitative evidence gathered through interviews and observations during design and testing periods. Products of the research activities will include: a series of formative memos to the development team; a report mapping changes made to PLUM RX Toolkit materials in response to formative input and the intended impact of those changes; and findings regarding commonalities and differences across sites in the interaction of local contextual factors and the implementation success of the PLUM RX Toolkit. Concord Evaluation Group (CEG) will provide independent, summative evaluation of the project. Through this process, PLUM RX will build broader knowledge about how to design educational resources, geared for both families and informal educators, which respond to the unique challenges of exploring environmental science in urban environments.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This research project leverages ongoing longitudinal research to investigate whether, and if so how, youth from ages 10 to 15 in a diverse, under-resourced urban community become interested and engaged in STEM. The project addresses a global issue; fewer youth choose to major in scientific fields or take science coursework at high school or university levels. These declining numbers result in fewer STEM professionals and fewer scientifically literate citizens who are able to function successfully in an increasingly scientific and technological society. These declines are observed for youth as a whole, but are most pronounced for girls and particular non-white ethnic minorities. Data collected from youth in this community of study, including non-white ethnic minorities, mirrors this decline. NSF funding will support a five-year systematic and systemic process in which project researchers work collaboratively with existing informal and formal educational partners (e.g., museums, libraries, afterschool providers, schools) to develop sets of customized, connected, and coordinated learning interventions, in and out of school, for youth with different backgrounds, needs, and interests, all with the goal of averting or dampening this decline of STEM interest and participation during early adolescence. In addition to new research and community STEM networks, this project will result in a Community Toolkit that includes research instruments and documentation of network-building strategies for use by other researchers and practitioners nationally and internationally. This mixed methods exploratory study has two distinct but interrelated populations - youth and educators from across informal and formal institutions. To develop a clearer understanding of the factors that influence youths' STEM interest development over time, particularly among three youth STEM Interest Profiles identified in a secondary analysis (1-Dislike Math, 2-Like all STEM, 3-Dislike all STEM), the design combines surveys with in-depth interviews and observations. To study educators and institutions, researchers will combine interviews, focus groups, and observations to better understand factors that influence community-wide, data-driven approaches to supporting youth interest development. Research will be conducted in three phases with the goal of community-level change in youth STEM interest and participation. In Phase 1 (Years 1 & 2) four educational partners will develop interventions for a 6th and 7th grade youth cohort that will be iteratively refined through a design-based approach. Educational partners and researchers will meet to review and discuss interest and participation data and use these data to select content, as well as plan activities and strategies within their programs (using a simplified form of conjecture mapping). By Phase 2 (Years 3 & 4) four additional partners will be included, more closely modeling the complex system of the community. With support from researchers support and existing partners, new educational partners will similarly review and discuss data, using these to select content, as well as plan activities consistent with program goals and strategies. Additional interventions will be implemented by the new partners and further assessed and refined with a new 6th and 7th grade cohort, along with the existing interventions of the first four partners. In Phase 3 (Year 5) data will be collected on pre-post community-level changes in STEM interest and participation and the perceived effectiveness of this approach for youth. These data will inform future studies.
Disparities in engineering participation and achievement by women and individuals from traditionally underserved racial and ethnic groups have been persistent. Approaches outside the context of university and school reform, including approaches to supporting interest development in early childhood, have not been fully considered by educators and policymakers. This AISL Pathways project will focus on engineering, which has emerged as a critical topic in the STEM education field and a prominent aspect of educational standards and policies. Building on a strong empirical and theoretical base, it will lay the foundation for future research efforts to advance the field's limited understanding of early childhood engineering-related interest development, especially through parent-child interactions; create research tools for studying engineering-related interest in young children; and identify effective strategies for supporting long-term engineering interest pathways. "Head Start on Engineering" is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Through an asset-based approach and authentic engagement with families and community organizations, Head Start on Engineering will pilot research and program activities that are sensitive to the constraints of low-income families and build on the resources and funds of knowledge within these communities. It will test and refine an innovative, theoretical model of early childhood interest development. The overall design of the pilot study will be mixed-method and short-term longitudinal, with data collected before, during, and after program implementation from participating families. Quantitative measures will allow for consistent comparisons across groups and within families, while qualitative data will help explore complex factors and processes hypothesized in the theoretical framework and related to program implementation. This work will allow the team time to address unanswered questions and issues around how to feasibly operationalize key aspects of the revised theoretical model in preparation for more extensive, longitudinal and experimental investigations as part of the next phase of the project. Understanding and honoring parents' beliefs, knowledge, and experiences is central to this project. In developing and implementing both the programs and research activities, the team will adopt culturally responsive and asset-based perspectives. The Pathways project is a collaboration between the Institute for Learning Innovation (ILI), a nonprofit organization dedicated to the advancement of lifelong, free-choice learning for all communities through research, practice, and policy initiatives; Mt. Hood Community College Head Start program; the Oregon Museum of Science and Industry (OMSI), a nationally renowned science museum; and the Center for STEM Education at the University of Notre Dame. The project involves families with four-year-old children who attend the Head Start program. The collaboration between educators, community organizations, and researchers and the integrated approach to research and program development will ensure that study findings translate to practical and effective education strategies and that future research efforts are well-grounded in the realities of practitioners and learners.
Over the last decade there has been a proliferation of out-of-school environments that foster building, making, tinkering, and design activities, creating an unprecedented opportunity to engage a wide range of participants in mathematics that is both purposeful and powerful. To date, this opportunity has been almost universally unexploited. The conference, which will take place at and in collaboration with the New York Hall of Science, will gather fifty researchers and practitioners from informal mathematics education and the burgeoning "making and tinkering" movement for two days to collaboratively generate approaches to integrating mathematics in making and design environments and programs. The project, which includes pre- and post-conference activities, will produce a sampler of Math in Making activities, a guidebook, a white paper for research and practice, a retrospective online discussion, and further dissemination of project deliverables. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. Through the conference and pre- and post-conference activities, the project team will: - Initiate and sustain conversations between researchers and practitioners; - Establish collaborations that lead to changes in the way math is framed and highlighted in making and design environments; - Create resources to help people in the making/design community highlight the math in their environments; and - Frame a research agenda to guide studies of mathematical reasoning and attitudes towards math in making and design environments. The work includes an extensive evaluation process of the conference and of pre- and post-conference activities.
The goal of the project is to research ways in which the teaching of basic computing skills can be integrated into after-school choral programs. The team will study how to adapt the interdisciplinary, computing + music activities developed to date in their NSF-funded Performamatics project with college-aged students to now introduce middle school-aged students to computing in an informal, after-school choral program. They will investigate how to leverage the universal appeal of music to help students who typically shy away from technical studies to gain a foothold in STEM (Science, Technology, Engineering, and Mathematics) by programming choral music. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The team will use a qualitative and quantitative, mixed-methods approach to study four research questions: (1) Can middle school-aged children follow the connections from singing to digitized sound to MIDI and back to music and learn to program using the songs they like to sing? To encourage students to become involved with manipulating sounds and programming music on their own computers, the approach will employ Audacity and Scratch, two free music recording, editing, and generation platforms. The team will study how well programming of music helps them acquire STEM skills by assessing the complexity and efficacy of the programs they can learn to code. (2) Can programming their individual parts help students learn to sing in three- and four-part harmony? The main focus is on learning of STEM, but research on this question will evaluate whether programming skills can help students learn about music too. (3) What resources, models, and tools (RMTs) are necessary to integrate STEM education into a middle school after-school choral program? The team will work with local middle schools to research techniques for integrating computing into after-school choral programs without disrupting their musical focus. They will identify what choral teachers need in order to do this integration, and they will devise and evaluate techniques for adding STEM skills to the students' choral experience. (4) Can the involvement of adults who match the students' racial and/or cultural backgrounds have a positive effect on the "people like me don't (or can't) do that?" belief that so often stifles efforts to attract underrepresented groups to STEM? They will actively seek to involve students of underrepresented groups in the program by recruiting adult role models from these groups who are involved with both music and computing. They will use attitudinal surveys to assess whether these adults have any effect on the students' self-efficacy and the "people like me" syndrome that hinders some from engaging in STEM.
A recent report by the Association for Computing Machinery estimates that by decade's end, half of all STEM jobs in the United States will be in computing. Yet, the participation of women and underrepresented groups in post-secondary computer science programs remains discouragingly and persistently low. One of the most important findings from research in computer science education is the degree to which informal experiences with computers (at many ages and in many settings) shape young people's trajectories through high school and into undergraduate degree programs. Just as early language and mathematics literacy begins at home and is reinforced throughout childhood through a variety of experiences both in school and out, for reasons of diversity and competency, formal experiences with computational literacy alone are insufficient for developing the next generation of scientists, engineers, and citizens. Thus, this CAREER program of research seeks to contribute to a conceptual and design framework to rethink computational literacy in informal environments in an effort to engage a broad and diverse audience. It builds on the concept of cultural forms to understand existing computational literacy practices across a variety of learning settings and to contribute innovative technology designs. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds new approaches to and evidence-based understanding of the design and development of STEM learning in these settings. This CAREER program of research seeks to understand the role of cultural forms in informal computational learning experiences and to develop a theoretically grounded approach for designing such experiences for youth. This work starts from the premise that new forms of computational literacy will be born from existing cultural forms of literacy and numeracy (i.e., for mathematical literacy there are forms like counting songs -- "10 little ducks went out to play"). Many of these forms play out in homes between parents and children, in schools between teachers and students, and in all sorts of other place between friends and siblings. This program of study is a three-phased design and development effort focused on key research questions that include understanding (1) how cultural forms can help shape audience experiences in informal learning environments; (2) how different cultural forms interact with youth's identity-related needs and motivations; and (3) how new types of computational literacy experiences based on these forms can be created. Each phase includes inductive research that attempts to understand computational literacy as it exists in the world and a design phase guided by concrete learning objectives that address specific aspects of computational literacy. Data collection strategies will include naturalist observation, semi-structured, and in-depth interviews, and learning assessments; outcome measures will center on voluntary engagement, motivation, and persistence around the learning experiences. The contexts for research and design will be museums, homes, and afterschool programs. This research builds on a decade of experience by the PI in designing and studying computational literacy experiences across a range of learning settings including museums, homes, out-of-school programs, and classrooms. Engaging a broad and diverse audience in the future of STEM computing fields is an urgent priority of the US education system, both in schools and beyond. This project would complement substantial existing efforts to promote in-school computational literacy and, if successful, help bring about a more representative, computationally empowered citizenry. The integrated education plan supports the training and mentoring of graduate and undergraduate students in emerging research methods at the intersection of the learning sciences, computer science, and human-computer interaction. This work will also develop publically available learning experiences potentially impacting thousands of youth. These experiences will be available in museums, on the Web, and through App stores.