As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The National Association of Math Circles (NAMC) will convene the Math Circle-Mentor and Partnership (MC-MAP) Workshop in late 2016. The proposed MC-MAP workshop will build the field's understanding of the training content and mechanisms that enhance the knowledge and skill development of participants in Math Circles. The workshop will bring mentors from experienced Math Circle leaders together with novice Math Circle leaders to develop the expertise of the notice leaders and their group to develop their expertise in facilitating math circle activities and in organizing related events. The approximately 180 Math Circles currently operating across the nation enlist mathematics professionals to share their passion for mathematics with K-12 students, teachers, and the general public in contexts that emphasize exploration, problem solving and discovery. This initial conference and Math Circle trainings informed by this conference will help build a community of practice around Math Circles through which novice and existing leaders are connected, encouraged and inspired.
The MC-MAP workshop will include structured planning as well as guided observation and structured debriefing of a demonstration Math Circle sessions. The workshop design will be grounded in research related to effective adult learning and to discovery-based mathematics. The workshop will serve as a training prototype that will assist the National Association of Math Circles to identify effective training formats and materials for both experienced and novice Math Circle leaders. Pre- and post- conference surveys of Math Circle leaders will produce data to be used in planning and designing future trainings. The NAMC will share key findings from the workshop evaluation and workshop resources not only with its membership, but also with other mathematics K-12 outreach programs. Workshop materials will address recruiting and serving diverse participants in Math Circles, including girls and women, persons with disabilities, students from varied socioeconomic backgrounds and underrepresented minorities in STEM.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
On August 21, 2017, a total solar eclipse will traverse the United States from Oregon to South Carolina. Millions of Americans will witness totality, in which the Moon completely blocks the Sun, and over 500 million people across North America will experience a partial eclipse. In this project, the American Astronomical Society (AAS) will forge an umbrella organization consisting of an eclipse project manager, a centralized website of resources, and a mini-grants program to coordinate and facilitate local and national activities that will educate the public about the science of this rare event. The project will leverage this fascinating display of beauty to engage as many people as possible in the endeavor of science.
This project will involve scientists, educators, and amateur and professional eclipse observers in developing extensive plans for unique outreach activities to reach a significant fraction of the diverse U.S. population. The goal is to use the eclipse, which will generate significant media attention, to educate a broad audience about the associated science and to encourage young people from widely diverse backgrounds to pursue careers in science. Special emphasis will be placed on citizen science projects and on educational activities targeting groups that are underrepresented in STEM disciplines. A mini-grants program will be established to fund efforts specifically targeting underrepresented groups in order to increase their participation. The evaluation plan will focus on the utilization of the materials on the website and the learning gains of participants in specific activities funded by the mini-grants. All lessons learned will be collated in a publicly available formal report and will lay the groundwork for a strategic plan to fully capitalize on the next U.S.-based solar eclipse in 2024. Because this project aligns well with the objectives of multiple NSF directorates, this award is co-funded by the Division of Undergraduate Education and the Division of Research on Learning in the Directorate for Education and Human Resources; the Division of Astronomical Sciences in the Directorate for Mathematical and Physical Sciences; and the Division of Atmospheric and Geospace Sciences in the Directorate for Geosciences.
DATE:
-
TEAM MEMBERS:
Kevin MarvelAngela SpeckShadia HabbalRichard Fienberg
resourceprojectProfessional Development, Conferences, and Networks
This project will convene a workshop focused on digital micro-credentials, also known as digital badges, and the role they might play in the high-stakes process of college admission. Digital micro-credentials represent one potential mechanism for broadening access for underrepresented groups to higher education. Digital micro-credentials enable students to present a broader view of themselves as learners that connects different domains of their lives: academic, social, and personal interest-driven. As such, digital micro-credentials enable students to represent expertise and potential in ways that go beyond traditional high school grade point averages and standardized test scores. The workshop addresses questions such as: Can micro-credentials serve as valid and reliable measures of learning? What "gap" in current assessment practices can be filled by micro-credentials? What is required for micro-credentials to be useful as evidence of preparation for future learning in the college admission process?
The project's principal investigators will employ case studies, drawn from the Chicago City of Learning network (chicagocityoflearning.org) and Mouse (mouse.org) in New York City, to better understand the use of micro-credentials for learning in STEM-focused extracurricular activities. During the workshop, participants with expertise in student learning from a range of perspectives will design representations of the knowledge or skills demonstrated by students. Participating admissions officers and STEM faculty will critique the designs with respect to how well the designs demonstrate evidence of preparation for future learning by students. The workshop outcomes will include sample designs of micro-credentials that show promise to both promote learning and support college admissions. The workshop will also result in a white paper discussing the potential of micro-credentials for college admission in STEM fields by youth from underrepresented groups.
This research project builds upon an Advancing Informal STEM Learning (AISL) project (DRL#1114674) that investigated preschoolers' self-directed science, technology, engineering, and mathematics (STEM) related play experiences in outdoor nature-based playscapes. An emerging trend, nature-based playscapes have great potential for exposing young children to STEM-related phenomena, concepts, and processes in a variety of early childhood education settings, including daycare centers, pre-schools, playgrounds, and children's museums. In contrast to traditional playgrounds, playscapes are designed to result in complex, sensory-rich environments in which extensive access to natural materials and resources inspires young children's investigative and exploratory behaviors. This study explores the hypothesis that play in nature provides young children (ages 3-5) with extensive contact with science content and that a play-based curriculum could expand opportunities for STEM learning. This Research-in-Service of Practice project will: 1) design, implement, and evaluate four digital play-based professional development curriculum modules for pre-school educators across multiple partner sites; 2) research the impact of professional training on educators' facilitation of STEM content and activities; 3) examine the impacts of play-based facilitation on young children's understanding of and engagement with STEM; and 4) evaluate the transferability and sustainability of new playscape design principles at three partner sites. This investigation will be led by researchers at the University of Cincinnati in close collaboration with early childhood educators at the Arlitt Center, Cincinnati Nature Center, and two local early childhood organizations that serve children in Head Start programs. The study will use a mixed-methods approach. Data sources include video observations, behavior mapping, teacher self-studies, surveys, interviews, child assessments and children's photo documentation of their experiences. This research project is being funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. Research that promotes the understanding of how designed play-based natural environments and related instructional approaches support the development of young children's engagement with STEM could lead to new learning theory, pedagogical approaches, and inform the design of effective informal learning experiences. Understanding the affordances of particular components of playscapes with respect to young children, as well as how pre-school educators could productively facilitate young children's engagement with, and understanding of, STEM would be a contribution to the informal STEM field.
Children are already learning at birth, and they develop and learn at a rapid pace in their early years. This provides a critical foundation for lifelong progress, and the adults who provide for the care and the education of young children bear a great responsibility for their health, development, and learning. Despite the fact that they share the same objective - to nurture young children and secure their future success - the various practitioners who contribute to the care and the education of children from birth through age 8 are not acknowledged as a workforce unified by the common
Situated within the Advancing Informal STEM Learning program, this Research in Service to Practice award seeks to design, implement, and evaluate an intervention aimed at fostering a culture of productive failure practices. The project responds to a broad concern in educational research and practice: Experiences of failure are frequently so negative that students shut down, lose agency, and develop low self-efficacy and learned helplessness. Surrendering too quickly to obstacles is particularly unfortunate, given evidence that initially "getting it wrong" ultimately breeds deep and sustained learning. In order to learn how students can make the most of productive failure, the proposed project will study how a community of practice that includes middle school youth and their mentors attempts to change its handling of learning obstacles. Building on prior research documenting storytelling practices in an afterschool program, the team now aims to embolden young students' productive practices of failure storytelling in computer science, a field in which experts practice candid, pervasive, and collaborative discourse around errors ("bugs"). Pulling together the domains of narrative analysis, meta-cognitive reflection, and control theories of motivation, within the context of authentic computer-science debugging activity, this study develops a theoretical framework that views productive responses to failure as a discipline-specific process of reflecting as a community on how to locate obstacles, how to construct causal theories about why those obstacles emerged, and how to plan productive responses. A design-based research approach will investigate three questions: (1) What is the impact of the interventions on students and instructors' actions and discourse when they are debugging errors in computer code? (2) What is the impact of the interventions on students and instructors' reflections back on their prior debugging experiences and on failure in general? and (3) What is the impact of the instructor-development efforts on the instructors' capacity to foster students' productive attitudes toward failure? The study focus will be 15 summer and weekend coding workshops with 5th-8th grade students from populations typically under-represented in STEM. The interventions are (a) setting new norms and practices for debugging, (b) instructor education, and (c) coding software that provides students with feedback on their productive struggle. Data sources include video and audio recordings of the learning environment, artifacts produced during the activities, and semi-structured interviews. Measures will capture variations in debugging activities, reflections on debugging, students' ideas about grit and growth mindset, and instructors' struggles and successes with the new curriculum. The empirical results will consist of mixed-methods, micro-longitudinal accounts of how a community of practice works to reform its orientation to failure. The products of this work include empirical knowledge, theory, and curriculum about how learning communities help students develop robust and efficient responses to failure. These will be disseminated through journals, open-source software, and workshops/conferences for researchers and practitioners working with youth afterschool programs. The products may be useful for exploring practices in the classroom. This project is being conducted by the 9 Dots Community Learning Center, UCLA and UC Berkeley.
DATE:
-
TEAM MEMBERS:
Melissa ChenDor AbrahamsonNoel EnyedyFrancis SteenDavid DeLiema
resourceprojectProfessional Development, Conferences, and Networks
The purpose of this proposal is to convene scholars at a two-day conference to closely examine validity-related measurement issues, create a guidelines for the field of mathematics education research that addresses key ideas (e.g., validity, validity arguments, evidence for validity and measurement at-scale), and set a clear pathway for scholars to discuss quantitative measurement within mathematics education. Invitees will include a mix of young, older and diverse scholars in mathematics education research. Products include refereed journal articles along with a website.
The workshop will engage the Mathematics Education, Policy, Statistical, Psychometrics and other education research communities in examining and critiquing measurement validity evidence of mathematics education research with the long-term goal of increasing the quality of quantitative inference in mathematics education research (to include improvements in the training of doctoral students).
DATE:
-
TEAM MEMBERS:
Jonathan BosticMichele Carney
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds efforts that seek to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will achieve these aims by identifying and closely evaluating critical factors and processes that are necessary to effectively broaden access and sustain professional learning (PL) for educational professionals working within informal STEM learning (ISL) settings. The context for this work builds on an evidence-based and nationally field tested professional learning model, Reflecting on Practice (RoP). This model will be refined to provide ISL educators with increased access to a proven PL curriculum via an in-person or blended approach, enhanced localized support, and cultivated regional professional learning communities. There is still little known about the effectiveness of blended PL within informal contexts. The emphasis on greater accessibility to PL is particularly important to the ISL field, given the significant number of informal STEM educators and institutions in underserved and remote locations, often facing disparate and insurmountable challenges in access to high quality STEM professional development. This modular program will not only target a broad range of informal institutions; varying in size, STEM content foci, geographic location and communities served but it is also uniquely designed for institutional customization and adoption, further increasing the likelihood of wide-spread uptake, participation, and engagement. If successful, this broad implementation effort will directly impact over 3,000 informal science educators and professionals in nearly 350 informal STEM learning institutions across the country. The intended theory of action and iterative, design-based implementation approach will be closely monitored, documented and analyzed by an experienced team of external evaluators, using formative and summative evaluative methods. A mixed methods approach will be employed to: (a) examine the effectiveness and accessibility of blended PL and regional PLCs for the ISL field, (b) identify critical design features in blended PL and regional PLCs for impacting educators' practice, (c) determine how PLCs can develop and continue in ISL through looking at what system of support is needed, and (d) ascertain the effective role of the Leaders and Leadership Sites. Data will be collected at all levels - from the RoP directors and PIs, document reviews, interviews and observations with RoP leaders at the six partnering institutions, and surveys with the RoP facilitators (n=700) and informal STEM educator participants (n=2,000). The results of the findings could be instrumental in the development of future frameworks and models designed to broadly disseminate similar professional learning models effectively within ISL contexts.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of Science, Technology, Engineering, and Mathematics (STEM) learning in informal environments. Roughly one million refugees resettled in the United States in the past decade, many of whom are school-aged youth. During secondary school, resettled refugee youth are often still developing English language literacy and STEM skills needed for successful postsecondary experiences in the United States. At the same time, these youth bring rich cultural and linguistic resources that they can use as an asset as they grow their STEM skill sets, prepare for future success, and make positive impacts on U.S. society. To promote these assets and engage youth in developing STEM literacy, this after-school program engages these youth in critical STEM literacy development. The project focuses on STEM learning, specifically the relationship between human life and climate, as well as developing youths' STEM identities and agency.
The project will develop and implement a community-based afterschool program that provides resettled Burmese refugee youth with STEM learning experiences. By drawing upon youths' experiences, the program will engage youth in learning about climate science and developing digital stories to communicate with broader audiences. To do so, the team will implement a program that builds on principles of responsive teaching, funds of knowledge, and English literacy development in authentic meaning-making contexts. The project will examine how youth expand their STEM knowledge, develop STEM identities and agency, and develop their expertise in communicating about STEM within and beyond their participation in the after-school program. The research team will explore existing and innovative data collection and analysis methods by drawing on principles of ethnography, video ethnography, mediated discourse analysis, and phenomenological and ethnomethodological analysis of interviews. These analyses will document learning over time in informal STEM learning settings. As there is very little prior research on STEM learning in this population, this project will generate knowledge about how to support STEM sense-making and critical STEM literacy. Furthermore, by testing the designed curriculum and building a partnership with a local community organization, the project will build capacity for broadening participation in informal STEM learning practices.