As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Research in Service to Practice project will examine how a wide range of pre-college out-of-school-time activities facilitate or hinder females' participation in STEM fields in terms of interest, identity, and career choices. The study will address the ongoing problem that, despite females' persistence to degree once declaring a major in college, initially fewer females than males choose a STEM career path. To uncover what these factors might be, this study will look at the extent to which college freshmen's pre-college involvement in informal activities (e.g., science clubs, internships, shadowing of STEM professionals, museum-going, engineering competitions, citizen science pursuits, summer camps, and hobbies) is associated with their career aspirations and avocational STEM interests and pursuits. While deep-seated factors, originating in culture and gender socialization, sometimes lower females' interest in STEM throughout schooling, this study will examine the degree to which out-of-school-time involvement ameliorates the subtle messages females encounter about women and science that can interfere with their aspiration to a STEM careers.
The Social Cognitive Career Theory will serve as the theoretical framework to connect the development of interest in STEM with students' later career choices. An epidemiological approach will be used to test a wide range of hypotheses garnered from a review of relevant literature, face-to-face or telephone interviews with stakeholders, and retrospective online surveys of students. These hypotheses, as well as questions about the students' demographic background and in-school experiences, will be incorporated into the main empirical instrument, which will be a comprehensive paper-and-pencil survey to be administered in classes, such as English Composition, that are compulsory for both students with STEM interests and those without by 6500 students entering 40 large and small institutions of higher learning. Data analysis will proceed from descriptive statistics, such as contingency tables and correlation matrices, to multiple regression and hierarchical modeling that will link out-of-school-time experiences to STEM interest, identity, and career aspirations. Factor analysis will be used to combine individual out-of-school activities into indices. Propensity score weighting will be used to estimate causal effects in cases where out-of-school-time activities may be confounded with other factors. The expected products will be scholarly publications and presentations. Results will be disseminated to out-of-school-time providers and stakeholders, educators, and educational researchers through appropriate-level journals and national meetings and conferences. In addition, the Public Affairs and Information Office of the Harvard-Smithsonian Center for Astrophysics will assist with communicating results through mainstream media. Press releases will be available through academic outlets and Op-Ed pieces for newspapers. The expected outcome will be research-based evidence about which types of out-of-school STEM experiences may be effective in increasing young females' STEM interests. This information will be crucial to educators, service providers, as well as policy makers who work toward broadening the participation of females in STEM.
DATE:
-
TEAM MEMBERS:
Roy GouldPhilip SadlerGerhard Sonnert
Situated within the Advancing Informal STEM Learning program, this Research in Service to Practice award seeks to design, implement, and evaluate an intervention aimed at fostering a culture of productive failure practices. The project responds to a broad concern in educational research and practice: Experiences of failure are frequently so negative that students shut down, lose agency, and develop low self-efficacy and learned helplessness. Surrendering too quickly to obstacles is particularly unfortunate, given evidence that initially "getting it wrong" ultimately breeds deep and sustained learning. In order to learn how students can make the most of productive failure, the proposed project will study how a community of practice that includes middle school youth and their mentors attempts to change its handling of learning obstacles. Building on prior research documenting storytelling practices in an afterschool program, the team now aims to embolden young students' productive practices of failure storytelling in computer science, a field in which experts practice candid, pervasive, and collaborative discourse around errors ("bugs"). Pulling together the domains of narrative analysis, meta-cognitive reflection, and control theories of motivation, within the context of authentic computer-science debugging activity, this study develops a theoretical framework that views productive responses to failure as a discipline-specific process of reflecting as a community on how to locate obstacles, how to construct causal theories about why those obstacles emerged, and how to plan productive responses. A design-based research approach will investigate three questions: (1) What is the impact of the interventions on students and instructors' actions and discourse when they are debugging errors in computer code? (2) What is the impact of the interventions on students and instructors' reflections back on their prior debugging experiences and on failure in general? and (3) What is the impact of the instructor-development efforts on the instructors' capacity to foster students' productive attitudes toward failure? The study focus will be 15 summer and weekend coding workshops with 5th-8th grade students from populations typically under-represented in STEM. The interventions are (a) setting new norms and practices for debugging, (b) instructor education, and (c) coding software that provides students with feedback on their productive struggle. Data sources include video and audio recordings of the learning environment, artifacts produced during the activities, and semi-structured interviews. Measures will capture variations in debugging activities, reflections on debugging, students' ideas about grit and growth mindset, and instructors' struggles and successes with the new curriculum. The empirical results will consist of mixed-methods, micro-longitudinal accounts of how a community of practice works to reform its orientation to failure. The products of this work include empirical knowledge, theory, and curriculum about how learning communities help students develop robust and efficient responses to failure. These will be disseminated through journals, open-source software, and workshops/conferences for researchers and practitioners working with youth afterschool programs. The products may be useful for exploring practices in the classroom. This project is being conducted by the 9 Dots Community Learning Center, UCLA and UC Berkeley.
DATE:
-
TEAM MEMBERS:
Melissa ChenDor AbrahamsonNoel EnyedyFrancis SteenDavid DeLiema
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of Science, Technology, Engineering, and Mathematics (STEM) learning in informal environments. Roughly one million refugees resettled in the United States in the past decade, many of whom are school-aged youth. During secondary school, resettled refugee youth are often still developing English language literacy and STEM skills needed for successful postsecondary experiences in the United States. At the same time, these youth bring rich cultural and linguistic resources that they can use as an asset as they grow their STEM skill sets, prepare for future success, and make positive impacts on U.S. society. To promote these assets and engage youth in developing STEM literacy, this after-school program engages these youth in critical STEM literacy development. The project focuses on STEM learning, specifically the relationship between human life and climate, as well as developing youths' STEM identities and agency.
The project will develop and implement a community-based afterschool program that provides resettled Burmese refugee youth with STEM learning experiences. By drawing upon youths' experiences, the program will engage youth in learning about climate science and developing digital stories to communicate with broader audiences. To do so, the team will implement a program that builds on principles of responsive teaching, funds of knowledge, and English literacy development in authentic meaning-making contexts. The project will examine how youth expand their STEM knowledge, develop STEM identities and agency, and develop their expertise in communicating about STEM within and beyond their participation in the after-school program. The research team will explore existing and innovative data collection and analysis methods by drawing on principles of ethnography, video ethnography, mediated discourse analysis, and phenomenological and ethnomethodological analysis of interviews. These analyses will document learning over time in informal STEM learning settings. As there is very little prior research on STEM learning in this population, this project will generate knowledge about how to support STEM sense-making and critical STEM literacy. Furthermore, by testing the designed curriculum and building a partnership with a local community organization, the project will build capacity for broadening participation in informal STEM learning practices.
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
The lack of diversity in the clinician-scientist workforce is a “very serious concern to the NIH” and to health care professions. Current efforts to broaden participation in STEM fields typically target high school and college-age students. Yet, history and national trends suggest that these efforts alone will not result in rapid or significant change because racial and ethnic disparities are already evident by this time. Children are forming career preferences as early as elementary school, a time when they have little exposure to science and STEM career options. The overall vision of this team is to meet the nation’s workforce goal of developing a diverse, clinician-scientist workforce while meeting the nation’s STEM goals. As a step toward this vision, the goal of This Is How We “Role” is to inspire elementary school students towards careers as clinician-scientists by increasing the number of K-4 students with authentic STEM experiences.
This goal will be attained through two specific aims. The focus of Aim 1 is to distribute and evaluate a K-4 afterschool program across the diverse geographic regions of the US, to support the development of a robust and diverse clinician-scientist workforce. Aim 2 is focused on developing the community resources (afterschool program curriculum, informational books and online certificate program) for promoting health science literacy and encouraging careers in biomedical and clinical research for K-4 students from underserved and underrepresented communities. Combined, these aims will enhance opportunities for young children from underserved communities to have authentic STEM experiences by providing culturally responsive, afterschool educational programs which will be delivered by university student and clinician-scientist role models who are diverse in gender, race, and ethnicity.
Books and an online certificate program about health issues impacting people and their animals (i.e. diabetes, tooth decay) will be developed and distributed to children unable to attend afterschool programs. Further, by engaging veterinary programs and students from across the US, along with practicing veterinarians, this program will examine whether the approaches and curriculum developed are effective across the diverse communities and geographic regions that span the country. Elementary school teachers will serve as consultants to ensure that educational materials are consistent with Next Generation Science Standards, and will assist in training university students and clinician-scientists to better communicate the societal impact of their work to the public.
The program will continue to use the successful model of engaging elementary school students in STEM activities by using examples of health conditions that impact both people and their animals. Ultimately, this project will educate, improve the health of, and attract a diverse pool of elementary school students, particularly those from underserved communities, to careers as clinician-scientists.
STEM learning ecosystems harness contributions of educators, policymakers, families, businesses, informal science institutions, after-school and summer providers, higher education, and many others towards a comprehensive vision of STEM learning for all children. This paper offers evidence of the impact of cross-sector partnerships on young people, and a logic model template for communities so they may further develop the attributes, strategies, and measures of progress that enable them to advance opportunities for all young people to succeed. Further research will help us expand the promise
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. CHISPA is a national network of science museums and afterschool programs affiliated with ASPIRA and National Council of La Raza (NCLR), working together to build stronger communities and increase the engagement of Hispanic children and their families with science and local science resources. The project period is October 2013 through September 2017.