Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Research in Service to Practice project will examine how a wide range of pre-college out-of-school-time activities facilitate or hinder females' participation in STEM fields in terms of interest, identity, and career choices. The study will address the ongoing problem that, despite females' persistence to degree once declaring a major in college, initially fewer females than males choose a STEM career path. To uncover what these factors might be, this study will look at the extent to which college freshmen's pre-college involvement in informal activities (e.g., science clubs, internships, shadowing of STEM professionals, museum-going, engineering competitions, citizen science pursuits, summer camps, and hobbies) is associated with their career aspirations and avocational STEM interests and pursuits. While deep-seated factors, originating in culture and gender socialization, sometimes lower females' interest in STEM throughout schooling, this study will examine the degree to which out-of-school-time involvement ameliorates the subtle messages females encounter about women and science that can interfere with their aspiration to a STEM careers.
The Social Cognitive Career Theory will serve as the theoretical framework to connect the development of interest in STEM with students' later career choices. An epidemiological approach will be used to test a wide range of hypotheses garnered from a review of relevant literature, face-to-face or telephone interviews with stakeholders, and retrospective online surveys of students. These hypotheses, as well as questions about the students' demographic background and in-school experiences, will be incorporated into the main empirical instrument, which will be a comprehensive paper-and-pencil survey to be administered in classes, such as English Composition, that are compulsory for both students with STEM interests and those without by 6500 students entering 40 large and small institutions of higher learning. Data analysis will proceed from descriptive statistics, such as contingency tables and correlation matrices, to multiple regression and hierarchical modeling that will link out-of-school-time experiences to STEM interest, identity, and career aspirations. Factor analysis will be used to combine individual out-of-school activities into indices. Propensity score weighting will be used to estimate causal effects in cases where out-of-school-time activities may be confounded with other factors. The expected products will be scholarly publications and presentations. Results will be disseminated to out-of-school-time providers and stakeholders, educators, and educational researchers through appropriate-level journals and national meetings and conferences. In addition, the Public Affairs and Information Office of the Harvard-Smithsonian Center for Astrophysics will assist with communicating results through mainstream media. Press releases will be available through academic outlets and Op-Ed pieces for newspapers. The expected outcome will be research-based evidence about which types of out-of-school STEM experiences may be effective in increasing young females' STEM interests. This information will be crucial to educators, service providers, as well as policy makers who work toward broadening the participation of females in STEM.
DATE:
-
TEAM MEMBERS:
Roy GouldPhilip SadlerGerhard Sonnert
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of Science, Technology, Engineering, and Mathematics (STEM) learning in informal environments. Roughly one million refugees resettled in the United States in the past decade, many of whom are school-aged youth. During secondary school, resettled refugee youth are often still developing English language literacy and STEM skills needed for successful postsecondary experiences in the United States. At the same time, these youth bring rich cultural and linguistic resources that they can use as an asset as they grow their STEM skill sets, prepare for future success, and make positive impacts on U.S. society. To promote these assets and engage youth in developing STEM literacy, this after-school program engages these youth in critical STEM literacy development. The project focuses on STEM learning, specifically the relationship between human life and climate, as well as developing youths' STEM identities and agency.
The project will develop and implement a community-based afterschool program that provides resettled Burmese refugee youth with STEM learning experiences. By drawing upon youths' experiences, the program will engage youth in learning about climate science and developing digital stories to communicate with broader audiences. To do so, the team will implement a program that builds on principles of responsive teaching, funds of knowledge, and English literacy development in authentic meaning-making contexts. The project will examine how youth expand their STEM knowledge, develop STEM identities and agency, and develop their expertise in communicating about STEM within and beyond their participation in the after-school program. The research team will explore existing and innovative data collection and analysis methods by drawing on principles of ethnography, video ethnography, mediated discourse analysis, and phenomenological and ethnomethodological analysis of interviews. These analyses will document learning over time in informal STEM learning settings. As there is very little prior research on STEM learning in this population, this project will generate knowledge about how to support STEM sense-making and critical STEM literacy. Furthermore, by testing the designed curriculum and building a partnership with a local community organization, the project will build capacity for broadening participation in informal STEM learning practices.
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
The America After 3PM survey is the nation’s most comprehensive household survey of how children spend the hours after school and asks parents and guardians of school-age children in the United States about availability and access to after-school programs. The 2014 survey, which followed prior surveys conducted in 2004 and 2009, reveals that over the past decade, the number of children in after-school programs has grown from 6.5 million to more than 10 million. Parents of an additional 19.4 million children would enroll their children in a program if one were available to them.
Commonly described as youth-led or youth-driven, the youth-adult partnership (Y-AP) model has gained increasing popularity in out-of-school time (OST) programs in the past two decades (Larson, Walker, & Pearce, 2005; Zeldin, Christens, & Powers, 2013). The Y-AP model is defined as “the practice of (a) multiple youth and multiple adults deliberating and acting together (b) in a collective (democratic) fashion (c) over a sustained period of time (d) through shared work (e) intended to promote social justice, strengthen an organization and/or affirmatively address a community issue” (Zeldin et al
DATE:
TEAM MEMBERS:
Heng-Chieh Jamie WuMariah KornbluhJohn WeissLori Roddy
Young adulthood, typically defined as between the ages of 18 and 25, is a critical period of growth during which young people acquire the education and training that serve as the basis for their later occupations and income (Arnett, 2000). The successful transition from adolescence to early adulthood requires youth to have the skills and resources to graduate high school and then go to college or enter the workforce (Fuligni & Hardway, 2004; Lippman, Atienza, Rivers, & Keith, 2008). To accomplish these tasks in advanced urban societies, young adults need a wide range of social, cognitive
From Intel to Facebook, Google and Apple, technology companies are joining other science, technology, engineering, and mathematics (STEM) industry leaders in a grand challenge to diversify their workforce. Finally, two sides of the diversity message can be heard simultaneously: expanding opportunities for women and girls is not just the right thing to do, investing in diversity is also a smart business opportunity. To meet workforce supply demands, improve innovation, and ensure social equity, STEM professions need the imaginations and talents of girls and underrepresented communities of color
This report details a four-month snapshot summative evaluation of the Bridging the Gap (BTG) program at the Wildlife Conservation Society. A snapshot summative evaluation in this instance means that the evaluation occurred as the program was concluding, but was not intended to evaluate the totality of the three-year program. The study sought to 1) better understand the effect the program had on teen participants' attitudes on any element associated with the program (STEM, careers, college, zoos, etc.); and 3) identify components of the program that were particularly successful or effective.
The 3-year Bridging the Gap program, developed and implemented by the Wildlife Conservation Society (WCS), was designed to educate minority youth from New York City (NYC) about education and career opportunities available in wildlife and conservation sciences. This National Science Foundation (NSF) Innovative Technology Experiences for Students and Teachers (ITEST)-funded program provided almost 150 minority high school students with conservation knowledge, practical information about the college application process and college life, and long-term support through continued contact with WCS