The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.
The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.
Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Patrik LundhAndrea BeesleyTimothy PodkulCarrie Allen
It is estimated that there could be 40 billion earth-sized planets orbiting in the habitable zones of stars in the Milky Way. Major advances in long range telescopes have allowed astronomers to identify thousands of exoplanets in recent decades, and the discovery of new exoplanets is a now a common occurrence. Public excitement for the discoveries grown alongside these discoveries, thus opening new possibilities for inspiring a new generation of scientists and engineers that may dream of one day visiting these planets. This project investigates the use of interactive, intelligent educational technologies to generate interest in STEM by allowing learners to explore and even create their own exoplanets. Research will occur across several informal learning contexts, including summer camps, after school programs, planetarium shows, and at home. The approach is based on the idea of "What if?"questions about Earth (e.g., "What if the Moon did not exist?"), designed to trigger interest in STEM and frame exploratory and elaborative discussions around hypothetical science questions that are subsequently linked to the search for habitable exoplanets. Learners are able to interact with and explore scientifically accurate simulations of alternative versions of Earth, while making observations and posing explanations for what they see. Technology-based informal learning experiences designed to act as triggers for and sustainment of interest in STEM have the potential to plug the leaky STEM pipeline, and thus have profound implications for the future of science and technology in the United States.
The project seeks to advance the science of designing technologies for promoting interest in STEM and informal astronomy education in several ways. First, the project will develop simulations for exploratory learning about astronomy and planetary science. These simulations will present hypothetical worlds based on what-if questions and feasible models of known exoplanets, thus giving learners a chance to better understand the challenges of finding a habitable world and learning about what is needed to survive there. Second, a new PBS NOVA Lab will be developed that will focus on Exoplanet education. This web-based activity has the potential to reach millions of learners and will help them understand how planets are formed and the requirements for supporting life. Learners who use the lab will have an opportunity to invent their own exoplanets and export them for first-person exploration. Third, researchers on the project will design and implement Artificial Intelligence-based pedagogical agents to support learning and promote interest. These agents will inhabit the simulations with the learner, acting as a coach and guide, and be designed to be culturally responsive and personalized based on learner preferences. Fourth, interactive exoplanet-focused planetarium shows, that will involve live interaction with simulations, will take place at the Fiske Planetarium (Boulder, CO). Finally, the project will develop a server-based infrastructure for tracking and supporting long term development of interest in STEM. This back-end will track fine-grained behaviors, including movement, actions, and communications in the simulations. Such data will reveal patterns about how interest develops, how learners engage in free-choice learning activities, and how they interact with agents and peers in computer simulations. A design-based research methodology will be employed to assess the power of these different experiences to trigger interest and promote learning of astronomy. A range of different pathways for interest in STEM will therefore be considered and assessed. Research will measure the power of these experiences to trigger interest in STEM and promote re-engagement over time. Innovation lies in the use of engaging and intelligent technologies with thought-provoking pedagogy as a method for extended engagement of diverse young learners in STEM. Project research and educational resources will be widely disseminated to researchers, designers developers and the general public via peer-reviewed research journals, conference presentations, informal STEM education networks of science museums, children's museums, Fab Labs, and planetariums, and public media such as public television's NOVA science program website.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
H Chad LaneNeil CominsJorge Perez-GallegoDavid Condon
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project will research the educational impact of social robots in informal learning environments, with applications to how social robots can improve participation and engagement of middle-school girls in out-of-school computer science programs in under-resourced rural and urban areas. The use of robots to improve STEM outcomes has focused on having learners program robots as tools to accomplish tasks (e.g., play soccer). An alternate approach views robots as social actors that can respond intelligently to users. By designing a programmable robot with social characteristics, the project aims to create a culturally-responsive curriculum for Latina, African American, and Native American girls who have been excluded by approaches that separate technical skill and social interaction. The knowledge produced by this project related to the use and benefits of social programmable robots has the potential to impact the many after-school and weekend programs that attempt to engage learners in STEM ideas using programmable robot curricula.
The project robot, named Cozmo, will be programmed using a visual programming language and will convey emotion with facial expressions, sounds, and movements. Middle school girls will engage in programming activities, collaborative reflection, and interact with college women mentors trained to facilitate the course. The project will investigate whether the socially expressive Cozmo improves computer science outcomes such as attitudes, self-efficacy, and knowledge among the middle school female participants differently than the non-social version. The project will also investigate whether adding rapport-building dialogue to Cozmo enhances these outcomes (e.g., when a learner succeeds in getting Cozmo to move, Cozmo can celebrate, saying "I can move! You're amazing!"). These questions will be examined research conducted with participants in multi-session after-school courses facilitated by Girl Scout troops in Arizona. The project will disseminate project research and resources widely by sharing research findings in educational and learning science journals; creating a website with open source code for programming social robots; and making project curriculum and related guidelines available to Girl Scouts and other educational programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.