The project will advance efforts by the American Association for the Advancement of Science and the Institute for Learning Innovation to bring together young adults from communities historically underrepresented in science, technology, engineering, and mathematics (STEM) to collaboratively conduct scientifically driven challenges embedded in a mobile learning tool based upon the AAAS Active Explorer platform. The project will be conducted at the Washington National Mall, San Francisco National Golden Gate Park, and the Boston Harbor Islands National Recreation Area, and will study how a mobile technology used in these settings can facilitate learner engagement in science content; how it can affect young adults' engagement in science-learning processes; and whether interest in learning science and technology has been furthered. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments, including pathways for broadening access to STEM learning experiences and advancing research STEM learning. Research questions will investigate science learning inequalities by addressing how place-based augmented reality games can connect young adults to scientific practices, including observing science phenomena, analyzing data, and communicating findings; how young adults develop science skills related to their science self-efficacy through participation in augmented reality science exploration; and how mobile technologies and gaming can serve as mediators that enable young adults to improve their science identity. In addition to engaging young adults in science activities at the National Parks and increasing their science skills, the project will provide valuable information to National Park staff and scientists to assist them in designing effective tools, resources and experiences to better engage young adults. Research teams will collect data in the form of digital ethnography, focus groups, activity reports, artifacts, and surveys. The project will document learning and engagement through mobile technology in three urban national parks that will involve 60 young adults at each location, and will create innovative measurement tools to monitor how informal settings can leverage the intersections of the arts and sciences to support student engagement and learning.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The project will fill a major gap in knowledge regarding why children listen to science podcasts and what impact they have on their STEM learning. Brains On! is an existing podcast for children 6-12 years old that is produced by American Public Media. The podcasts are kid-driven. Kid listeners send in questions and suggest the show topics. Every episode is co-hosted by a different child, who interviews top scientists about their work, sees research done first hand and helps shape the overall arc of the episode. The project team collaborates with a wide variety of scientists to create programming that is both appealing to kids and has scientific merit. Although Brains On! has enjoyed more than 2.4 million downloads collectively of its 50-episode library little is known about why children are drawn to it, how they are using its content, and what the impacts might be for those who listen to the podcast. There has been no previous research to understand why children choose to listen, or what impact it has on their learning. This Pathways project would produce new episodes and collaborate with the Science Museum of Minnesota that would conduct research to fill this large gap in understanding aural learning through podcasts. The Brains On! project has the following goals to create strategic impact: 1) explore and begin to develop knowledge around what makes children's science podcasts, such as Brains On!, appealing and what role they can play in impacting children and their families' science curiosity, learning, and awareness of science careers, and 2) develop a theory of action for the Brains On! podcast that could also inform the development of similar kinds of children's science podcasts. A mixed-methods exploratory research study will be carried out to address these goals. The three overarching research questions are: Who is the audience for Brains On! and what are their motivations for listening to science podcasts? How are Brains On! listeners using the podcast and engaging with its content? What kinds of impacts does Brains On! have on its audiences? The research results, including the theory of action, from the Brains On! exploratory study will benefit the fields of informal science education and public media by beginning to fill a gap in the current knowledge-base around the potential for science children's podcasts to contribute to a wide range of informal science learning outcomes for children and families, as well provide insight into what features of children's science podcasts can lead to those outcomes. The study results may also encourage other public media and informal science education organizations to create their own science podcasts for children, increasing the reach and potential impact of this emerging STEM media resource.
DATE:
-
TEAM MEMBERS:
Molly BloomSanden TottenLauren DeeMarc SanchezAmy Grack Nelson
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This Research in Service to Practice project will address the issues around Informal Education of rural middle school students who have high potential regarding academic success in efforts to promote computer and IT knowledge, advanced quantitative knowledge, and STEM skills. Ten school districts in rural Iowa will be chosen for this study. It is anticipated that new knowledge on rural informal education will be generated to benefit the Nation's workforce. The specific objectives are to understand how informal STEM learning shapes the academic and psychosocial outcomes of rural, high-potential students, and to identify key characteristics of successful informal STEM learning environments for rural, high-potential students and their teachers. The results of this project will provide new tools for educators to increase the flow of underserved students into STEM from economically-disadvantaged rural settings.
The President's Council of Advisors on Science and Technology predicts a rapid rise in the number of STEM jobs available in the next decade, describing an urgent need for students' educational opportunities to prepare them for this workforce. In 2014, 62% of CEOs of major US corporations reported challenges filling positions requiring advanced computer and information technology knowledge. The project team will use a mixed methods approach, integrating comparative case study and mixed effects longitudinal methods, to study the Excellence program. Data sources include teacher interviews, classroom observations, and student assessments of academic aptitude and psychosocial outcomes. The analysis and evaluation of the program will be grounded in understanding the local efforts of school districts to build curriculum responsive to the demands of their high-potential student body. The project design, and subsequent analysis plan, utilizes a mixed methods approach, incorporating case study and longitudinal quantitative methods to analyze naturalistic data and build robust evidence for the implementation and impact of this program. This project will provide significant insights in how best to design, implement, and support informal out-of-school learning environments to broaden participation in the highest levels of STEM education and careers for under-resourced rural students.
DATE:
-
TEAM MEMBERS:
Susan Assouline
resourceprojectProfessional Development, Conferences, and Networks
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. There are few empirical studies of sustained youth engagement in STEM-oriented making over time, how youth are supported in working towards more robust STEM related projects, on the outcomes of such making experiences among youth from historically marginalized communities, or on the design features of making experiences which support these goals. The project plans to conduct a set of research studies to develop: a theory-based and data-driven framework for equitably consequential making; a set of related individual-level and program-level cases with exemplars (and the associated challenges) that can be used by researchers and practitioners for guiding the field; and an initial set of guiding principles (with indicators) for identifying equitably consequential making in practice. The project will result in a framework for equitably consequential making with guiding principles for implementation that will contribute to the infrastructure for fostering increased opportunities to learn among all youth, especially those historically underrepresented in STEM.
Through research, the project seeks to build capacity among STEM-oriented maker practitioners, researchers and youth in the maker movement around equitably consequential making to expand the prevailing norms of making towards more transformative outcomes for youth. Project research will be guided by several questions. What do youth learn and do (in-the-moment and over time) in making spaces that work to support equity in making? What maker space design features support (or work against) youth in making in equitably consequential ways? What are the individual and community outcomes youth experience in STEM-making across settings and time scales? What are the most salient indicators of equitably consequential making, how do they take shape, how can these indicators be identified in practice? The project will research these questions using interview studies and critical longitudinal ethnography with embedded youth participatory case study methodologies. The research will be conducted in research-practice partnerships involving Michigan State University, the University of North Carolina at Greensboro and 4 local, STEM- and youth-oriented making spaces in Lansing and Greensboro that serve historically underrepresented groups in STEM, with a specific focus on youth from lower-income and African American backgrounds.
This ChangeMakers project builds on a 2016 National Academies report finding that scientific literacy can be understood at a community level as opposed to a traditional focus on the individual. This is important since scientific knowledge is often seen as abstract and distant from the daily concerns of average citizens. A community focus shifts the spotlight away from individual learning to collective learning facilitated by trusted cultural institutions serving as social assets. This work brings together scientific expertise and community organizations to advance operational science literacy--scientific ways of problem-solving--for community leaders and functional science literacy--information and skills people can use in their daily lives--among their service populations. This will be done by gathering and sharing knowledge and developing skills and abilities to contribute to the community's overall well-being.
The New England Aquarium (NeAq) and Aquarium of the Pacific (AoP) will apply a community engagement model involving active listening, documentation, alignment of concerns and goals, and co-development of shared solutions that serves the needs of all participants. As part of the Advancing Community Science Literacy (ACSL) project, multi-disciplinary teams from NeAq, AoP and their regional partners will participate in training on the model. They will apply that training to build and implement action plans to advance community-driven responses to local environmental issues. Teams will be assessed with respect to how they use tools from their shared training, along with peer support and coaching, to make progress in engaging diverse community stakeholders. Results of the evaluation will offer insights and recommendations for informal science learning centers to serve their communities more effectively as engagement facilitators and change agents to support science literacy development and action. By applying techniques developed for cultural institutions to communicate about climate science, and combining those with techniques developed for libraries and other organizations to help meet emergent community concerns, such as storm surges and coastal flooding, it is possible to redefine the role informal science learning centers can play as part of a community culture.
ACSL is funded by the Advancing Informal STEM Learning (AISL) program which supports projects that provide multiple pathways for broadening access to and engagement in STEM learning experiences, advances innovative research on and assessment of STEM learning in informal environments, and develops understandings of deeper learning by participants.
Public Participation in Scientific Research (PPSR), often referred to as crowdsourcing or citizen science, engages participants in authentic research, which both advances science discovery as well as increases the potential for participants' understanding and use of science in their lives and careers. This four year research project examines youth participation in PPSR projects that are facilitated by Natural History Museums (NHMs). NHMs, like PPSR, have a dual focus on scientific research and science, technology, engineering, and mathematics (STEM) education. The NHMs in this project have established in-person and online PPSR programs and have close ties with local urban community-based organizations. Together, these traits make NHMs appropriate informal learning settings to study how young people participate in PPSR and what they learn. This study focuses on three types of PPSR experiences: short-term outdoor events like bioblitzes, long-term outdoor environmental monitoring projects, and online PPSR projects such as crowdsourcing the ID of field observations. The findings of this study will be shared through PPSR networks as well as throughout the field in informal STEM learning in order to strength youth programming in STEM, such that youth are empowered to engage in STEM research and activities in their communities. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
The study employs observations, surveys, interviews, and learning analytics to explore three overarching questions about youth learning: 1) What is the nature of the learning environments and what activities do youth engage in when participating in NHM-led PPSR? 2) To what extent do youth develop three science learning outcomes, through participation in NHM-led citizen science programs? The three are: a) An understanding of the science content, b) identification of roles for themselves in the practice of science, and c) a sense of agency for taking actions using science? 3) What program features and settings in NHM-led PPSR foster these three science learning outcomes among youth? Based on studies occurring at multiple NHMs in the US and the UK, the broader impact of this study includes providing research-based recommendations for NHM practitioners that will help make PPSR projects and learning science more accessible and productive for youth. This project is collaboration between education researchers at University of California, Davis and Open University (UK), and Oxford University (UK) and citizen science practitioners, educators, and environmental scientists at three NHMs in the US and UK: NHM London, California Academy of Sciences, and NHM Los Angeles.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will develop a national infrastructure of state and regional partnerships to scale up The Franklin Institute's proven model of Leap into Science, an outreach program that builds the capacity of children (ages 3-10) and families from underserved communities to participate in science where they live. Leap into Science combines children's science-themed books with hands-on science activities to promote life-long interest and knowledge of science, and does so through partnerships with informal educators at libraries, museums, and other out-of-school time providers. Already field-tested and implemented in 12 cities, Leap into Science will be expanded to 90 new rural and urban communities in 15 states, and it is estimated that this expansion will reach more than 500,000 children and adults as well as 2,700 informal educators over four years. The inclusion of marginalized rural communities will provide new opportunities to evaluate and adapt the program to the unique assets and needs of rural families and communities.
The project will include evaluation and learning research activities. Evaluation will focus on: 1) the formative issues that may arise and modifications that may enhance implementation; and 2) the overall effectiveness and impact of the Leap into Science program as it is scaled across more sites and partners. Learning research will be used to investigate questions organized around how family science interest emerges and develops among 36 participating families across six sites (3 rural, 3 urban). Qualitative methods, including data synthesis and cross-case analysis using constant comparison, will be used to develop multiple case studies that provide insights into the processes and outcomes of interest development as families engage with Leap into Science and a conceptual framework that guides future research. This project involves a partnership between The Franklin Institute (Philadelphia, PA), the National Girls Collaborative Project (Seattle, WA), Education Development Center (Waltham, MA), and the Institute for Learning Innovation (Corvallis, OR).
Supporting and sustaining public science literacy and engagement are important goals of informal science education institutions worldwide. Although there is evidence that both science centers and natural history museums positively influence public science literacy and engagement, significant differences exist between these two types of institutions. This international workshop on Integration of Science Centers with Natural History Museums for Imparting Informal Education addresses this issue by convening key science center and natural history museum professionals from 9 countries in South and Southeast Asia, as well as the United States, to explore the strengths and limitations of the assets, philosophies and strategies of these institutions. Beyond the benefits science center and natural history museum professionals attending will receive, the effort will significantly contribute to the broader US and international conversation about the future of science centers and natural history museums, as well as other museum-like, science-rich informal education institutions, in these regions and beyond. In particular, supporting personal and cultural relevance has been a major focus of informal science education organizations globally, and the recommendations that emerge from the meeting will significantly contribute to this dialogue and help to make advances in the disciplinary field of informal science education.
This international workshop, hosted in Malaysia and facilitated by researchers from the Institute for Learning Innovation, convenes 40 science center and natural history museum professionals to explore the affordances and constraints of science centers and natural history museum exhibitions, programs, outreach efforts, websites, etc. The conference is designed to examine the opportunities, challenges and barriers to integrating key design principles that blend the best of science centers and natural history museums, while guiding the creation of new forms of 21st century informal science education institutions. Additional goals explore how to make informal science education institutions in general more relevant to 21st century publics, both culturally and personally, as well as foster intra- and international collaborations between science center and natural history museum professionals. Toward these ends, all conference participants will commit to the completion of pre-conference assignments; active preparation and involvement at the meeting; and, assistance with the dissemination of project findings. The major deliverable will be a Whitepaper describing the outcomes of the meeting and the key design principles that leverage the effectiveness and relevance of each of these institutions. The Whitepaper will be produced in both hard copy and electronic form and more broadly disseminated throughout the natural history museum and science center fields in all participating countries. The electronic form will be hosted and available for download through the website of the Institute for Learning Innovation and the Center for Advancing Informal Science Education (CAISE) with links to all participating institutions. This project is supported jointly by the NSF Office of International Science and Engineering (OISE) and the Advances in Informal STEM Education (AISL) program.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as