As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects.
The specific areas of study are:
a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI.
b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research.
c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement.
d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations.
Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Over the seven years prior to this award, the principal investigator from George Mason University and a national team of scientists, professional societies, science communication researchers, and broadcast meteorologists have been engaged in an effort to include in TV and other weather broadcasts information about current research on the interactions of climate and weather. A Climate Matters network has been established that involves 350 weathercasters at 218 stations, in 119 media markets, nationwide. A particular focus of the initiative has been to help the public become more familiar with the science behind how their local weather and its trends are related to the dynamics of the climate. Many communities nationwide are engaged in deliberations about how to understand, plan for, and adapt to the potential impacts of changes in their weather on important factors pertaining to their economy and well-being, such as natural resources, natural disasters, agriculture, industry, and health. The goal of this continuing project is to expand the quantity and nature of the coverage of such information into the news segments of local news media. By stimulating local reporting on climate impacts and their relationships to personal and community-wide decision-making, this project will potentially help millions of Americans better understand and respond to critical factors that are affecting their lives. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project involves five inter-related, complementary activities: (1) Knowledge building through formative research and process evaluation, specifically in-depth interviews and random sample surveys of journalists in each of the participating journalism professional societies; (2) Recruiting 400 news directors, producers, reporters and additional weathercasters into the Climate Matters network; (3) Providing climate reporting training and professional development to members of the network; (4) Producing and distributing Climate Matters reporting packages to all members of the network on a near-weekly basis; and (5) Evaluating the impacts of the climate reporting on public understanding of science.
DATE:
-
TEAM MEMBERS:
Edward MaibachSusan HassolBernadette PlackyRichard CraigTeresa Myers
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will conduct research designed to deepen our fundamental knowledge about culture, experience, and ecosystems cognition and to develop innovative practices and approaches to support learning about changing ecological systems and environmental decision making. Work on cultural differences in the production of complex systems knowledge is severely lacking. This gap in knowledge may contribute to the continued reproduction of inequities in science education. More broadly findings from this project will have clear implications for theories of cognitive development, especially those pertaining to how knowledge is shaped by culture and experience. Focusing on ecosystems may represent an opportunity to not only increase engagement and achievement in science among non-dominant communities and Native youth specifically, but also advance effective learning for all communities. The primary deliverables for the project are conference presentations and research publications. However, the project will also develop additional resources freely available to researchers, educators, and the general public. These will include summer curricular materials and teaching tools, professional development workshops, practitioner briefs about research findings that can be used in professional development workshops and shared share more broadly, and evaluation reports.
A deeper understanding of cultural influences on conceptions of the natural world can serve to advance the educational needs of children, including children from diverse linguistic and cultural backgrounds. Project research will include two interrelated series of studies designed to expand knowledge about human cognition of complex ecosystems and the affordances of informal STEM learning environments in developing and supporting the critical 21st century skill of ecological systems level reasoning. The first consists of a series of experiments focused on ecological cognition and the role of humans in nature. The second consists of design-based research interventions in informal settings, summer workshops for youth and the communities, focused on ecological systems level thinking and socio-environmental decision making. The project will recruit and engage both child and adult participants from two broad cultural communities, Native Americans and European Americans living in urban and suburban communities, in part because it affords a sharp test of human-nature relations. Sampling from two different urban communities will avoid simple Native-non-Native comparative binaries and to conduct Native-to-Native comparative analysis. Based on results from this, the project will result in: 1) foundational knowledge about human learning and reasoning and ecosystems and environmental decision making, 2) culturally responsive models of learning and practice about complex ecosystems for indoors and outdoors informal learning environments, and 3) insights about research-practice-community partnerships. One important objective of the research is to broaden participation and close opportunity gaps for under-represented groups in STEM fields broadly and more specifically for Indigenous people. Members of Indigenous communities, who provide strong role models for other aspiring scholars, will be involved as postdoctoral fellows, research assistants and graduate fellows.
Polar Extremes: Enhancing Experiential Digital Learning is an integrated media and research project produced by the PBS science series, NOVA, that will bring polar science to informal learners through traditional storytelling and experiential, digital learning environments. Stark, cold, and seemingly frozen in time, the top and bottom of the Earth feel other-worldly, completely removed from our everyday existence. Yet, nothing could be further from the truth. The Arctic and Antarctic exert profound influence over our entire planet. Disturbances in these icy realms can send transformative ripples around the globe, altering the circulation of the atmosphere and oceans, and affecting every form of life. And although the poles might seem constant and everlasting, they--like our planet--are always changing, with a deep and complex past. NOVA will provide informal science learners access to specialized research happening at the ends of the earth, introducing them to today's scientists exploring the major drivers of the climate, uncovering the deep history of past paleoclimates, or perfecting climate and weather models. The project includes: a 2-hour nationally broadcast PBS documentary (working title Polar Extremes); a NOVA Polar Lab, an experiential interactive learning platform on polar science; and a Polar Exploration Initiative consisting of a 10-part YouTube series, a collection of 360 videos, virtual field trips, and social media reporting "on location" from Antarctica, along with other polar-themed video, radio and digital journalism. It also includes a research program conducted in collaboration with the University of California, Santa Barbara (UCSB) to study how narrative-driven and experiential learning can foster informal learning in polar science across a diverse array of audiences. NOVA, the most popular science program on television, with a robust digital presence, will bring current polar science to millions. NOVA will use a range of media to transport viewers to remote polar locations, to interact with polar scientists, manipulate polar data, or vicariously explore the frozen tundra--using a mix of learning approaches. This project will develop and test the impact of two forms of informal learning: traditional narrative-driven storytelling and active, experiential learning. Both components will be developed through audience research, formative evaluation or pilot testing, and experiments. The overarching goal is to determine the best way to combine and leverage traditional and interactive media technologies to educate the public about polar science. How can these modes enhance learning outcomes? The study uses the Informal Science Learning "strand framework" developed by the National Research Council in Learning Science in Informal Environments: People, Places, and Pursuits (2009). Because different age groups and socioeconomic backgrounds may engage differently with different types of learning materials and platforms, the project components are designed to test a variety of different learning approaches, with different audiences. This study will be one of the first to address the relative efficacy of various forms of experiential education and whether active versus vicarious experiential learning depends on the characteristics of the learners. As engagement technologies continue to evolve, this project will help inform how to best design and apply them effectively. The project will apply these new lessons specifically to present polar research to the public and to offer audiences an opportunity to explore and learn about these remote regions in new ways that bring them to life, make them relevant, and enhance learning outcomes. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project has co-funding support from the Office of Polar Programs (OPP).
DATE:
-
TEAM MEMBERS:
Paula ApsellLisa LeombruniJulia CortHunter Gehlbach
Cities and communities in the U.S. and around the world are entering a new era of transformational change, in which their inhabitants and the surrounding built and natural environments are increasingly connected by smart technologies, leading to new opportunities for innovation, improved services, and enhanced quality of life. The Smart and Connected Communities (SCC) program supports strongly interdisciplinary, integrative research and research capacity-building activities that will improve understanding of smart and connected communities and lead to discoveries that enable sustainable change to enhance community functioning. This project is a Research Coordination Network (RCN) that focuses on achieving SCC for medium/small size, remote, and rural communities through a polycentric (multiple centers) integrated policy, design, and technology approach. The communities served by the RCN have higher barriers to information, resources, and services than larger urban communities. To reduce this gap, the PIs propose to develop need-based R&D pipelines to select solutions with the highest potential impacts to the communities. Instead of trying to connect under-connected communities to nearby large cities, this proposal aims to develop economic opportunities within the communities themselves. This topic aligns well with the vision of the SCC program, and the proposed RCN consists of a diverse group of researchers, communities, industry, government, and non-profit partners.
This award will support the development of an RCN within the Commonwealth of Virginia which will coordinate multiple partners in developing innovations utilizing smart and connected technologies. The goal of the research coordination network is to enable researchers and citizens to collaborate on research supporting enhanced quality of life for medium, small, and rural communities which frequently lack the communication and other infrastructure available in cities. The research coordination network will be led by the University of Virginia. There are 14 partner organizations including six research center partners in transportation, environment, architecture and urban planning, and engineering and technology; two State and Industry partners (Virginia Municipal League and Virginia Center for Innovative Technology); four community partners representing health services (UVA Center for Telemedicine), small and remote communities (Weldon Cooper Center), neighborhood communities (Charlottesville Neighborhood Development), and urban communities (Thriving Cities); and two national partners which support high speed networking (US-Ignite) and city-university hubs (MetroLab). Examples of research coordination include telemedicine services, transportation services, and user-centric and community-centric utilization and deployment of sensor technologies.
DATE:
-
TEAM MEMBERS:
Ila BermanT. Donna ChenKaren RheubanQian Cai
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings.The project plans to develop evidence-based principles to guide citizen science project owners in the coordinated management of project participants within the SciStarter landscape. SciStarter is a repository of over 1,500 citizen science (CS) projects. Through prior research, SciStarter 2.0 tools were developed which can be used to study and coordinate recruitment and retention strategies across projects. Coordinated management has the potential to deepen volunteer learning and growth and benefit project goals because it can address across-project skew (CS volunteers involved in multiple projects), evolving motivations, seasonal gaps, untapped synergies across projects, and other unanticipated factors that cannot be addressed via management within project silos. The project will increase the capacity of citizen science projects to achieve their myriad scientific, learning and conservation goals through enhanced coordination of volunteer management, facilitated by evidence-based guidance from the SciStarter's User's Manual for Project Owners. The findings of the research will guide project design and implementation towards synergies that increase the capacity of projects to generate scientific, learning, and conservation outcomes. Research about citizen scientists has focused on within-project assessments and comparisons of projects, but few have examined dynamics of recruitment, retention, and movement of individuals across projects. SciStarter is designed for embedded tracking of participation dynamics in a landscape of projects. The project will expand embedded assessment to measure scientific, learning, and conservation outcomes and their links to participation dynamics within and across projects. Through social network analysis, the project will describe patterns of bridges, ties, and distances among projects based on the cross-over of participants. The project will also propose qualitative research to understand project managers' perceptions of SciStarter and the costs and benefits of coordinated management of citizen scientists. The research is designed to provide insights into participation dynamics that will lead to subsequent knowledge building across citizen science projects, and determine whether new evidence about advantages and disadvantages of coordinated management will persuade project owners to rely less on the silo approach to volunteer management.
Lineage is a comprehensive educational media and outreach initiative that will engage individuals and families in learning about deep time and evolution, helping audiences come to newfound understandings of the connections between the past, present, and future of life on Earth. The project is a partnership between Twin Cities PBS (TPT) and the Smithsonian Institution's National Museum of Natural History and is linked to the opening of that museum's new Deep Time Fossil Hall in June 2019. The project includes a two-hour film for national broadcast on PBS, and a 20-minute short version for exhibition in science centers. The documentaries will show how scientists, using paleontology, genetics, earth science and other disciplines, can reconstruct in detail the origins of living animals like birds and elephants, revealing their ancient past as well as evidence of ecological change that can inform our understanding of Earth today. Extensive educational outreach will include the creation of "Bone Hunter," an innovative VR (Virtual Reality) game designed for family co-play that engages multiple players in the process of paleontology as they piece together a fossil in a digital lab. Bone Hunter and other collaborative educational activities will be deployed at Family Fossil Festivals that will attract multi-generational learners. One such Festival will take place at the Smithsonian Institution in Washington, D.C., while others will be based at geographically diverse institutions that serve underserved rural as well as urban communities. Lineage is a collaboration between national media producers, noted learning institutions and researchers, including Twin Cities Public Television, the Smithsonian Institution / National Museum of Natural History, Schell Games, the Institute for Learning Innovation (ILI), and Rockman et al. One of the project's primary innovations is its exploration of new learning designs for families that use cutting-edge technologies (e.g. the Bone Hunter virtual reality game) and collaborative multi-generational learning experiences that advance science knowledge and inquiry-based learning. An external research study conducted by ILI will investigate how intergenerational co-play with physical artifacts compared to virtual artifacts influences STEM (Science Technology Engineering Mathematics) learning and engagement. The findings will lead to critical strategic impacts for the field, building knowledge about ongoing innovation in the free choice learning space. The project's external evaluation will be conducted by Rockman et al and evaluative findings, as well as the educational materials derived from the project, will be widely disseminated through partnerships with professional and educator groups. Clips from the Lineage film and related learning resources will be hosted on PBS LearningMedia, so educators can incorporate these resources into their classrooms, and students and lifelong learners can explore and discover on their own. The project outcomes will have broad impact on public audiences, deepening and advancing knowledge and understanding about important scientific concepts, and promoting continued, family-based collaborative learning experiences to expand and deepen STEM knowledge. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will use a design-based research process to research and develop an innovative theatrical game that will improve visitors' understanding of complex topics requiring conceptual change. This project will research a novel experience that helps visitors engage with difficult content in informal science education venues, uses existing exhibit and collection assets in a new way, and creates a venue for visitor engagement that requires less capitalization than a full exhibition project. For the public, this project will blend best practices from exhibit development, museum theater, and facilitation with emerging theories about game-based learning to create a novel experience that deeply engages visitors with an evolution storyline and allows them to explore the museum and interact with one another in new ways. For the field, the project will examine how theatrical games can be valuable, viable experiences in museum environments and what game mechanics and supports contribute to players' conceptual thinking. While the project's games with theatrical elements will focus on evolution, the tested strategies will provide valuable information about effective approaches for informal STEM education more broadly wherever audiences exhibit major misconceptions or discomfort with scientific ideas. The project will disseminate findings through conferences and workshops, academic reports, a research-to-practice implementation guide, and a training video about best practices for engaging the public in theatrical gaming.
The project will focus on the creation and modification of a theoretical framework that describes the content, program format, and degree of facilitation necessary to create experiences that support conceptual change in visitors' thinking about evolution--and, by extension, other complex topics. The project team and advisors will collaboratively will build varying levels of facilitation and challenge into theatrical programming that connects objects and experiences across the museum to help visitors construct a story of evolution. Project research will focus on the creation of three variants of a theatrical game to test a theoretical framework that describes the game dynamics and facilitation necessary for experiences that support conceptual shifts in visitors' understanding about evolution. This work will take place in four phases, and will be conducted by researchers at the Science Museum of Minnesota with input and review through an external evaluation process. The questions guiding the research are: (1) How, and in what ways, do game design features support conceptual shifts in evolution concepts?; (2) Do player outcomes differ in each game? If so, in what ways?; (3) What other factors (player profile, collaboration, evolution beliefs) influence player outcomes? (4) What are the best practices for facilitating the games and supporting visitors' experiences? The research will contribute to the under-studied field of participatory museum theatre experiences; broaden our understanding of the roles facilitation and gameplay have in informal learning; and help exhibit and program developers make informed choices about the potential of various exhibit components and aligned programming.
As higher education institutions (HEIs) work to enhance Broader Impacts (BI) efforts, collaborations with informal science education institutions (ISEs) (e.g. science centers, aquaria, zoos) can help them strengthen their impact and reach broader audiences. This project builds on the successful Portal to the Public (PoP) framework, bringing together the expertise and resources of HEIs and ISEs around the shared mission of engaging public audiences in current STEM research. The project is designed to address several critical needs: (1) Public outreach BI activities are relatively uncommon compared to BI that is focused within the infrastructure of academia; (2) Because collaborations with ISEs are frequently tied to individual Principal Investigators (PIs), there is limited opportunity to build a body of knowledge around the practice of partnering for BI work; and (3) Collaborations are often transient, making it more difficult for universities to view BI on an institutional level in ways that leverage particular institutional assets or strategies and even link investigators from multiple projects. The specific areas of study are: a. Develop and test a structure for education/outreach BI experience design that addresses a public audience need and meets NSF's BI criterion: The project will create disseminatable tools around the activity design process (including evaluation of learning impacts). By convening cross-disciplinary teams, the project will ensure that experiences will reflect a wide range of expertise and will help meet the needs of multiple stakeholders. These established structures will lower the barrier to entry for PIs who want to do public outreach BI. b. Design, test, and study structures for long-term, mutually beneficial HEI-ISE partnerships: The project will build on the proven PoP model to create flexible, disseminatable tools around the development of institutional partnerships at three collaborating HEI-ISE site pairings that consider each institution's resources, constraints and strategic goals, including a cross-institutional and cross-disciplinary Broader Impacts Design (BID) Team structure. Sustained partnerships will support ongoing public engagement with current STEM research. c. Anchor the partnership at the HEI with a representative from an office of research support: Research support professionals will be a core part of the BID Team and will help support institutional strategies for aligning BI activities with broader goals around community engagement. d. Study the culture of HEI-ISE partnerships, building knowledge about how these institutions can form effective, sustained and mutually beneficial collaborations. Project partners include Pacific Science Center with the University of Washington, Bothell, WA; University of Wisconsin-Madison with the Wisconsin Institute for Discovery; and the Sciencenter with Cornell University, Ithaca, NY. In addition, the Center for Research in Lifelong Learning, Oregon State University will oversee the research aspects of the project. The project's primary benefit is the development of more effective mechanisms for HEIs and ISEs to collaborate, that will better enable them to engage their communities in experiences and conversations about current STEM research and innovation. This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).