As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The proposed project broadens the utility of Public Participation in Scientific Research (PPSR) approaches, which include citizen science, to support new angles in informal learning. It also extends previous work on interactive data visualizations in museums to encompass an element of active contribution to scientific data. To achieve these goals, this project will develop and research U!Scientist (pronounced `You, Scientist!')--a novel approach to using citizen science and learning research-based technology to engage museum visitors in learning about the process of science, shaping attitudes towards science, and science identity development. Through the U!Scientist multi-touch tabletop exhibit, visitors will: (1) interact with scientific data, (2) provide interpretations of data for direct use by scientists, (3) make statements based on evidence, and (4) visualize how their data classifications contribute to globe-spanning research projects. Visitors will also get to experience the process of science, gaining efficacy and confidence through these carefully designed interactions. This project brings together Zooniverse, experts in interactive design and learning based on large data visualizations in museums, and leaders in visitor experience and learning in science museums. Over fifty thousand museum visitors are expected to interact annually with U!Scientist through this effort. This impact will be multiplied by packaging the open-source platform so that others can easily instantiate U!Scientist at their institution.
The U!Scientist exhibit development process will follow rapid iterations of design, implementation, and revision driven by evaluation of experiences with museum visitors. It will involve close collaboration between specialists in computer science, human-computer interaction and educational design, informal science learning experts, and museum practitioners. The summative evaluation will be based on shadowing observations, U!Scientist and Zooniverse.org logfiles (i.e., automated collection of user behavior metrics), and surveys. Three key questions will be addressed through this effort: Q1) Will visitors participate in PPSR activities (via the U!Scientist touch table exhibit) on the museum floor, despite all the distractions and other learning opportunities competing for their attention? If so, who engages, for how long, and in what group configurations? Q2) If visitors do participate, will they re-engage with the content after the museum visit (i.e., continue on to Zooniverse.org)? Q3) Does engaging in PPSR via the touch table exhibit--with or without continued engagement in Zooniverse.org after the museum visit--lead to learning gains, improved understanding of the nature of science, improved attitudes towards science, and/or science identity development?
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings.The project plans to develop evidence-based principles to guide citizen science project owners in the coordinated management of project participants within the SciStarter landscape. SciStarter is a repository of over 1,500 citizen science (CS) projects. Through prior research, SciStarter 2.0 tools were developed which can be used to study and coordinate recruitment and retention strategies across projects. Coordinated management has the potential to deepen volunteer learning and growth and benefit project goals because it can address across-project skew (CS volunteers involved in multiple projects), evolving motivations, seasonal gaps, untapped synergies across projects, and other unanticipated factors that cannot be addressed via management within project silos. The project will increase the capacity of citizen science projects to achieve their myriad scientific, learning and conservation goals through enhanced coordination of volunteer management, facilitated by evidence-based guidance from the SciStarter's User's Manual for Project Owners. The findings of the research will guide project design and implementation towards synergies that increase the capacity of projects to generate scientific, learning, and conservation outcomes. Research about citizen scientists has focused on within-project assessments and comparisons of projects, but few have examined dynamics of recruitment, retention, and movement of individuals across projects. SciStarter is designed for embedded tracking of participation dynamics in a landscape of projects. The project will expand embedded assessment to measure scientific, learning, and conservation outcomes and their links to participation dynamics within and across projects. Through social network analysis, the project will describe patterns of bridges, ties, and distances among projects based on the cross-over of participants. The project will also propose qualitative research to understand project managers' perceptions of SciStarter and the costs and benefits of coordinated management of citizen scientists. The research is designed to provide insights into participation dynamics that will lead to subsequent knowledge building across citizen science projects, and determine whether new evidence about advantages and disadvantages of coordinated management will persuade project owners to rely less on the silo approach to volunteer management.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal Science Learning program funds innovative research, approaches and resources for use in a variety of settings. This Exploratory Pathways project brings together scientists and science curriculum experts with field station leaders to study informal science learning at biological field stations. The objective is to understand and evaluate the unique qualities of field stations as centers of informal and enduring science learning for the non-science community. There are over 400 field stations and represent a science communication mechanism that if available to most US citizens. This project is a collaboration between Texas A&M University and Colorado State University.
Field stations typically engage in informal science learning. While there are great examples of informal learning through outreach activities at field stations, little is known about what is happening in the aggregate at these establishments. This project documents the outreach work of field stations and explores the connections between how the outreach activities engage learners, incorporate science topics, and address science learning. By creating an Outreach Ontology, a multidimensional framework around the outreach activities, this work provides a valuable resource and reference to informal science researchers who seek to understand what informal learning projects are undertaken at field stations, and how these activities fit into the broader context of informal science learning. This project will help field stations collaborate on improving informal STEM learning activities by bringing them together to discuss their efforts and by developing a publicly available, searchable database detailing their activities. A particular benefit to advancing informal STEM learning by investigating field stations is the broad range of people and communities that are involved with and affected by field station outreach activities.
Public Participation in Scientific Research (PPSR), often referred to as crowdsourcing or citizen science, engages participants in authentic research, which both advances science discovery as well as increases the potential for participants' understanding and use of science in their lives and careers. This four year research project examines youth participation in PPSR projects that are facilitated by Natural History Museums (NHMs). NHMs, like PPSR, have a dual focus on scientific research and science, technology, engineering, and mathematics (STEM) education. The NHMs in this project have established in-person and online PPSR programs and have close ties with local urban community-based organizations. Together, these traits make NHMs appropriate informal learning settings to study how young people participate in PPSR and what they learn. This study focuses on three types of PPSR experiences: short-term outdoor events like bioblitzes, long-term outdoor environmental monitoring projects, and online PPSR projects such as crowdsourcing the ID of field observations. The findings of this study will be shared through PPSR networks as well as throughout the field in informal STEM learning in order to strength youth programming in STEM, such that youth are empowered to engage in STEM research and activities in their communities. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
The study employs observations, surveys, interviews, and learning analytics to explore three overarching questions about youth learning: 1) What is the nature of the learning environments and what activities do youth engage in when participating in NHM-led PPSR? 2) To what extent do youth develop three science learning outcomes, through participation in NHM-led citizen science programs? The three are: a) An understanding of the science content, b) identification of roles for themselves in the practice of science, and c) a sense of agency for taking actions using science? 3) What program features and settings in NHM-led PPSR foster these three science learning outcomes among youth? Based on studies occurring at multiple NHMs in the US and the UK, the broader impact of this study includes providing research-based recommendations for NHM practitioners that will help make PPSR projects and learning science more accessible and productive for youth. This project is collaboration between education researchers at University of California, Davis and Open University (UK), and Oxford University (UK) and citizen science practitioners, educators, and environmental scientists at three NHMs in the US and UK: NHM London, California Academy of Sciences, and NHM Los Angeles.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
During the school year of 2016-2017, Fairchild Tropical Botanic Garden (Fairchild) implemented the first year of a four-year project entitled: Growing Beyond Earth (GBE). NASA is providing funding support for project implementation as well as an external project evaluation.
The evaluation activities conducted this year were focused on understanding project implementation and exploring project outcomes using data collected between September 2016 and May 2017. This report’s findings and accompanying recommendations inform next year’s project implementation and evaluation activities.
DATE:
TEAM MEMBERS:
Catherine RaymondAmy RubinsonCarl LewisMarion LitzingerAmy Padolf
In the project entitled "The GLOBE Program 2010: Collaborative Environmental Research at Local to Global Scales," the University Corporation for Atmospheric Research (UCAR) will improve the functionality of the GLOBE Program by providing: (1) new methods, tools, and services to enhance GLOBE Partner and teacher abilities to facilitate inquiry-based learning and student research, (2) initial pilot testing and assessment of student and teacher learning activities and events related to Climate Science research, (3) improvements in GLOBE's technology infrastructure and data systems (e.g. database, social networking, information management) to support collaborations between students, scientists, and teachers, and (4) development of a robust evaluation plan. In addition, the UCAR will continue to provide support to the worldwide GLOBE community, as well as program management and timely communication with program sponsors.
In 2016, more than 120 National Park Service (NPS) units conducted BioBlitzes, supported by a collaboration between The National Geographic Society and the National Park Service. The Lawrence Hall of Science conducted an evaluation of participant and park outcomes at the cornerstone BioBlitz throughout the National Capital region, at the large (regional) Showcase BioBlitzes, and at additional events at National Parks across the US. The report includes a description of the evaluation project, case studies from 3 BioBlitzes, findings, recommendations, and the instruments used to measure
Citizen science is an important way of engaging a broad range of audiences in science inquiry by participating in research that asks novel questions and unearths new knowledge and new questioning. Though citizen science projects are quite diverse in their scientific pursuits, all projects share the common element of involving volunteers directly in some aspect of science inquiry. Thus, it is essential for citizen science projects to determine their participants’ capacity to learn and successfully perform science inquiry skills, such as making scientific observations, collecting and analyzing
Citizen science has proven useful in advancing scientific research, but participant learning outcomes are not often assessed. This case study describes the implementation and tailoring of an in-depth assessment of the educational impact of two citizen science projects in an undergraduate, general education course. Mixed-methods assessment of citizen science within a college classroom demonstrates that public participation in scientific research can positively alter attitudes towards science. The timing and type of assessments yielded significantly different results and qualitative assessment
DATE:
TEAM MEMBERS:
Tyler VitoneKathryn StoferM. Sedonia SteningerJiri HulcrRobert DunnAndrea Lucky
As science museums and centres (SMC) broaden their practices to include the development of scientific citizenship, evaluation needs also to take account of this dimension of their practices. It requires complex methods to understand better the impacts of public participation in activities mediated by SMC, including their impacts on the governance of the SMC themselves.