PocketMacro is a mobile app designed by the Learning Media Design Center at Carnegie Mellon University in collaboration with Stroud Water Research Center, Carnegie Museum of Natural History and Clemson University, and stakeholder input. The PocketMacro app aims to help users better identify benthic macroinvertebrates commonly found in streams and other waterways. Rockman et al Cooperative (REA), an independent educational evaluation group, designed a summative study to explore the effectiveness of the app in supporting users’ aquatic macroinvertebrate identification. The purpose of the
This project's goals are to:
Enable participants to contribute to any or all stages of the scientific process and enhance their learning using an online citizen science platform and live bird cams.
Generate new scientific knowledge about wildlife.
Advance the understanding of effective project design for co-created online citizen-science projects at a national scale.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
PocketMacro is a mobile app designed by The Human-Computer Interaction Institute at Carnegie Mellon University to help users better identify benthic macroinvertebrates commonly found in streams and other waterways. In Summer 2021, the app and other supplemental materials were highlighted during trainings for educators held at the Stroud Water Research Center.
The evaluation team from Rockman et al Cooperative (REA) surveyed and interviewed educators who participated in the summer trainings to determine what they took away from the experience and to gather feedback about the PocketMacro app
Learning to See, Seeing to Learn is a National Science Foundation-funded project to develop www.macroinvertebrates.org, a digital observation tool and set of informational resources that can supplement volunteer biomonitoring trainings and improve aquatic macroinvertebrates identification. Project researchers are interested in how trainers and volunteers use the tool, as well as how training that incorporates the tool impacts volunteers’ confidence in and accuracy around aquatic macroinvertebrates identification. In November 2018, project partner, Stroud Water Research Center, conducted a
Identifying private gardens in the U.K. as key sites of environmental engagement, we look at how a longer-term online citizen science programme facilitated the development of new and personal attachments of nature. These were visible through new or renewed interest in wildlife-friendly gardening practices and attitudinal shifts in a large proportion of its participants. Qualitative and quantitative data, collected via interviews, focus groups, surveys and logging of user behaviours, revealed that cultivating a fascination with species identification was key to both ‘helping nature’ and wider
DATE:
TEAM MEMBERS:
Nirwan SharmaSam GreavesAdvaith SiddharthanHelen AndersonAnnie RobinsonLaura Colucci-GrayAgung Toto WibowoHelen BostockAndrew SalisburyStuart RobertsDavid SlawsonRené van der Wal
In citizen science, user-centred development is often emphasised for its potential to involve participants in the development of technology. We describe the development process of the mobile app “Naturblick” as an example of a user-centred design in citizen science and discuss digital user feedback with regard to the users' involvement. We have identified three types of digital user feedback using qualitative content analysis: general user feedback, contributory user feedback and co-creational user feedback. The results indicate that digital user feedback can link UCD techniques with more
A team of experts from five institutions (University of Minnesota, Adler Planetarium, University of Wyoming, Colorado State University, and UC San Diego) links field-based and online analysis capabilities to support citizen science, focusing on three research areas (cell biology, ecology, and astronomy). The project builds on Zooniverse and CitSci.org, leverages the NSF Science Gateways Community Institute, and enhances the quality of citizen science and the experience of its participants.
This project creates an integrated Citizen Science Cyberinfrastructure (CSCI) framework that expands the capacity of research communities across several disciplines to use citizen science as a suitable and sustainable research methodology. CSCI produces three improvements to the infrastructure for citizen science already provided by Zooniverse and CitSci.org:
Combining Modes - connecting the process of data collection and analysis;
Smart Assignment - improving the assignment of tasks during analysis; and
New Data Models - exploring the Data-as-Subject model. By treating time series data as data, this model removes the need to create images for classification and facilitates more complex workflows. These improvements are motivated and investigated through three distinct scientific cases:
Biomedicine (3D Morphology of Cell Nucleus). Currently, Zooniverse 'Etch-a-Cell' volunteers provide annotations of cellular components in images from high-resolution microscopy, where a single cell provides a stack containing thousands of sliced images. The Smart Task Assignment capability incorporates this information, so volunteers are not shown each image in a stack where machines or other volunteers have already evaluated some subset of data.
Ecology (Identifying Individual Animals). When monitoring wide-ranging wildlife populations, identification of individual animals is needed for robust estimates of population sizes and trends. This use case combines field collection and data analysis with deep learning to improve results.
Astronomy (Characterizing Lightcurves). Astronomical time series data reveal a variety of behaviors, such as stellar flares or planetary transits. The existing Zooniverse data model requires classification of individual images before aggregation of results and transformation back to refer to the original data. By using the Data-as-Subject model and the Smart Task Assignment capability, volunteers will be able to scan through the entire time series in a machine-aided manner to determine specific light curve characteristics.
The team explores the use of recurrent neural networks (RNNs) to determine automated learning architectures best suited to the projects. Of particular interest is how the degree to which neighboring subjects are coupled affects performance. The integration of existing tools, which is based on application programming interfaces (APIs), also facilitates further tool integration. The effort creates a citizen science framework that directly advances knowledge for three science use cases in biomedicine, ecology, and astronomy, and combines field-collected data with data analysis. This has the ability to solve key problems in the individual applications, as well as benefiting the research of the dozens of projects on the Zooniverse platform. It provides benefits to researchers using citizen scientists, and to the nearly 1.6 million citizen scientists themselves.
This award by the Office of Advanced Cyberinfrastructure is jointly supported by the Division of Research on Learning in Formal and Informal Settings, within the NSF Directorate for Education and Human Resources.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Explore the Science of Spring: A Live Media Event is an Innovations in Development project produced by the signature PBS series Nature. The new primetime series Spring LIVE (working title) will break the frame of a traditional documentary, letting viewers themselves explore the dramatic seasonal changes of spring through the immediacy of live television. On-camera hosts, scientists and naturalists in locations across the U.S., and scores of citizen scientists will use observation and scientific inquiry to explore the workings of nature during this season of rebirth. The unfolding stories of seasonal change will illuminate larger scientific insights--into the biodiversity of species in habitats, the interconnectedness of plants and animals in diverse ecosystems, the global phenomenon of species migration, and how spring "green-up" can be affected by environmental change--while inspiring appreciation for species conservation and habitat preservation. Spring LIVE is conceived as an ongoing series, with this inaugural season composed of three one-hour programs broadcast live on three consecutive nights, along with real-time interactions via Facebook. Reaching long-standing Nature viewers (2.5 million per episode), Spring LIVE will seek to turn mature adults and diverse families into citizen science doers, and leverage younger Nature online audiences through social media and community engagement in partnership with citizen science projects.
Spring LIVE will build public knowledge of and engagement in phenology and citizen science. The project will also conduct knowledge-building research on the effectiveness of Facebook as a science learning tool. It will experiment with eliciting audience participation via Facebook within the live shows to generate synchronous, second-screen thought and discussion. An exploratory study by Multimedia Research will look at the impact of this feature, addressing the question: To what extent and how does Facebook interactivity within live science shows impact adult engagement, learning and motivation? Spring LIVE will also engage multiple partners to expand reach and impact and build capacity in their fields. National partners include the National Park Service and Next Avenue; citizen science partners include Celebrate Urban Birds, National Phenology Network, Monarch Blitz, and SciStarter, among others. PBS stations will work with these organizations to involve diverse, intergenerational audiences in observation of nature and seasonal change. Project evaluation, implemented by Knight Williams Research Communications, will focus on the impact of live television on science learning, and the success of the integration of citizen science projects on air, online, and in communities. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
Citizen science continues to grow, potentially increasing competition among projects to recruit and retain volunteers interested in participating. Using web analytics, we examined the ability of a marketing campaign to broaden project awareness, while driving engagement and retention in an online, crowdsourced project. The campaign challenged audiences to support the classification of >9,000 pairs of images. The campaign was successful due to increased engagement, but it did not increase the time participants spent classifying images. Engagement over multiple days was significantly shorter
DATE:
TEAM MEMBERS:
Alycia CrallMargaret KosmalaRebecca ChengJonathan BrierDarlene CavalierSandra HendersonAndrew Richardson
The mixed methods randomized experimental study assessed a model of engagement and education that examined the contribution of SciGirls multimedia to fifth grade girls’ experience of citizen science. The treatment group (n = 49) experienced 2 hours of SciGirls videos and games at home followed by a 2.5 hour FrogWatch USA citizen science session. The control group (n = 49) experienced the citizen science session without prior exposure to SciGirls. Data from post surveys and interviews revealed that treatment girls, compared to control girls, demonstrated significantly greater interest in their