As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
Considering whether to volunteer to be an NSF AISL reviewer? Here’s some information to help you decide if you are a good fit. Each year, the NSF Advancing Informal STEM Learning program looks for peer reviewers. New reviewers often have questions about the commitment to review. This slide deck is to help you understand what reviewers do and the commitments they make considering issues about time commitment, activities, money, etc.
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
The landscape for out-of-school STEM learning in Hong Kong is evolving. In 2017, to capture this change, the Croucher Foundation conducted a mapping exercise. This is the second annual mapping exercise conducted by the Croucher Foundation.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with almost 2,000 discrete activities covering a very wide range of science disciplines. This second report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through
The Water for Life project has been an effective, and in some cases an essential vehicle for addressing issues around water quality and retention in island settings where water security is an on-going challenge. The focus on local partnerships was a highly valued attribute of the WfL project, and the informal science and conservation education resources produced and disseminated by the project have had a significant impact on these populations
The Head Start on Engineering project engages parents and children in a multicomponent family engineering program that includes professional development for teachers, workshops for parents, take-home family activity kits, home visits, classroom extensions, and a culminating field trip to a science center.
Throughout their lives, children from low socioeconomic backgrounds and traditionally underserved and under-resourced communities face significant barriers to engaging with engineering and science (Gershenson 2013; Orr, Ramirez, and Ohland 2011). Supporting learning and interest
The Croucher Foundation recently embarked on a research study to explore informal science learning in Hong Kong. This is the first study to focus on the out-of-school ecosystem for science learning in Hong Kong. This exploratory and investigative study identified over a thousand out-of-school STEM activities that happened between June 2015 and May 2016, including courses, workshops and exhibitions available to Hong Kong school students over this twelve-month period. The study excluded tutorials and exam-orientated courses and focused instead on activities designed to encourage an interest in
The Baltimore Museum of Art (BMA) contracted Randi Korn & Associates, Inc. (RK&A) to conduct reflective case studies of the Outpost, a mobile art museum that took up temporary residence at a variety of sites across Baltimore from 2014-2016. At each site, visitors to the Outpost had the opportunity to view reproductions of artworks from the museum’s collection, make art, and share their experiences of place, home, and life in Baltimore.
RK&A conducted case studies of 10 former Outpost sites, which the BMA chose because they represented a variety of host organization types (e.g., social
DATE:
TEAM MEMBERS:
Stephanie DowneyCathy SigmondBaltimore Museum of Art
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly
Campaigns by zoos, aquariums, and other civil society organizations are an important tool for promoting social changes that benefit the environment. Here, we evaluate a global biodiversity education campaign's impact through a repeated-measures survey of nearly 5000 visitors to 20 zoos and aquariums located in 14 countries. By comparing visitors’ pre- and post-visit responses combined across respondents, we found significant aggregate improvements in their biodiversity understanding and their knowledge of actions to help protect biodiversity. Respondents who reported seeing the education