This project will research factors influencing the implementation of programs designed to increase diverse participation in informal science. The goal is to provide the informal science education field with information and tools that will help them design effective programs that more effectively engage a broad range of diverse audiences. The project has two major components. First, the project will research the implementation of a citizen science project, Celebrate Urban Birds (CUB), in major U.S. cities. Citizen science projects involve public volunteers in gathering scientifically valid data as part of ongoing research. Second, building on results of the research, the project will launch a website and learning community (called a Community of Practice or CoP) supporting informal science educators that are involved in designing and implementing informal science programs with an emphasis on engaging diverse participants. The project will be lead by the Cornell Lab of Ornithology (CLO), a leader in designing and researching citizen science projects, in collaboration with the Association of Science-Technology Centers (ASTC) and five science center members of ASTC, where the CUB program will be implemented and researched. The objective of the research is to better understand contextual factors and how they impact implementation even when accepted practices are followed. Such research is key not only to revealing accepted practices but also to understanding how projects are implemented in the face of concrete operational, cultural, economic, and demographic variables. The research will use a comparative case study approach, which is designed for studies requiring holistic, in-depth investigation. The development of the website and the CoP will be guided by a Network Improvement Strategy, a research-based approach to designing educational CoPs. The development of the CoP will involve the project stakeholders including the informal science organization practitioners, community organization representatives, CUB staff, ASTC staff, advisors and consultants. This strategy will allow the project team and pilot sites to leverage their diverse experiences and skill sets to improve practice; provide space for researchers and practitioners to work together as partners; and develop a nuanced set of strategies that can be implemented across a variety of organizational contexts.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
The Citizen Science Embedded Assessment project will explore the use of embedded assessment to measure participant science inquiry skill development within the context of citizen science projects. Citizen science (CS) projects partner volunteers with scientists to participate directly in research endeavors. Embedded assessments (EAs) assess participant skills and performance that are directly integrated and are indistinguishable from day-to-day activities. As such, EAs allow learners to demonstrate their science competencies through tasks that are integrated seamlessly into the learning experience itself. The CS field has a growing inventory of self-assessment tools, however, the evaluation of citizen science (and other informal science projects) using such subjective assessments can be remarkably improved when these are used in combination with objective measures of knowledge, skills or other resources participants gain through their participation. Science skills, such as data collection and analysis, are particularly important for CS projects because of their focus on the scientific process and their need for rigorous data collection. Despite the focus on skill gains, CS projects rarely measure such improvements. Embedded assessments (EAs) offer a critical method for understanding the impacts of these participatory learning environments. The project will develop and field test EAs on citizen science topics with an environmental science focus. It will also design training to support their use by individual projects. The project has three primary research foci: (1) identifying common and unique science inquiry skills targeted by CS projects, and how skills are currently being measured to document project impact; (2) identifying the opportunities and challenges present in developing and administering EA tools customized for CS projects to assess science inquiry skills; and (3) assessing whether EA tools created for a CS project can provide project leaders with a better understanding of their project's impact on participant science inquiry skills. The project will address these questions with a needs assessment of research and evaluation studies within the CS community and case studies to develop and test EAs customized for three identified and interested CS projects.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
As popular visitor destinations, zoos play a vital role in enhancing understanding of animal biology, conservation, and biodiversity. But what do visitors already understand? This study examined visitors’ knowledge of animal biology and their understanding of how human activity may affect biodiversity. The findings led to a modification of a model that illustrates visitors’ levels of understanding of animal biology and the conservation of biodiversity.
This paper examines how students, teachers, and parents evaluate residential fieldwork courses. As in prior research, findings from questionnaire data indicate that fieldwork effects social, affective, and behavioural learning. More surprisingly, focus group interviews captured increases in cognitive learning as well. This paper underscores the value of out-of-school experiences, particularly for students from under-resourced backgrounds.
This study examines how youth navigate socioscientific issues through the case studies of two students in an afterschool program. The study explores how the students’ thinking changed during the program and what influenced the students’ final stance on whether or not to build a new hybrid power plant in their community.
A two stage summative evaluation was conducted following the launch of the Mystic Seaport for Educators website, the final output resulting from the IMLS National Leadership grant entitled Mystic E-Port Digital Classroom project. The results of four focus groups, conducted in two phases, found consistent results suggesting that the project was successful at achieving all four goals as outlined in the original grant proposal. Appendix includes focus group protocol.
This analysis of visitors’ experience of the "Congo Gorilla Forest" exhibition at the Wildlife Conservation Society’s Bronx Zoo was commissioned to investigate how this 15 year old exhibition is perceived by visitors, and if things have changed since an original summative evaluation in 1999-2000. Questions of particular interest were: 1. Have the characteristics of visitors seeing this exhibition changed? Has awareness or interest in environmental concepts changed? 2. Is the exhibition still appealing to visitors? 3. Are exhibit components such as the film and Conservation Choices Computers
Through a critical ethnography, Birmingham and Calabrese Barton examined why and how a group of six middle school girls took civic action, defined as “educated action in science,” after studying green energy in an afterschool science program. The paper follows the students’ process in planning and implementing a carnival to engage their community in energy conservation and efficiency issues.
Hamlin provides a how-to guide for leveraging traditional ecological knowledge (TEK) to teach science in indigenous contexts. Her process uses the Vitality Index of Traditional Ecological Knowledge with ethnography to identify TEK. She describes how a community-driven program used TEK to expand the learning opportunities of a historically oppressed group: Maya women in Guatemala.
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. The project seeks to develop and study a model that would integrate the science research on urban systems into science museum exhibits and programs, starting in this phase in a new "City Science" exhibit space at the EcoTarium. The goal is to learn how to assist citizens in decision-making and shaping a sustainable future for their communities.