The Citizen Science Embedded Assessment project will explore the use of embedded assessment to measure participant science inquiry skill development within the context of citizen science projects. Citizen science (CS) projects partner volunteers with scientists to participate directly in research endeavors. Embedded assessments (EAs) assess participant skills and performance that are directly integrated and are indistinguishable from day-to-day activities. As such, EAs allow learners to demonstrate their science competencies through tasks that are integrated seamlessly into the learning experience itself. The CS field has a growing inventory of self-assessment tools, however, the evaluation of citizen science (and other informal science projects) using such subjective assessments can be remarkably improved when these are used in combination with objective measures of knowledge, skills or other resources participants gain through their participation. Science skills, such as data collection and analysis, are particularly important for CS projects because of their focus on the scientific process and their need for rigorous data collection. Despite the focus on skill gains, CS projects rarely measure such improvements. Embedded assessments (EAs) offer a critical method for understanding the impacts of these participatory learning environments. The project will develop and field test EAs on citizen science topics with an environmental science focus. It will also design training to support their use by individual projects. The project has three primary research foci: (1) identifying common and unique science inquiry skills targeted by CS projects, and how skills are currently being measured to document project impact; (2) identifying the opportunities and challenges present in developing and administering EA tools customized for CS projects to assess science inquiry skills; and (3) assessing whether EA tools created for a CS project can provide project leaders with a better understanding of their project's impact on participant science inquiry skills. The project will address these questions with a needs assessment of research and evaluation studies within the CS community and case studies to develop and test EAs customized for three identified and interested CS projects.
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.
The University of Southern California's Institute for Creative Technologies (ICT) and the Museum of Science, Boston (MoS) were awarded an Informal Science Education grant from the National Science Foundation (#0813541) for the project, Responsive Virtual Human Museum Guide. The goal of the project was to use computer-generated character animation, artificial intelligence, and natural language processing to create interactive characters, or virtual humans, that could engage in face-to-face communication with museum visitors. During the three year project, the MOS and ICT project teams created
DATE:
TEAM MEMBERS:
Susan FoutzJeanine AnceletKara HershorinLiz DanterUniversity of Southern CaliforniaMuseum of Science
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
This paper examines how students, teachers, and parents evaluate residential fieldwork courses. As in prior research, findings from questionnaire data indicate that fieldwork effects social, affective, and behavioural learning. More surprisingly, focus group interviews captured increases in cognitive learning as well. This paper underscores the value of out-of-school experiences, particularly for students from under-resourced backgrounds.
This article provides firm evidence, for formal and informal educators alike, that shared learning can be powerful and meaningful, if carefully considered. Findings from a study conducted in a summer middle school mathematics class suggest that when students are able to ask legitimate, authentic questions and share understanding about a common problem, their learning becomes truly “distributed by design.”
Museum educators rarely experience ongoing training. They tend to rely on their past experiences of teaching and learning to guide their interactions with learners. Allen and Crowley describe the implementation of a new school trip program that challenged museum educators’ beliefs. The program involved a five-month process of reflective practice and the iterative testing of student-centered, inquiry-based facilitation approaches.
The Bronx Zoo of the Wildlife Conservation Society (WCS) engaged Randi Korn & Associates, Inc. to conduct formative evaluation and community focus groups related to a proposed exhibit, "Safari Adventure." The aim with this exhibit is to provide better connections to nature for families in our community and foster a life-long sense of environmental stewardship. The exhibit concept was born of the issue that, today, there exists a greater need to connect people to nature than ever before, a topic especially relevant for our community—part of the largest urban population in the United States
Existing (and essentially school-based) approaches to assessment involve recording the extent to which learners gain particular knowledge or skills. In informal settings, outcomes depend on the participant’s own agenda. Michalchik and Gallagher propose an approach to assessment—of both individuals and programmes—that focuses on learner behaviour instead of on pre-determined objectives.
This report presents and analyzes the findings from a front-end evaluation conducted by Randi Korn & Associates (RK&A) regarding the concept for "Safari Adventure," an exhibition being developed at the Bronx Zoo by the Wildlife Conservation Society (WCS) in Bronx, NY. The aim of Safari Adventure will be to provide better connections to nature for families in our community and foster a life-long sense of environmental stewardship. The exhibit concept was born of the issue that, today, there exists a greater need to connect people to nature than ever before, a topic especially relevant for our
This presentation was shared at the 2014 Association of Science-Technology Centers (ASTC) annual meeting in Raleigh, NC. It describes how proposers can submit competitive proposals to the National Science Foundation (NSF) Advancing Informal STEM Learning (AISL) program in FY 2014. The presentation describes strategies for submitting competitive proposals to the to the NSF AISL program via solicitation 14-555/