This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07).
Appendix A: Installation Site Intercept Interview Instrument
Appendix B: Artists-Scientists Walk & Talks Instrument
Appendix C: Post-Performance Event Survey Instrument
Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS:
John FraserRebecca Joy NorlanderSophie SwansonNezam ArdalanKate FlinnerJoanna Laursen BruckerNicole LaMarca
Engagement is the cornerstone of learning in informal science education. During free-choice learning in museums and science centers, visitor engagement shapes how learners interact with exhibits, navigate through exhibit spaces, and form attitudes, interests, and understanding of science. Recent advances in multimodal learning analytics are creating novel opportunities for expanding the range and richness of measures of visitor engagement in free-choice settings. In particular, multimodal learning analytics offer significant potential for integrating multiple data sources to devise a composite picture of visitors' cognitive, affective, and behavioral engagement. The project will center on providing a rich empirical account of meaningful visitor engagement with interactive tabletop science exhibits among individual visitors and small groups, as well as uncovering broader tidal patterns in visitor engagement that unfold across exhibit spaces. A key objective of the project is creating models and practitioner-focused learning analytic tools that will inform the best practices of exhibit designers and museum educators. This project is funded by the Advancing Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, AISL funds research and innovative approaches and resources for use in a variety of settings. The research team will conduct data-rich investigations of visitors' learning experiences with multimodal learning analytics that fuse the rich multichannel data streams produced by fully-instrumented exhibit spaces with the data-driven modeling functionalities afforded by recent advances in machine learning and educational data mining. The research team will conduct a series of visitor studies of naturalistic engagement in solo, dyad, and group interactions as visitors explore interactive tabletop science exhibits. The studies will utilize eye trackers to capture visitors' moment-to-moment attention, facial expression analysis and quantitative field observations to track visitors' emotional states, trace logs generated by exhibit software, as well as motion-tracking sensors and coded video recordings to capture visitors' behavioral interactions. The studies will also use conversation recordings and pre-post assessment measures to capture visitors' science understanding and inquiry processes. With these multimodal data streams as training data, the research team will use probabilistic and neural machine learning techniques to devise learning analytic models of visitor engagement. The project will be conducted by a partnership between North Carolina State University and the North Carolina Museum of Natural Sciences. The research team will 1) design a data-rich multimodal visitor study methodology, 2) create the Visitor Informatics Platform, a suite of open source software tools for multimodal visitor analytics, and 3) launch the Multimodal Visitor Data Warehouse, a curated visitor experience data archive. Together, the multimodal visitor study methodology, the Visitor Informatics Platform, and the Multimodal Visitor Data Warehouse will enable researchers and practitioners in the informal science education community to utilize multimodal learning analytics in their own informal learning environments. It is anticipated that the project will advance the field of informal STEM learning by extending and enriching measures of meaningful visitor engagement, expanding the evidence base for visitor experience design principles, and providing learning analytic tools to support museum educators. By enhancing understanding of the cognitive, affective, and behavioral dynamics underlying visitor experiences in science museums, informal science educators will be well-positioned to design learning experiences that are more effective and engaging. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
James LesterJames MinogueJonathan RoweNorth Carolina Museum of Natural Sciences
Scientists are increasingly being called upon to play a more prominent role in the interface of science and society by contributing to science literacy in ways that support two-way exchanges with the public. However, many remain reluctant to participate in public engagement activities in part because they feel they lack relevant skills and experience. We surveyed scientists trained on engagement through a nationwide program called Portal to the Public and examined how participation in the program may have influenced their self-efficacy, commitment and attitudes about outreach, and perceived
The Association of Science-Technology Centers (ASTC) aims to help member institutions inform and educate the public about science through a global lens. The World Biotech Tour (WBT) was a three-year initiative designed to not only promote a greater understanding of biotechnology through public outreach and programming led by science centers and museums, but also as an opportunity for ASTC to collect useful data on the resources required and challenges encountered at different science museums around the world when implementing a long-term, multi-country program. The WBT involved students
This research brief highlights findings from the proof of concept pilot year of the Child Trends News Service project. It explores what we have learned regarding best practices for communicating with and engaging Latino parents through short messages on research-informed parenting practices. The findings are grounded in research that substantiates the need to amplify access to child development research, particularly among low-income Latino families; and in communication science research that demonstrates the value of the news media as an information source for child development research.
DATE:
TEAM MEMBERS:
Alicia TorresSelma CaalLuz GuerraAngela Rojas
Recently there have been many calls for enhanced communication between scientists and the public in order to increase scientific literacy and improve attitudes toward science. However, these educational outreach (E/O) efforts often encounter structural barriers and the processes that support attainment of the goals of E/O are not well documented. E/O is a form of Informal Science Education (ISE), but E/O literature is often published in both science education and science communication journals because of the various approaches and environments in which it occurs. This unique juxtaposition
European Researchers’ Night is an annual pan-European initiative of the European Commission held on the last Friday in September. In 2015, 1.1 million European citizens and 18,000 researchers took part in events organised in more than 300 cities within Europe and neighbouring countries. The objective of European Researchers’ Night is to encourage the wider public to visit research institutes, engage with researchers, and learn more about European research and potential career opportunities. In this paper, European Researchers’ Night in Ireland is considered through the lens of informal
Why do scientists volunteer to be involved in public engagement in science? What are the barriers that can prevent them participating in dialogue with society? What can be done to facilitate their participation? We report the outcomes of a series of focus groups conducted with the young scientists who volunteered in SISSA for schools (S4S), the Children's University program of the International School for Advanced Studies (SISSA) in Trieste, Italy.
S4S is based on the contribution of PhD students as volunteers, has a participatory character, and is attentive to social and gender inclusion
DATE:
TEAM MEMBERS:
Simona CerratoValentina DaelliHelena PertotOlga Puccioni
resourceevaluationMuseum and Science Center Programs
The San Diego Natural History Museum contracted RK&A to conduct an evaluation of the SPECTRUM Social Stories Project. The program involved a series of 16 “meetups” for museum staff and young adults with an autism spectrum disorder (ASD) to visit seven Balboa Park museums. The young adults, with support from museum staff, used their observations of those spaces to create pre-visit materials for museum-goers with ASD.
How did we approach this study?
The evaluation explored outcomes for young adult participants, museum staff, and project partners from other Balboa Park museums. We conducted
Summary brief describing summative evaluation associated with the MarcellusByDesign component of Marcellus Matters: EASE. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a series of environmental planning workshops geared toward local community members in counties across Pennsylvania.