This project builds on an NSF-funded program which engaged youth in the creation of art-science experiences that use the biology and the experiences of migratory birds as a means for communicating the impact of a changing climate.
DATE:
-
TEAM MEMBERS:
Rebecca SafranShawhin RoudbariMary Osnes
resourceresearchMuseum and Science Center Exhibits
Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceevaluationMuseum and Science Center Exhibits
This document presents the final evaluation report for the NSF-funded AISL project: "Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits."
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Re-Living Paleontology conducted usability and comparison studies on immersion and interactivity in augmented reality (AR) and visitors' engagement and understanding of science. Two "Tar AR" experiences were designed and studied.
DATE:
TEAM MEMBERS:
Benjamin D. NyeWilliam SwartoutDavid NelsonGale M. SinatraEmily LindseyMolly Porter
Snow: Tiny Crystals, Global Impact is a 2,500 ft traveling exhibition about: how snow shapes and sustains life on Earth, the impacts of climate change on snow, and the importance of our collective engagement to take action. The exhibition will be installed at OMSI during winter 2021-2022 for summative evaluation and learning research.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
The nature of the learning that occurs with real versus replicated objects and environments is an important topic for museums and science centers. Our comparative, exploratory study addressed this area through an investigation of family visits to two different settings: an operating permafrost research tunnel, and a replica of this permafrost tunnel at a science center. We conducted and analyzed family interviews, grounding our work in the Contextual Model of Learning and ideas about sensory components of learning. We found significant differences between the real and replicated environments