Researchers at Arizona State University (ASU), in partnership with the Smithsonian Museum on Main Street (MoMS), the Arizona Science Center, and eight tribal and rural museum sites around Arizona, will help educate and empower communities living in the Desert Southwest on water sustainability issues through the creation of WaterSIMmersion, a mixed reality (MR) educational game and accompanying museum exhibit.
DATE:
-
TEAM MEMBERS:
Claire LauerScotty CraigMina Johnson-GlenbergMichelle Hale
resourceresearchMuseum and Science Center Exhibits
Recent advances in multimodal learning analytics show significant promise for addressing these challenges by combining multi-channel data streams from fully-instrumented exhibit spaces with multimodal machine learning techniques to model patterns in visitor experience data. We describe initial work on the creation of a multimodal learning analytics framework for investigating visitor engagement with a game-based interactive surface exhibit for science museums called Future Worlds.
DATE:
TEAM MEMBERS:
Jonathan RoweWookhee MinSeung LeeBradford MottJames Lester
resourceresearchMuseum and Science Center Exhibits
Multimodal models often utilize video data to capture learner behavior, but video cameras are not always feasible, or even desirable, to use in museums. To address this issue while still harnessing the predictive capacities of multimodal models, we investigate adversarial discriminative domain adaptation for generating modality-invariant representations of both unimodal and multimodal data captured from museum visitors as they engage with interactive science museum exhibits.
DATE:
TEAM MEMBERS:
Nathan HendersonWookhee MinAndrew EmersonJonathan RoweSeung LeeJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonWookhee MinJonathan RoweJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
In this paper, we introduce a Bayesian hierarchical modeling framework for predicting learner engagement with Future Worlds, a tabletop science exhibit for environmental sustainability.
DATE:
TEAM MEMBERS:
Andrew EmersonNathan HendersonJonathan RoweWookhee MinSeung LeeJames MinogueJames Lester
resourceevaluationMuseum and Science Center Exhibits
This document presents the final evaluation report for the NSF-funded AISL project: "Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits."
In this paper, we investigate bias detection and mitigation techniques to address issues of
algorithmic fairness in multimodal models of museum visitor visual attention.
DATE:
TEAM MEMBERS:
Halim AcostaNathan HendersonJonathan RoweWookhee MinJames MinogueJames Lester
resourceresearchMuseum and Science Center Exhibits
The linked repository contains select resources from the SICIIT NSF project (Supporting Science and Engineering Identity Change in Immersive Interactive Technologies). The project did not reach its main objective, mainly due to disruptions caused by COVID, but we hope that the materials will be a useful resource for follow-up research.
DATE:
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
Three-dimensional digital models are increasingly prevalent in preserving tangible and intangible aspects of Indigenous material heritage. Yet, there are no comprehensive, clearly laid-out best practices that can guide researchers, Indigenous communities, and museum personnel in designing ethically sound and socially engaged 3D heritage preservation projects. The use of 3D technologies for heritage preservation and providing public access to digital 3D collections is well-established in the European context. While there have been several robust efforts on digitizing European national heritage, in the U.S. context, the focus often involves work with Indigenous heritage, instantly placing 3D projects into a post-colonial research paradigm with a complex set of ethical ramifications. This research examines emerging thoughts from the European context and connects them with best practices in digital Indigenous data management to identify practices that contribute to cultures of academic integrity that are inclusive of all stakeholder voices. This work fosters ethical cultures of STEM through the development of a comprehensive Responsible Conduct of Research guiding document that can be adapted to address culture-specific Indigenous perspectives as well as project-specific challenges in future 3D heritage preservation endeavors.
Project goals are accomplished through workshops and virtual collaborations that bring together researchers, Indigenous community members, and heritage preservation professionals with previous experience in the responsible management, protection, and sharing of Indigenous digital data and the use of 3D technology for heritage preservation. The collaboratively produced guidelines outline ethical considerations that can be used in developing: 1) partnerships with origin/descendant communities, 2) institution- and collection-specific museum policies on using 3D technology, 3) Tribal policies for culturally appropriate use of 3D technologies, and 4) training material and curriculum that integrates with other research compliance regulations pertaining to heritage preservation. The project explores the questions that have emerged through previous experiences using 3D technologies to preserve Indigenous ancestral heritage. These questions include the factors contributing to developing ethically sound 3D heritage preservation projects; the practices useful in 3D projects to foster a culture of integrity that equally engages academic and Indigenous perspectives; consideration for what constitutes Responsible Conduct of Research in using 3D technologies to preserve Indigenous cultural heritage; and addressing practice-based questions that contribute to understanding ethical challenges in digitally preserving and presenting Indigenous heritage. The project situates 3D modeling and heritage representation as part of the larger discourse on decolonizing core methodologies in museum management and anthropological collection practices. Results from this work can be adapted to training future researchers and digital heritage management professionals and creating meaningful partnerships in heritage documentation. This research cultivates cultures of academic integrity by informing heritage management policy on the critical importance of heritage ethics for the creation and management of 3D digitization projects involving Indigenous collections. This award is funded by the Directorate of Geosciences and the Directorate of Education and Human Resources.