In this paper we describe two projects that utilize reality-based interaction to advance collaborative scientific inquiry and discovery. We discuss the relation between reality-based and embodied interaction, and present findings from an experimental study that illustrate benefits of reality-based tabletop interaction for collaborative inquiry-based learning.
New mobile devices with large multi-touch displays, such as the iPad, have brought revolutionary changes to ways users interact with computers. Instead of traditional input devices such as keyboards, touchpads and mice, multi-touch gestures are used as the primary means of interacting with mobile devices. Surprisingly, body-motion gestures are evolving to become a new, natural, and effective way for game players to interact with game consoles in a very similar fashion: in Kinect for Xbox 360, a controller-free gaming experience is made possible by using body-motion gestures to play games.
This paper outlines research showing a suprizing agreement in the guesability of multitouch gestures on tabletop surfaces between users. It also provides more evidence that crowd sourcing gesture mapping will lead to more complete intuitive gesture set and potential convergence into a standard gesture library.
DATE:
TEAM MEMBERS:
Jacob WobbrockMeredith MorisAndrew Wilson
Direct-touch interaction on mobile phones revolves around screens that compete for visual attention with users‟ real-world tasks and activities. This paper investigates the impact of these situational impairments on touch-screen interaction. We probe several design factors for touch-screen gestures, under various levels of environmental demands on attention, in comparison to the status-quo approach of soft buttons. We find that in the presence of environmental distractions, ges-tures can offer significant performance gains and reduced attentional load, while performing as well as soft buttons
DATE:
TEAM MEMBERS:
Andrew BragdonEugene NelsonYang LiKen Hinckley
Recent advances in touch screen technology have increased the prevalence of touch screens and have prompted a wave of new touch screen-based devices. However, touch screens are still largely inaccessible to blind users, who must adopt error-prone compensatory strategies to use them or find accessible alternatives. This inaccessibility is due to interaction techniques that require the user to visually locate objects on the screen. To address this problem, we introduce Slide Rule, a set of audiobased multi-touch interaction techniques that enable blind users to access touch screen applications
DATE:
TEAM MEMBERS:
Jim SpadacciniJeffrey BighamJacob Wobbrock
During its first year, more than 1500 people signed up to be a part of Open Exhibits. Participation ranged from reading blog posts, to trying a few software modules or using Open Exhibits software to develop actual exhibition components. This report highlights findings about the emerging community and trends in Open Exhibits participation.
The NMC Horizon Report: 2011 Museum Edition, is a coproduction with the Marcus Institute for Digital Education in the Arts (MIDEA), and examines emerging technologies for their potential impact on and use in education and interpretation within the museum environment. The international composition of the advisory board reflects the care with which a global perspective for the report was assembled. While there are many local factors affecting the adoption and use of emerging technologies in museums, there are also issues that transcend regional boundaries and questions we all face. It was with
DATE:
TEAM MEMBERS:
Larry JohnsonHolly Witchey
resourceresearchProfessional Development, Conferences, and Networks
For document visualization, folding techniques provide a focus-plus-context approach with fairly high legibility on flat sections. To enable richer interaction, we explore the design space of multi-touch document folding. We discuss several design considerations for simple modeless gesturing and compatibility with standard Drag and Pinch gestures. We categorize gesture models along the characteristics of Symmetric/Asymmetric and Serial/Parallel, which yields three gesture models. We built a prototype document workspace application that integrates folding and standard gestures, and a system for
DATE:
TEAM MEMBERS:
Patrick ChiuChunyuan LiaoFrancine Chen
Delimiters are great for using gestures to overide application or OS commands. This paper investigates whether the DoubleFlip gesture is easy learn and practical to use as an effective delimter.
Many tasks in graphical user interfaces require users to interact with elements at various levels of precision. We present FingerGlass, a bimanual technique designed to improve the precision of graphical tasks on multitouch screens. It enables users to quickly navigate to different locations and across multiple scales of a scene using a single hand. The other hand can simultaneously interact with objects in the scene. Unlike traditional pan-zoom interfaces, FingerGlass retains contextual information during the interaction. We evaluated our technique in the context of precise object selection
DATE:
TEAM MEMBERS:
Dominik K¨aserManeesh AgrawalaMark Pauly
resourceresearchProfessional Development, Conferences, and Networks
Open Exhibits held a Design Summit bringing together 30 professionals from the field to help guide future development. The Design Summit was convened in Corrales, New Mexico near the design studios of Ideum, the principal organization of Open Exhibits. It was held March 9th to 11th of 2011. Attendees came from large and small science centers, planetariums, zoos, local museums, and several other open source software initiatives. They were educators, evaluators, designers, researchers, software engineers, and museum professionals. Participants engaged in a combination of short presentations
Despite a long history of using participatory methods to enable public engagement with issues of societal importance, interactive displays have only recently been explored for this purpose. In this paper, we evaluate a tabletop game called Futura, which was designed to engage the public with issues of sustainability. Our design is grounded in prior research on public displays, serious games, and computer supported collaborative learning. We suggest that a role-based, persistent simulation style game implemented on a multi-touch tabletop affords unique opportunities for a walk-up-and-play style
DATE:
TEAM MEMBERS:
Alissa N. AntleJoshua TanenbaumAllen BevansKatie SeabornSijie Wang