This paper explores the interactive possibilities enabled when the barrel of a digital pen is augmented with a multi-touch sensor. We present a novel multi-touch pen (MTPen) prototype and discuss its alternate uses beyond those of a standard stylus, such as allowing new touch gestures to be performed using the index finger or thumb and detecting how users grip the device as a mechanism for mode switch-ing. We also discuss the hardware and software implemen-tation challenges in realizing our prototype, and showcase how one can combine different grips (tripod, relaxed tripod, sketch, wrap) and
DATE:
TEAM MEMBERS:
Jim SpadacciniHyunyoung SongHrvoje BenkoFrancois GuimbretiereShahram IzadiXiang CaoKen Hinckley
This paper outlines research showing a suprizing agreement in the guesability of multitouch gestures on tabletop surfaces between users. It also provides more evidence that crowd sourcing gesture mapping will lead to more complete intuitive gesture set and potential convergence into a standard gesture library.
DATE:
TEAM MEMBERS:
Jacob WobbrockMeredith MorisAndrew Wilson
Direct-touch interaction on mobile phones revolves around screens that compete for visual attention with users‟ real-world tasks and activities. This paper investigates the impact of these situational impairments on touch-screen interaction. We probe several design factors for touch-screen gestures, under various levels of environmental demands on attention, in comparison to the status-quo approach of soft buttons. We find that in the presence of environmental distractions, ges-tures can offer significant performance gains and reduced attentional load, while performing as well as soft buttons
DATE:
TEAM MEMBERS:
Andrew BragdonEugene NelsonYang LiKen Hinckley
In recent years, a large amount of software for multitouch interfaces with various degrees of similarity has been written. In order to improve interoperability, we aim to identify the common traits of these systems and present a layered software architecture which abstracts these similarities by defining common interfaces between successive layers. This provides developers with a unified view of the various types of multitouch hardware. Moreover, the layered architecture allows easy integration of existing software, as several alternative implementations for each layer can co-exist. Finally
DATE:
TEAM MEMBERS:
Florian EchtlerGudrun KlinkerJim Spadaccini
Recent advances in touch screen technology have increased the prevalence of touch screens and have prompted a wave of new touch screen-based devices. However, touch screens are still largely inaccessible to blind users, who must adopt error-prone compensatory strategies to use them or find accessible alternatives. This inaccessibility is due to interaction techniques that require the user to visually locate objects on the screen. To address this problem, we introduce Slide Rule, a set of audiobased multi-touch interaction techniques that enable blind users to access touch screen applications
DATE:
TEAM MEMBERS:
Jim SpadacciniJeffrey BighamJacob Wobbrock
We are in the midst of an explosion of emerging humancomputer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of these emerging interaction styles. Based on this concept of RBI, we provide a framework that can be used to understand, compare, and relate current paths of recent HCI research as well as to analyze specific interaction designs. We believe that viewing interaction through the lens of RBI provides insights for design and uncovers
DATE:
TEAM MEMBERS:
Robert J.K. JacobAudrey GirouardLeanne M. HirshfieldMichael S. HornOrit ShaerErin Treacy SoloveyJamie Zigelbaum
Proton is a novel framework that addresses both of these problems. Using Proton, the application developer declaratively specifies each gesture as a regular expression over a stream of touch events. Proton statically analyzes the set of gestures to report conflicts, and it automatically creates gesture recognizers for the entire set. To simplify the creation of complex multitouch gestures, Proton introduces gesture tablature, a graphical notation that concisely describes the sequencing of multiple interleaved touch actions over time.
DATE:
TEAM MEMBERS:
Jim SpadacciniKenrick KinBjörn HartmannTony DeRoseManeesh Agrawala
Modern smartphones contain sophisticated sensors to monitor three-dimensional movement of the device. These sensors permit devices to recognize motion gestures— deliberate movements of the device by end-users to invoke commands. However, little is known about best-practices in motion gesture design for the mobile computing paradigm. To address this issue, we present the results of a guessability study that elicits end-user motion gestures to invoke commands on a smartphone device. We demonstrate that consensus exists among our participants on parameters of movement and on mappings of motion
DATE:
TEAM MEMBERS:
Jim SpadacciniJaime RuizYang LiEdward Lank
WNET is producing "The Human Spark," a multimedia project that includes a four-part television series (4 x 60 min) for national primetime broadcast on PBS, innovative outreach partnerships with museums, an extensive Web site and outreach activities, including a Spanish-language version and companion book. Hosted by Alan Alda, "The Human Spark" will explore the intriguing questions: What makes us human? Can the human spark be found in the differences between us and our closest genetic relative -- the great apes? Is there some place or process unique to the human brain where the human spark resides? And if we can identify it, could we transfer it to machines? The programs will explore these questions through presenting cutting-edge research in a number of scientific disciplines including evolution, genetics, cognitive neuroscience, behavioral science, anthropology, linguistics, AI, robotics and computing. The series will highlight opposing views within each field, and the interdisciplinary nature of science, including its intersection with the humanities. The series will develop a new innovative format, the "muse concept", which involves pairing the host with a different scientific expert throughout each program. The outreach plan is being developed with a consortium of four leading science museums, American Museum of Natural History in New York, Museum of Science in Boston, The Exploratorium in San Francisco, and the Fort Worth Museum of Science and History, paired with their respective local public television stations. An additional six museums and local broadcasters will be chosen through an RFP process to develop local initiatives around the series. Multimedia Research and Leflein Associates will conduct formative as well as summative evaluations of the series and web.
DATE:
-
TEAM MEMBERS:
William GrantJared LipworthGraham CheddBarbara Flagg
This is one of three focus point presentations delivered as part of the session titled "Technology and Cyberinfrastructure," delivered on day two of the Citizen Science Toolkit Conference at the Cornell Lab of Ornithology in Ithaca, New York on June 20-23, 2007. Josh Knauer, Director of Advanced Development, Information Commons at MAYA Design, discusses the problem of "information liquidity" and how to make data available to the intended audiences and in a way that makes the data available at all times. Knauer applies the original model of the public library to the digital age and makes
DATE:
TEAM MEMBERS:
Josh Knauer
resourceresearchProfessional Development, Conferences, and Networks
These reports were delivered on day three at the conclusion of the Citizen Science Toolkit Conference at the Cornell Lab of Ornithology in Ithaca, New York on June 20-23, 2007. The reports summarize the discussions that took place in five separate breakout groups, which met periodically throughout the conference to focus on key Citizen Science themes and topics that emerged during conference presentations and plenary discussions.
DATE:
TEAM MEMBERS:
Cornell Lab of OrnithologyCatherine McEverNolan DoeskenGeoff LeBaronSarah KirnRebecca JordanMaureen McConnell
resourceresearchProfessional Development, Conferences, and Networks
This discussion was held during the final plenary session on day three of the Citizen Science Toolkit Conference at the Cornell Lab of Ornithology in Ithaca, New York on June 20-23, 2007. Topics discussed include citizen science as a new field or discipline, the science role that citizen scientists play, next steps, issues to consider, suggestions, and developing (or not) a shared data infrastructure.
DATE:
TEAM MEMBERS:
Cathy McEverCornell Lab of Ornithology