In recent years, a large amount of software for multitouch interfaces with various degrees of similarity has been written. In order to improve interoperability, we aim to identify the common traits of these systems and present a layered software architecture which abstracts these similarities by defining common interfaces between successive layers. This provides developers with a unified view of the various types of multitouch hardware. Moreover, the layered architecture allows easy integration of existing software, as several alternative implementations for each layer can co-exist. Finally
DATE:
TEAM MEMBERS:
Florian EchtlerGudrun KlinkerJim Spadaccini
Recent advances in touch screen technology have increased the prevalence of touch screens and have prompted a wave of new touch screen-based devices. However, touch screens are still largely inaccessible to blind users, who must adopt error-prone compensatory strategies to use them or find accessible alternatives. This inaccessibility is due to interaction techniques that require the user to visually locate objects on the screen. To address this problem, we introduce Slide Rule, a set of audiobased multi-touch interaction techniques that enable blind users to access touch screen applications
DATE:
TEAM MEMBERS:
Jim SpadacciniJeffrey BighamJacob Wobbrock
During its first year, more than 1500 people signed up to be a part of Open Exhibits. Participation ranged from reading blog posts, to trying a few software modules or using Open Exhibits software to develop actual exhibition components. This report highlights findings about the emerging community and trends in Open Exhibits participation.
We are in the midst of an explosion of emerging humancomputer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of these emerging interaction styles. Based on this concept of RBI, we provide a framework that can be used to understand, compare, and relate current paths of recent HCI research as well as to analyze specific interaction designs. We believe that viewing interaction through the lens of RBI provides insights for design and uncovers
DATE:
TEAM MEMBERS:
Robert J.K. JacobAudrey GirouardLeanne M. HirshfieldMichael S. HornOrit ShaerErin Treacy SoloveyJamie Zigelbaum
Proton is a novel framework that addresses both of these problems. Using Proton, the application developer declaratively specifies each gesture as a regular expression over a stream of touch events. Proton statically analyzes the set of gestures to report conflicts, and it automatically creates gesture recognizers for the entire set. To simplify the creation of complex multitouch gestures, Proton introduces gesture tablature, a graphical notation that concisely describes the sequencing of multiple interleaved touch actions over time.
DATE:
TEAM MEMBERS:
Jim SpadacciniKenrick KinBjörn HartmannTony DeRoseManeesh Agrawala
resourceresearchProfessional Development, Conferences, and Networks
Open Exhibits held a Design Summit bringing together 30 professionals from the field to help guide future development. The Design Summit was convened in Corrales, New Mexico near the design studios of Ideum, the principal organization of Open Exhibits. It was held March 9th to 11th of 2011. Attendees came from large and small science centers, planetariums, zoos, local museums, and several other open source software initiatives. They were educators, evaluators, designers, researchers, software engineers, and museum professionals. Participants engaged in a combination of short presentations
Modern smartphones contain sophisticated sensors to monitor three-dimensional movement of the device. These sensors permit devices to recognize motion gestures— deliberate movements of the device by end-users to invoke commands. However, little is known about best-practices in motion gesture design for the mobile computing paradigm. To address this issue, we present the results of a guessability study that elicits end-user motion gestures to invoke commands on a smartphone device. We demonstrate that consensus exists among our participants on parameters of movement and on mappings of motion
DATE:
TEAM MEMBERS:
Jim SpadacciniJaime RuizYang LiEdward Lank
Assessing the Impact of a Visit to a Zoo or Aquarium: A Multi-institutional Research Project will create a functional taxonomy of zoo/aquarium visitors' entering knowledge, attitudes and behaviors. This taxonomy, in conjunction with data about the specific experiences visitors have during their visit, will enable investigators to understand and predict the contribution of zoos and aquariums to the public understanding of animals and their conservation. The results will clarify the role of zoos and aquariums as centers of informal learning and point to ways to strengthen their educational impact. The AZA convened a national advisory committee that commissioned and completed a thorough review, confirming a critical need to conduct more research, particularly research that attempts to ask broad questions, collect data systematically, and includes sufficient number and types of institutions to permit community-wide generalizations. Twelve AZA institutions of various sizes, geographic regions and types will participate in the study. The net result of the study will be a descriptive model of zoo and aquarium visitor learning experiences and development of a set of diagnostic tools to help zoo and aquaria staff understand and enhance the nature and extent of their public impact.
The investigators will collect data on a broad range of informal science education activities of an existing sample of approximately 3,500 adults across the U.S. It will relate these activities to prior forms of science involvement and to various indicators of lifelong STEM learning. The proposed work is an extension of the Longitudinal Study of American Youth (LSAY), a study funded by NSF since 1986 and still ongoing. Prior work has tracked two national cohorts of students who were originally representative of public middle and high schools, focusing on their science and mathematics course enrollment, content, achievement, and career choices, and informed by data from their parents and teachers. The project team has maintained very high levels of continued participation by the approximately 5,000 students, now aged 34-38, many of whom have families of their own. The project will extend the planned surveys for 2009 and 2010 to examine how these adults use informal science education resources such as museums, libraries, books, magazines, newspapers, television, and the Internet. The project will provide baseline data on informal science education resource use in the Internet era for a large and diverse sample. It will allow investigation of the relationships of current informal science learning behaviors, both individual and intergenerational, to prior learning variables such as school science achievement, parental involvement, college experience, career choice, and prior use of informal learning resources while respondents were school-aged.
The investigators will collect data on a broad range of informal science education activities of an existing sample of approximately 3,500 adults across the U.S. It will relate these activities to prior forms of science involvement and to various indicators of lifelong STEM learning. The proposed work is an extension of the Longitudinal Study of American Youth (LSAY), a study funded by NSF since 1986 and still ongoing. Prior work has tracked two national cohorts of students who were originally representative of public middle and high schools, focusing on their science and mathematics course enrollment, content, achievement, and career choices, and informed by data from their parents and teachers. The project team has maintained very high levels of continued participation by the approximately 5,000 students, now aged 34-38, many of whom have families of their own. The project will extend the planned surveys for 2009 and 2010 to examine how these adults use informal science education resources such as museums, libraries, books, magazines, newspapers, television, and the Internet. The project will provide baseline data on informal science education resource use in the Internet era for a large and diverse sample. It will allow investigation of the relationships of current informal science learning behaviors, both individual and intergenerational, to prior learning variables such as school science achievement, parental involvement, college experience, career choice, and prior use of informal learning resources while respondents were school-aged.
LOOP is the working title for a multiplatform project to promote environmental and scientific literacy about sustainability for children ages 6-9 and their families. Unlike most educational materials for this age group, the LOOP approach requires the audience to learn about the interconnectedness of environmental and human systems in a cross-disciplinary manner. Produced by WGBH, the center piece of the project will be a television series designed for PBS with accompanying digital media on the web and an extensive "Get to Know Your World" outreach initiative. The U.S. Forest Service is one of the project's partners. At this development stage, the project will: -Conduct front-end research to obtain a baseline understanding about what kids know about environmental sustainability. -Further develop and test LOOP's proposed creative style. -Produce an animatic (a simple mock-up) of a full episode and accompanying live-action video, with input from Content Directors. -Perform formative evaluation to assess the learning impact of the animatic and live-action video to inform series production. Concord Evaluation Group will conduct the front-end research to assess children\'s knowledge of environmental sustainability and formative evaluation of the animatic pilot. Global Mechanic is the animation producer. The project has the potential to (1) inform the field on how to enhance young children\'s understanding of complex ecological concepts; and (2) "push the envelope" by exploring how mass media can support local environmental investigation and promote outdoor family explorations. Introducing children to systems thinking, especially around environmental subjects, could make a significant contribution to their understanding of and approach to STEM.
The Institute for Learning Innovation, in collaboration with Mary Miss Studio and the Institute for Urban Design, is conducting an exploratory research and development project on sustainable practices related to the built infrastructure of New York City. The work will (1) pilot test and study new interpretive strategies for urban "place-based" public learning experiences that focus pedestrians' attention on a city's ecology and existing built sustainability infrastructure; (2) engage urban design professionals and STEM researchers to explore how these new strategies have the potential to transform how urban design fields inform, dialog and interact with the public about sustainable urban design and planning; and (3) assess the effectiveness of these public interpretation programs on STEM learning beyond traditional Informal Science Learning Environments (ISEs) such as science museums. Project participants also include faculty from the City College of NY Graduate Program in Urban Design, STEM faculty from Columbia University, and staff of the Provisions Library in Washington, D.C. The project is an early phase of the "City as Living Laboratory" initiative that can leverage the Rockefeller Foundation-funded Urban Design Week program in New York City scheduled to occur September 15 - 20, 2011. This request to NSF adds an additional track to the process to specifically focus on STEM learning and urban sustainability. From the promotional materials: "The Institute for Urban Design is currently preparing for the first annual Urban Design Week, a public festival created to engage New Yorkers in the fascinating and complex issues of the public realm and celebrate the city's exceptional urbanity. Through a rich roster of charettes, summits, installations, film screenings, exhibitions, and tours, Urban Design Week will draw in citizens from every borough and walk of life and highlight the idea that cities are made by collective effort, and that each of us can be a part of that great endeavor." The project goal is to generate new models for public engagement with science in the city environment and to explore how urban designers and planners, as they design for sustainability, can more effectively collaborate with STEM researchers and with the public. The project has both research and programmatic deliverables. Research activities include: Public Audiences: observational study of pedestrians in the installation environment; intercept surveys of the public about their experiences with the streetscape installations. Professional Audiences: pre-installation surveys on the role of public space science interpretation for altering public discourse about urban planning and sustainable cities; focus group assessment of professionals' experiences with observing public interactions with the installations; online delayed- post experience survey on learning outcomes in terms of knowledge, attitude, motivation and anticipated impacts on professional practices; analysis of blog postings and public media surrounding the installation; survey of attendees at an ISE forum on the project, its goals, outcomes and potential for future developments. Programmatic deliverables include: a workshop that engages urban design students in the development of experimental streetscape installations; a pilot installation on streets in the City College of NY (consistent with approvals already received by NYC Dept. of Transportation); a City as Living Laboratory art-science workshop for Urban Design Week professionals to highlight possible benefits of inter-disciplinary collaboration; a panel discussion around new forms of citizen engagement through a "city as a science learning environment"; a forum specifically for ISE professionals to explore the research findings and potential for use as a strategy to increase science learning in city places.