This book addresses the new interaction modalities that are becoming possible with new devices by looking at user interfaces from an input perspective. It deals with modern input devices and user interaction and design covering in-depth theory, advanced topics for noise reduction using Kalman Filters, a case study, and multiple chapters showing hands-on approaches to relevant technology, including modern devices such as the Leap-Motion, Xbox One Kinect, inertial measurement units, and multi-touch technology. It also discusses theories behind interaction and navigation, past and current techniques, and practical topics about input devices.

Here’s what three pioneers in computer graphics and human-computer interaction have to say about this book: “What a tour de force—everything one would want—comprehensive, encyclopedic, and authoritative.” — Jim Foley “At last, a book on this important, emerging area. It will be an indispensable reference for the practitioner, researcher, and student interested in 3D user interfaces.” — Andy van Dam “Finally, the book we need to bridge the dream of 3D graphics with the user-centered reality of interface design. A thoughtful and practical guide for researchers and product developers. Thorough review, great examples.” — Ben Shneiderman As 3D technology becomes available for a wide range of applications, its successful deployment will require well-designed user interfaces (UIs). Specifically, software and hardware developers will need to understand the interaction principles and techniques peculiar to a 3D environment. This understanding, of course, builds on usability experience with 2D UIs. But it also involves new and unique challenges and opportunities. Discussing all relevant aspects of interaction, enhanced by instructive examples and guidelines, 3D User Interfaces comprises a single source for the latest theory and practice of 3D UIs. Many people already have seen 3D UIs in computer-aided design, radiation therapy, surgical simulation, data visualization, and virtual-reality entertainment. The next generation of computer games, mobile devices, and desktop applications also will feature 3D interaction. The authors of this book, each at the forefront of research and development in the young and dynamic field of 3D UIs, show how to produce usable 3D applications that deliver on their enormous promise. Coverage includes: The psychology and human factors of various 3D interaction tasks Different approaches for evaluating 3D UIs Results from empirical studies of 3D interaction techniques Principles for choosing appropriate input and output devices for 3D systems Details and tips on implementing common 3D interaction techniques Guidelines for selecting the most effective interaction techniques for common 3D tasks Case studies of 3D UIs in real-world applications To help you keep pace with this fast-evolving field, the book’s Web site, www.3dui.org, will offer information and links to the latest 3D UI research and applications.

The Complete, Up-To-Date Guide to Building Great 3D User Interfaces for Any Application 3D interaction is suddenly everywhere. But simply using 3D input or displays isn’t enough: 3D interfaces must be carefully designed for optimal user experience. 3D User Interfaces: Theory and Practice, Second Edition is today’s most comprehensive primary reference to building state-of-the-art 3D user interfaces and interactions. Five pioneering researchers and practitioners cover the full spectrum of emerging applications, techniques, and best practices. The authors combine theoretical foundations, analysis of leading devices, and empirically validated design guidelines. This edition adds two new chapters on human factors and general human-computer interaction—indispensable foundational knowledge for building any 3D user interface. It also demonstrates advanced concepts at work through two running case studies: a first-person VR game and a mobile augmented reality application. Coverage Includes 3D user interfaces: evolution, elements, and roadmaps Key applications: virtual and augmented reality (VR, AR), mobile/wearable devices What 3D UI designers should know about human sensory systems and cognition ergonomics How proven human-computer interaction techniques apply to 3D UIs 3D UI output hardware for visual, auditory, and haptic/ tactile systems Obtaining 3D position, orientation, and motion data for users in physical space 3D object selection and manipulation Navigation and wayfinding techniques for moving through virtual and physical spaces Changing application state with system control techniques, issuing commands, and enabling other forms of user input Strategies for choosing, developing, and evaluating 3D user interfaces Utilizing 2D, “magic,” “natural,” multimodal, and two-handed interaction The future of 3D user interfaces: open research problems and emerging technologies

Augmented & mixed reality, gestural, 3d en multisensory interfaces.

This text offers advice on creating user-friendly interface designs - whether they're delivered on the Web, a CD, or a 'smart' device like a cell phone. It presents solutions to common UI design problems as a collection of patterns - each containing concrete examples, recommendations, and warnings.

Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research. Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology. Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience. This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.