An Evaluation of Smartphone-Based Interaction in AR for Constrained Object Manipulation

Kristoffer Waldow, Martin Misiak, Ursula Derichs, Olaf Clausen und Arnulph Fuhrmann.

In: Proceedings of the 24th ACM Symposium of Virtual Reality Software and Technology (VRST), Tokio, Japan 2018

Abstract

In Augmented Reality, interaction with the environment can be achieved with a number of different approaches. In current systems, the most common are hand and gesture inputs. However experimental applications also integrated smartphones as intuitive interaction devices and demonstrated great potential for different tasks. One particular task is constrained object manipulation, for which we conducted a user study. In it we compared standard gesture-based approaches with a touch-based interaction via smartphone. We found that a touch-based interface is significantly more efficient, although gestures are being subjectively more accepted. From these results we draw conclusions on how smartphones can be used to realize modern interfaces in AR.

Paper

Preprint: PDF

DOI: 10.1145/3281505.3281608

 

The three different evaluated interation methods in AR. Left: A transformation method with gaze, gestures and a bounding box with virtual handles. The user can move the hand vertically to scale and horizontally to rotate the object. Middle: Similar to the variant on the left, except there is no gaze selection. The transform selection is directly identified by the users’ gestures once their hand starts moving. Right: Smartphone as touch-input for the transformation. By swiping vertically or horizontally on the display, the object is scaled or rotated.

Ähnliches

Real-time tone mapping – An evaluation of color-accurate methods for luminance compression

Recent advances in real-time rendering enable virtual production pipelines in a broad range of industries. These pipelines are based on a fast, latency-free handling in addition to the accurate appearance of results. This requires the use of high dynamic range rendering for photo-realistic results and a tone mapping operator for a matched display.

Using MQTT for Platform Independent RemoteMixed Reality Collaboration

In this paper, we present a Mixed Reality telepresence system that allows the connection of multiple AR or VR devices to create a shared virtual environment by using the simple MQTT networking protocol. It follows a subscribe-publish pattern for reliable and easy platform independent integration. Therefore, it is possible to realize different clients that handle communication and allow remote collaboration. To allow embodied natural human interaction, the system maps the human interaction channels, gestures, gaze and speech, to an abstract stylized avatar by using an upper body inverse kinematic approach. This setup allows spatially separated persons to interact with each other via an avatar-mediated communication.