Using MQTT for Platform Independent RemoteMixed Reality Collaboration

Kristoffer Waldow and Arnulph Fuhrmann

In: Proceedings of the Mensch und Computer 2019, Workshop on User-Embodied Interaction in Virtual Reality

The schematic design of a MR telepresence for remote interaction. The devices communicate via a MQTT interface with a MQTT broker. This server distributes all messages to the clients according to their subscribed topic.

Abstract

In this paper, we present a Mixed Reality telepresence system that allows the connection of multiple AR or VR devices to create a shared virtual environment by using the simple MQTT networking protocol. It follows a subscribe-publish pattern for reliable and easy platform independent integration. Therefore, it is possible to realize different clients that handle communication and allow remote collaboration. To allow embodied natural human interaction, the system maps the human interaction channels, gestures, gaze and speech, to an abstract stylized avatar by using an upper body inverse kinematic approach. This setup allows spatially separated persons to interact with each other via an avatar-mediated communication.

Paper

Final published paper: https://dx.doi.org/10.18420/muc2019-ws-570

Ähnliches

An Evaluation of Smartphone-Based Interaction in AR for Constrained Object Manipulation

An Evaluation of Smartphone-Based Interaction in AR for Constrained Object Manipulation

In Augmented Reality, interaction with the environment can be achieved with a number of different approaches. In current systems, the most common are hand and gesture inputs. However experimental applications also integrated smartphones as intuitive interaction devices and demonstrated great potential for different tasks. One particular task is constrained object manipulation, for which we conducted a user study. In it we compared standard gesture-based approaches with a touch-based interaction via smartphone. We found that a touch-based interface is significantly more efficient, although gestures are being subjectively more accepted. From these results we draw conclusions on how smartphones can be used to realize modern interfaces in AR.