Development of an immersive interface for robot teleoperation

Junshen Chen, Marc Glover, Chenguang Yang, Chunxu Li, Zhijun Li, Angelo Cangelosi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In this paper, a novel interface of human-robot interaction has been developed to provide enhanced user experience for teleoperators. The interface has been implemented and tested on a Baxter robot platform and it can be easily adapted to other robot platforms. The main objective of this work is to provide a teleoperator immersive experience when controlling a telerobot arm by enabling the user to see and feel what the robot sees and feels from a first person point of view. This objective has been achieved by our designed interface integrating a haptic feedback device, a virtual reality headset, and an RGB-D camera. An operator can manipulate a robotic arm and receive force feedback information about interactions between the robot’s grippers, as well as the robot’s environment, whilst viewing the captured visual information of the robot’s workspace, on the screen of the virtual reality headset. A servo motor driving platform has been designed as a new robot head to manipulate the camera on top of it, such that a teleoperator is able to control the pose of the camera in a natural manner via the wearable virtual reality headset. The orientation of the built-in inertial measurement unit (IMU) of the virtual reality headset is used to directly command the angles of the head platform on which the camera is mounted. The operator will have an immersive and in-depth experience when manipulating the robotic arm. Extensive tests with a variety of users have been carried out to evaluate the design in this work with quantified analysis.

Original languageEnglish
Title of host publicationTowards Autonomous Robotic Systems - 18th Annual Conference, TAROS 2017, Proceedings
PublisherSpringer Nature
Number of pages15
ISBN (Print)9783319641065
Publication statusPublished - 1 Jan 2017
Event18th Annual Conference on Towards Autonomous Robotic Systems, TAROS 2017 - Guildford, United Kingdom
Duration: 19 Jul 201721 Jul 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10454 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference18th Annual Conference on Towards Autonomous Robotic Systems, TAROS 2017
Country/TerritoryUnited Kingdom


  • Human-robot interaction
  • Immersive virtual feedback
  • Teleoperation


Dive into the research topics of 'Development of an immersive interface for robot teleoperation'. Together they form a unique fingerprint.

Cite this