GestRight: Understanding the Feasibility of Gesture-driven Tele-Operation in Human-Robot Teams

Document Type

Conference Proceeding

Publication Date

1-1-2024

Abstract

In this paper, we propose GestRight, a real-time system for gesture-based tele-operation of a mobile robot. For field use (e.g., smart factory settings, search and rescue missions, etc.), relying on tablet-based controls or joysticks are limiting which has led to the recent interest in hands-free operation of these assistive robots. In this work, we design three gesture-based schemes, namely, fist, touch, and wheel, represent three levels of precision-intuitiveness tradeoffs for low-level navigational control of mobile robots. GestRight includes a head-mounted device that captures hand joint data for accurate gesture recognition which is then translated to motion commands at an edge server. Through a user study involving seventeen participants, we present quantitative insights in comparison to traditional modes of control. Specifically, we evaluate GestRight in terms of the ease of navigational control, task time, and amount of errors/corrective actions required, run extensive statistical analyses, and provide a series of design recommendations for gesture-driven teleoperation systems. Our results show that gesture based schemes perform as well as traditional modes of control in contrast to participants' self-reports on how successful they felt in controlling the robots.

Identifier

85216488119 (Scopus)

ISBN

[9798350377705]

Publication Title

IEEE International Conference on Intelligent Robots and Systems

External Full Text Location

https://doi.org/10.1109/IROS58592.2024.10802649

e-ISSN

21530866

ISSN

21530858

First Page

13487

Last Page

13494

Grant

W911NF21-20076

Fund Ref

U.S. Army

This document is currently not available here.

Share

COinS