Demo: Attention and Mobility-Aware On-Device Perception for Mobile Augmented Reality

Document Type

Conference Proceeding

Publication Date

2-28-2024

Abstract

With the ability to seamlessly integrate physical and virtual worlds to provide immersive experiences, Mobile Augmented Reality, is a promising technology for several futuristic applications such as on the-job training and guidance in smart factories, human-autonomy teaming, etc. However, the hardware limitations of most modern AR/VR headsets are prohibitive in that the processing latencies for common scene understanding tasks, a foundational primitive for such applications, can be in the order of 1 leading to poor quality of experience (QoE). The problem is further exacerbated by contention for resources between processing and rendering. State of-the-art in perception for these headsets rely on assistance from nearby edge servers [1, 2] which may not always be available in practical settings. In this demonstration, we show how user atten tion and mobility-aware scheduling can improve the processing latency without significant loss in perception accuracy and QoE for on-device perception.

Identifier

85187205045 (Scopus)

ISBN

[9798400704970]

Publication Title

HOTMOBILE 2024 - Proceedings of the 2024 25th International Workshop on Mobile Computing Systems and Applications

External Full Text Location

https://doi.org/10.1145/3638550.3643634

First Page

158

This document is currently not available here.

Share

COinS