A Digitized You in My Eye: A Perceptually Driven Spatial Communication Prototype for XR

Document Type

Article

Publication Date

1-1-2024

Abstract

Amid the proliferation of immersive extended reality (XR), three key challenges are identified: the transmission and synthesis of intensive volumetric streams, the need for personalized XR experiences, and the availability of a comprehensive 3D data capturing system. To overcome these challenges, we propose a 'Digitized You in My Eye' (DYME) spatial communication prototype, which leverages 5G, distributed computing, and artificial intelligence (AI) to address challenges in XR. DYME proposes a 3D live volumetric chat procedure that eliminates real-time image capture by utilizing pre-existing digitized 3D models stored in the cloud. It further embraces a distributed methodology for volumetric streaming, encompassing the utilization of cloud, edge, and local devices, capitalizing on the proximity of user infrastructure, and employing expeditious transmission facilitated by AI generative models. Additionally, a user-specific management module (DYME manager) is integrated to personalize XR experiences based on user behaviors and preferences. By combining these technologies, DYME aims to provide efficient, tailored, and immersive XR experiences. The prototype demonstrates the potential of AI and 5G-driven solutions in addressing challenges and enhancing user experiences in XR environments.

Identifier

85193260199 (Scopus)

Publication Title

IEEE Wireless Communications

External Full Text Location

https://doi.org/10.1109/MWC.011.2300344

e-ISSN

15580687

ISSN

15361284

First Page

252

Last Page

259

Issue

4

Volume

31

This document is currently not available here.

Share

COinS