Optimizing Handover Parameters by Q-Learning for Heterogeneous Radio-Optical Networks

Document Type

Article

Publication Date

2-1-2020

Abstract

Existing literature studying the access point (AP)-user association problem of heterogeneous radio-optical networks either investigates quasi-static network selection or only considers vertical handover (VHO) dwell time from optical to radio. The quasi-static assumption can result in outdated decisions for highly mobile scenarios. Solely focusing on the optical to radio handover ignores the importance of dwell time for VHO from radio to optical. In this paper, we propose a flexible and holistic framework, that runs a self-optimizing algorithm at the centralized coordinator (CC). This CC resides in the LTE eNodeB and controls the handover parameters of all the visible light communication (VLC) APs under the coverage of the LTE eNodeB. Based on Q-learning approach, the algorithm optimizes the time-to-trigger ($TTT$) values for VHO between LTE and VLC. Case studies are performed to validate the considerable gain in terms of average throughput by optimizing $TTT$s. We evaluate the impact of learning parameters on the optimal throughput and convergence speed through trace-driven simulations. The simulation results reveal that the Q-learning based algorithm improves the average throughput of mobile device by 25% when compared to the fixed $TTT$ scheme. Furthermore, this algorithm is capable of self-optimizing handover parameters in an online manner.

Identifier

85078846551 (Scopus)

Publication Title

IEEE Photonics Journal

External Full Text Location

https://doi.org/10.1109/JPHOT.2019.2953863

e-ISSN

19430655

Issue

1

Volume

12

Grant

CNS-1617645

Fund Ref

National Science Foundation

This document is currently not available here.

Share

COinS