Caching in Dynamic IoT Networks by Deep Reinforcement Learning

Document Type

Article

Publication Date

3-1-2021

Abstract

The sensing service of Internet-of-Things (IoT) networks enables IoT sensors to sense the environment information (e.g., temperature and traffic conditions) and send them through the IoT gateway to the users who request those information. The explosive growth of IoT users and sensors injects massive traffic into IoT networks and easily depletes the battery of IoT sensors. Caching at the IoT gateway is hence a promising solution to mitigate this problem by storing popular IoT data at the IoT gateway and sending them directly to the users instead of activating IoT sensors to transmit the data. In our work, we investigate the content placement problem, which determines data to be cached at each time epoch in dynamic IoT networks with the objective to minimize the average data transmission delay constrained by the cache storage capacity and IoT data freshness. We formulate our problem as an integer linear programming (ILP) problem and then model it as a Markov decision process (MDP). A deep reinforcement learning algorithm is proposed to solve this problem and its performances are demonstrated via extensive simulations.

Identifier

85101674073 (Scopus)

Publication Title

IEEE Internet of Things Journal

External Full Text Location

https://doi.org/10.1109/JIOT.2020.3004394

e-ISSN

23274662

First Page

3268

Last Page

3275

Issue

5

Volume

8

This document is currently not available here.

Share

COinS