On a Meta Learning-Based Scheduler for Deep Learning Clusters

Document Type

Article

Publication Date

10-1-2023

Abstract

Deep learning (DL) has become a dominating type of workloads on AI computing platforms. The performance of such platforms highly depends on how distributed DL jobs are scheduled. Reinforcement learning (RL)-based schedulers have been extensively studied and are capable of modeling interferences between concurrent jobs competing for resources. However, existing RL-based schedulers must learn from large number of samples and adapt to workload changes in real systems, which is a huge cost for production clusters. This paper proposes an intelligent, autonomous scheduler that employs sample-efficient RL for real-world resource scheduling on complex DL clusters. Specifically, we design a closed-loop meta-RL-based worker placement algorithm for DL training jobs. Instead of random exploration, we encourage the scheduler to explore combinatorial subspaces, where the performance model might be inaccurate, to improve the sampling efficiency of the scheduler agent. Extensive experimental results demonstrate that our algorithm outperforms other baselines in terms of average job completion time with 12.29% to 16.24% improvements. Further experiments with workload variations yield 15.76% to 22.13% improvements.

Identifier

85168652996 (Scopus)

Publication Title

IEEE Transactions on Cloud Computing

External Full Text Location

https://doi.org/10.1109/TCC.2023.3308161

e-ISSN

21687161

First Page

3631

Last Page

3642

Issue

4

Volume

11

This document is currently not available here.

Share

COinS