Margin Trader: A Reinforcement Learning Framework for Portfolio Management with Margin and Constraints
Document Type
Conference Proceeding
Publication Date
11-27-2023
Abstract
In the field of portfolio management using reinforcement learning, existing approaches have mainly focused on cash-only trading, overlooking the potential benefits and risks of margin trading. Incorporating margin accounts and their constraints, especially in short sale scenarios, is crucial yet often neglected. To address this gap, we make the first attempt to propose Margin Trader, an innovative and adaptive reinforcement learning framework designed for margin trading in the stock market. Margin Trader integrates margin accounts and constraints into a realistic trading environment for both long and short positions. The framework aims to balance profit maximization and risk management through the Margin Adjustment Module and the Maintenance Detection Module. Margin Trader supports various Deep Reinforcement Learning (DRL) algorithms and offers traders the flexibility to customize critical settings, such as equity allocation, margin ratios, and maintenance requirements, to suit diverse market conditions, individual preferences, and risk tolerance. Experimental results demonstrate that Margin Trader effectively learns profitable trading strategies and hedges risks in both bullish and bearish markets, outperforming other baseline models with the highest Sharpe ratio.
Identifier
85179838001 (Scopus)
ISBN
[9798400702402]
Publication Title
Icaif 2023 4th ACM International Conference on AI in Finance
External Full Text Location
https://doi.org/10.1145/3604237.3626906
First Page
610
Last Page
618
Recommended Citation
Gu, Jingyi; Du, Wenlu; Muntasir Rahman, A. M.; and Wang, Guiling, "Margin Trader: A Reinforcement Learning Framework for Portfolio Management with Margin and Constraints" (2023). Faculty Publications. 1314.
https://digitalcommons.njit.edu/fac_pubs/1314
