Tjong: A transformer-based Mahjong AI via hierarchical decision-making and fan backward

Document Type

Article

Publication Date

8-1-2024

Abstract

Mahjong, a complex game with hidden information and sparse rewards, poses significant challenges. Existing Mahjong AIs require substantial hardware resources and extensive datasets to enhance AI capabilities. The authors propose a transformer-based Mahjong AI (Tjong) via hierarchical decision-making. By utilising self-attention mechanisms, Tjong effectively captures tile patterns and game dynamics, and it decouples the decision process into two distinct stages: action decision and tile decision. This design reduces decision complexity considerably. Additionally, a fan backward technique is proposed to address the sparse rewards by allocating reversed rewards for actions based on winning hands. Tjong consists of 15M parameters and is trained using approximately 0.5 M data over 7 days of supervised learning on a single server with 2 GPUs. The action decision achieved an accuracy of 94.63%, while the claim decision attained 98.55% and the discard decision reached 81.51%. In a tournament format, Tjong outperformed AIs (CNN, MLP, RNN, ResNet, VIT), achieving scores up to 230% higher than its opponents. Furthermore, after 3 days of reinforcement learning training, it ranked within the top 1% on the leaderboard on the Botzone platform.

Identifier

85188745304 (Scopus)

Publication Title

CAAI Transactions on Intelligence Technology

External Full Text Location

https://doi.org/10.1049/cit2.12298

e-ISSN

24682322

ISSN

24686557

First Page

982

Last Page

995

Issue

4

Volume

9

Grant

62276285

Fund Ref

National Natural Science Foundation of China

This document is currently not available here.

Share

COinS