A Progressive Quadric Graph Convolutional Network for 3D Human Mesh Recovery
Document Type
Article
Publication Date
1-1-2023
Abstract
Human mesh recovery from one single image has achieved rapid progress recently, but many methods suffer from the image appearance overfitting since the training data are collected along with accurate 3D annotations in controlled settings of monotonous backgrounds or simple clothes. Some methods regress human mesh vertices from poses to tackle the above problem. However the mesh topologies have not been well exploited, and artifacts are often generated. In this paper, we aim to find an efficient low-cost solution to human mesh reconstruction. To this end, we propose a Progressive Quadric Graph Convolutional Network (PQ-GCN), and design a simple and fast method for 3D human mesh recovery from a single image in the wild. Specifically, we apply quadric-based surface simplification to human meshes and design a progressive graph convolution network, accompanied by mesh feature up-sampling, to deal with the mesh topologies. We carry out a series of studies to validate our method. The results prove that our method achieves superior performance on a challenging in-the-wild dataset, while using 66% fewer parameters than the existing method, Pose2Mesh. Artifacts have also been eliminated and better visual quality has been obtained without any further post-processing and model fitting. Besides, the recovery can be stopped at an earlier stage by adding a decoder head. Consequently, the computational complexity can be reduced greatly.
Identifier
85136862377 (Scopus)
Publication Title
IEEE Transactions on Circuits and Systems for Video Technology
External Full Text Location
https://doi.org/10.1109/TCSVT.2022.3199201
e-ISSN
15582205
ISSN
10518215
First Page
104
Last Page
117
Issue
1
Volume
33
Grant
201502
Fund Ref
National Natural Science Foundation of China
Recommended Citation
Wang, Lei; Liu, Xunyu; Ma, Xiaoliang; Wu, Jiaji; Cheng, Jun; and Zhou, Mengchu, "A Progressive Quadric Graph Convolutional Network for 3D Human Mesh Recovery" (2023). Faculty Publications. 2354.
https://digitalcommons.njit.edu/fac_pubs/2354