3D-RVP: A method for 3D object reconstruction from a single depth view using voxel and point
Document Type
Article
Publication Date
3-21-2021
Abstract
Three-dimensional object reconstruction technology has a wide range of applications such as augment reality, virtual reality, industrial manufacturing and intelligent robotics. Although deep learning-based 3D object reconstruction technology has developed rapidly in recent years, there remain important problems to be solved. One of them is that the resolution of reconstructed 3D models is hard to improve because of the limitation of memory and computational efficiency when deployed on resource-limited devices. In this paper, we propose 3D-RVP to reconstruct a complete and accurate 3D geometry from a single depth view, where R, V and P represent Reconstruction, Voxel and Point, respectively. It is a novel two-stage method that combines a 3D encoder-decoder network with a point prediction network. In the first stage, we propose a 3D encoder-decoder network with residual learning to output coarse prediction results. In the second stage, we propose an iterative subdivision algorithm to predict the labels of adaptively selected points. The proposed method can output high-resolution 3D models by increasing a small number of parameters. Experiments are conducted on widely used benchmarks of a ShapeNet dataset in which four categories of models are selected to test the performance of neural networks. Experimental results show that our proposed method outperforms the state-of-the-arts, and achieves about 2.7% improvement in terms of the intersection-over-union metric.
Identifier
85097471582 (Scopus)
Publication Title
Neurocomputing
External Full Text Location
https://doi.org/10.1016/j.neucom.2020.10.097
e-ISSN
18728286
ISSN
09252312
First Page
94
Last Page
103
Volume
430
Grant
2019B1515120030
Fund Ref
National Natural Science Foundation of China
Recommended Citation
Zhao, Meihua; Xiong, Gang; Zhou, Meng Chu; Shen, Zhen; and Wang, Fei Yue, "3D-RVP: A method for 3D object reconstruction from a single depth view using voxel and point" (2021). Faculty Publications. 4237.
https://digitalcommons.njit.edu/fac_pubs/4237