Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians

Licheng Zhong, Hong-Xing "Koven" Yu, Jiajun Wu, Yunzhu Li

arXiv preprint
Project Page / arXiv / Data / Code

Spring-Gaus reconstructs the appearance, geometry, and physical dynamics properties of elastic objects from video observations. Spring-Gaus enables future prediction and simulation under different initial states and environmental parameters.

Color-NeuS: Reconstructing Neural Implicit Surfaces with Color

Licheng Zhong*, Lixin Yang*, Kailin Li, Haoyu Zhen, Mei Han, Cewu Lu

International Conference on 3D Vision (3DV), 2024
Project Page / arXiv / Data / Code

Color-NeuS focuses on mesh reconstruction with color. We remove view-dependent color while using a relighting network to maintain volume rendering performance. Mesh is extracted from the SDF network, and vertex color is derived from the global color network. We conceived a in hand object scanning task and gathered several videos for it to evaluate Color-NeuS.

CHORD: Category-level in-Hand Object Reconstruction via Shape Deformation

Kailin Li*, Lixin Yang*, Haoyu Zhen, Zenan Lin, Xinyu Zhan, Licheng Zhong, Jian Xu, Kejian Wu, Cewu Lu

International Conference on Computer Vision (ICCV), 2023
Project Page / Paper / arXiv / Code / PyBlend

We proposed a new method CHORD which exploits the categorical shape prior for reconstructing the shape of intra-class objects. In addition, we constructed a new dataset, COMIC, of category-level hand-object interaction. COMIC encompasses a diverse collection of object instances, materials, hand interactions, and viewing directions, as illustrated.

POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo

Lixin Yang, Jian Xu, Licheng Zhong, Xinyu Zhan, Zhicheng Wang, Kejian Wu, Cewu Lu

Computer Vision and Pattern Recognition (CVPR), 2023
Paper / arXiv / Code

POEM (Point Embedded Multi-view) focuses on reconstructing an articulation body with "true scale" and "accurate pose" from a series of sparsely arranged camera views. In practice, we used the example of hand. POEM explores the power of points, using a cluster of (x, y, z) coordinates with natural positional encoding to find associations in multi-view stereo.

Exploring the use of Convolutional Neural Network to Surgical Stapler Design

Licheng Zhong, Jin Ma, Yizhou Li and Guoxing Liu

Journal of Shanghai Jiao Tong University (Science)

We trained a model to identify the image of staplers (distinguish from mechanical arms as an example). After image recognition, we analyzed the feature information contained in the obtained image to help design. This method can also use in other product designs.

Centralized and Decentralized Methods for Multi-robot Safe Navigation

Xinbei Wang*, Zexuan Yan*, Licheng Zhong* (*=equal contribution)

Machine Learning and Intelligent Systems Engineering (MLISE), 2022

We simulated two centralized methods and two decentralized methods for multi-robot safe navigation in their respective environments.