Posts by Collection

portfolio

publications

POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo

Lixin Yang, Jian Xu, Licheng Zhong, Xinyu Zhan, Zhicheng Wang, Kejian Wu, Cewu Lu

Computer Vision and Pattern Recognition (CVPR), 2023
Paper / arXiv / Code

POEM (Point Embedded Multi-view) focuses on reconstructing an articulation body with “true scale” and “accurate pose” from a series of sparsely arranged camera views. In practice, we used the example of hand. POEM explores the power of points, using a cluster of (x, y, z) coordinates with natural positional encoding to find associations in multi-view stereo.

CHORD: Category-level in-Hand Object Reconstruction via Shape Deformation

Kailin Li*, Lixin Yang*, Haoyu Zhen, Zenan Lin, Xinyu Zhan, Licheng Zhong, Jian Xu, Kejian Wu, Cewu Lu

International Conference on Computer Vision (ICCV), 2023
Project Page / Paper / arXiv / PyBlend

We proposed a new method CHORD which exploits the categorical shape prior for reconstructing the shape of intra-class objects. In addition, we constructed a new dataset, COMIC, of category-level hand-object interaction. COMIC encompasses a diverse collection of object instances, materials, hand interactions, and viewing directions, as illustrated.

Color-NeuS: Reconstructing Neural Implicit Surfaces with Color

Licheng Zhong*, Lixin Yang*, Kailin Li, Haoyu Zhen, Mei Han, Cewu Lu

International Conference on 3D Vision (3DV), 2024
Project Page / Paper / arXiv / Data / Code

Color-NeuS focuses on mesh reconstruction with color. We remove view-dependent color while using a relighting network to maintain volume rendering performance. Mesh is extracted from the SDF network, and vertex color is derived from the global color network. We conceived a in hand object scanning task and gathered several videos for it to evaluate Color-NeuS.

Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking



under review

A benchmark of Humanoid Scene Interaction. The first comprehensive benchmark for generalizable humanoid-scene interaction learning via human mimicking. Integrated a large-scale diverse human skill reference dataset with both synthetic and real-world human-scene interactions. Developed a general skill-learning paradigm and provide support for both pipeline-wise and modular evaluations.

talks

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.