Yuan Liu - Homepage

Yuan Liu (刘缘)

Incoming Assistant Professor@HKUST, PhD@HKU

yuanly@connect.hku.hk

I'm visiting NTU as a PostDoc working with Prof. Ziwei Liu. I obtained my PhD degree at HKU advised by Prof. Wenping Wang and Prof. Taku Komura. I'm one of the organizers of AnySyn3D. My research mainly concentrates on 3D vision and graphics. I currently work on topics about 3D AIGC including neural rendering, neural representations, and 3D generative models.

[Github] [Twitter] [Google Scholar]

Openings

I will join ISD HKUST as an assistant professor in 2025 spring. I'm going to recruit PhD students (start from 2025 fall), research assistants, and visiting students. We will focus on utilizing neural rendering/representations (NeRF, NeuS, 3D GS), 3D Generative Models and 3D LLMs for solving the following tasks.

AI for 3D Asset Generation.
3D/4D Video Generation and Editing.
City-scale 3D Reconstruction and Analysis.

If you are interested in working with me on these topics, please fill the Google form here and drop an email to yuanly@connect.hku.hk. I have experience in mentoring master or junior PhD students. Refer to the Mentoring section for more details.

Publications (Selected / Full Publication List)

*Equal contribution †Corresponding author

	DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models Yuqing Zhang, Yuan Liu, Zhiyu Xie, Lei Yang, Zhongyuan Liu, Mengzhou Yang, Runze Zhang, Qilong Kou, Cheng Lin, Wenping Wang, Xiaogang Jin† SIGGRAPH 2024 (TOG)** [Paper] [Project Page] [Code]
	Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li, Yuan Liu, Xiaoxiao Long†, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wei Xue, Wenhan Luo, Ping Tan, Wenping Wang, Qifeng Liu, Yike Guo† arXiv 2024 [Paper] [Project Page] [Code] [Live demo]
	SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long†, Lingjie Liu, Taku Komura, Wenping Wang† ICLR 2024 (Spotlight) [Paper] [Project Page] [Code] [Live demo]
	Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin†, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, Wenping Wang† CVPR 2024 (Highlight) [Paper] [Project Page] [Code] [Live demo]
	NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images Yuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long, Jiepeng Wang, Lingjie Liu, Taku Komura, Wenping Wang SIGGRAPH 2023 (TOG) [Paper] [Project Page] [Code]
	F²NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories Peng Wang, Yuan Liu, Zhaoxi Chen, Ziwei Liu, Lingjie Liu, Taku Komura, Christian Theobalt, Wenping Wang CVPR 2023 (Highlight) [Paper] [Project Page] [Code]
	RoReg: Pairwise Point Cloud Registration with Oriented Descriptors and Local Rotations Haiping Wang, Yuan Liu, Qingyong Hu, Bing Wang, Jianguo Chen, Zhen Dong†, Yulan Guo, Wenping Wang, Bisheng Yang† TPAMI 2023 [Paper] [Project Page] [Code]
	Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images Yuan Liu, Yilin Wen, Sida Peng, Cheng Lin, Xiaoxiao Long, Taku Komura, Wenping Wang ECCV 2022 [Paper] [Project Page] [Code]
	Neural Rays for Occlusion-aware Image-based Rendering Yuan Liu, Sida Peng, Lingjie Liu, Qianqian Wang, Peng Wang, Christian Theobalt, Xiaowei Zhou, Wenping Wang CVPR 2022 [Paper] [Project Page] [Code]
	NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang NeurIPS 2021 (Spotlight) [Paper] [Project Page] [Code]
	PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation Sida Peng, Yuan Liu, Qixing Huang, Xiaowei Zhou, Hujun Bao CVPR 2019 (Oral)** [Paper] [Project Page] [Code]

Mentoring

I spent wonderful time working with talented master or junior PhD students on some interesting research projects as follows.

Haiping Wang: YOHO (MM'22), RoReg (TPAMI'23) SGHR (CVPR'23) FreeReg (ICLR'23)

PhD at WHU.

Runsong Zhu: AdaFit (ICCV'21)

Master at WHU, Ph.D. at CUHK

Yuqing Zhang: DreamMat (SIGGRAPH'24)

Master at ZJU

Jionghao Wang: SO-SMPL (arXiv'23)
- Master at SJTU, PhD at TAMU
Peng Li: Era3D (arXiv'24)
- PhD at HKUST
Wenqi Jiangying: GaussianShader (CVPR'24)
- PhD at ShanghaiTech University
Anran Liu: NeRFBuff (TVCG'24), Part123 (SIGGRAPH'24)
- PhD at HKU

	DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models Yuqing Zhang, Yuan Liu, Zhiyu Xie, Lei Yang, Zhongyuan Liu, Mengzhou Yang, Runze Zhang, Qilong Kou, Cheng Lin, Wenping Wang, Xiaogang Jin† SIGGRAPH 2024 (TOG)** [Paper] [Project Page] [Code]
	Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li, Yuan Liu, Xiaoxiao Long†, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wei Xue, Wenhan Luo, Ping Tan, Wenping Wang, Qifeng Liu, Yike Guo† arXiv 2024 [Paper] [Project Page] [Code] [Live demo]
	SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long†, Lingjie Liu, Taku Komura, Wenping Wang† ICLR 2024 (Spotlight) [Paper] [Project Page] [Code] [Live demo]
	Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin†, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, Wenping Wang† CVPR 2024 (Highlight) [Paper] [Project Page] [Code] [Live demo]
	NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images Yuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long, Jiepeng Wang, Lingjie Liu, Taku Komura, Wenping Wang SIGGRAPH 2023 (TOG) [Paper] [Project Page] [Code]
	F²NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories Peng Wang, Yuan Liu, Zhaoxi Chen, Ziwei Liu, Lingjie Liu, Taku Komura, Christian Theobalt, Wenping Wang CVPR 2023 (Highlight) [Paper] [Project Page] [Code]
	RoReg: Pairwise Point Cloud Registration with Oriented Descriptors and Local Rotations Haiping Wang, Yuan Liu, Qingyong Hu, Bing Wang, Jianguo Chen, Zhen Dong†, Yulan Guo, Wenping Wang, Bisheng Yang† TPAMI 2023 [Paper] [Project Page] [Code]
	Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images Yuan Liu, Yilin Wen, Sida Peng, Cheng Lin, Xiaoxiao Long, Taku Komura, Wenping Wang ECCV 2022 [Paper] [Project Page] [Code]
	Neural Rays for Occlusion-aware Image-based Rendering Yuan Liu, Sida Peng, Lingjie Liu, Qianqian Wang, Peng Wang, Christian Theobalt, Xiaowei Zhou, Wenping Wang CVPR 2022 [Paper] [Project Page] [Code]
	NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang NeurIPS 2021 (Spotlight) [Paper] [Project Page] [Code]
	PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation Sida Peng, Yuan Liu, Qixing Huang, Xiaowei Zhou, Hujun Bao CVPR 2019 (Oral)** [Paper] [Project Page] [Code]