Embodied AI / Humanoid Robotics / Multimodal Perception

Moyun Liu

Postdoctoral Researcher at Huazhong University of Science and Technology working on embodied intelligence, robot perception, and multimodal 3D understanding.

Research Embodied AI and robotics
Current Base State Key Laboratory of Intelligent Manufacturing Equipment and Technology, HUST

I am currently a Postdoctoral Researcher in the School of Mechanical Science and Engineering at Huazhong University of Science and Technology (HUST), working with Prof. Han Ding (Academician of the Chinese Academy of Sciences), Prof. Bo Tao (Changjiang Distinguished Professor), and Prof. Xingwei Zhao (Recipient of the National Science Fund for Excellent Young Scholars).

I received both my M.S. and Ph.D. degrees in Mechanical Science and Engineering from HUST in 2021 and 2025, advised by Prof. Youping Chen and Prof. Jingming Xie. From 2023 to 2025, I was a visiting student at the A*STAR Centre for Frontier AI Research (CFAR), Singapore, where I worked with Prof. Joey Tianyi Zhou and Dr. Jiawei Du.

My current research interests include embodied AI, humanoid robotics, multimodal fusion, and 3D scene understanding.

Research Focus

Embodied AI

I study how vision-language models and multimodal reasoning can support grounded interaction, affordance understanding, and task-oriented behavior.

Humanoid Robotics

I am interested in perception modules and decision pipelines that improve scene understanding and action planning for humanoid systems.

Multimodal 3D Perception

My previous and ongoing work covers depth completion, 3D detection, segmentation, and cross-modal representation learning across images, point clouds, and language.

News

  • 2026.05 🎉 Our work "Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs" is available online with Dr. Xin Zhang. Paper
  • 2026.03 🎉 Our work "Prompt-Driven Lightweight Foundation Model for Instance Segmentation-Based Fault Detection in Freight Trains" was accepted by IEEE TITS. Paper Code
  • 2026.02 🎉 Our work "HAMMER: Harnessing MLLMs via Cross-Modal Integration for Intention-Driven 3D Affordance Grounding" was accepted by CVPR 2026. Project Code
  • 2026.02 🎉 Our work "LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentation" was accepted by IEEE TCSVT. Paper Code
  • 2025.09 🎉 Our work "T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentation" was accepted by IEEE TMM. Paper Code
More updates
  • 2025.08 🎉 Our work "Generalized Probabilistic Graphical Modeling for Multi-view Bipartite Graph Clustering" was accepted by IEEE TPAMI. Paper Code
  • 2025.07 🎉 Our work "GaussianCross: Cross-modal Self-supervised 3D Representation Learning via Gaussian Splatting" was accepted by ACM MM 2025. Paper Code
  • 2025.06 🧑‍🔬 I joined the State Key Laboratory of Intelligent Manufacturing Equipment and Technology, HUST, as a Postdoctoral Researcher.
  • 2025.06 🎓 I completed my Ph.D. at HUST.
  • 2025.05 🏆 Our works LaSSM and SGIFormer won first and second places on the CVPR 2025 ScanNet++ Challenge.
  • 2025.04 🎉 Our work "MAENet: Boost Image-Guided Point Cloud Completion More Accurate and Even" was accepted by Information Fusion. Paper Code
  • 2025.03 🏆 "LF-YOLO" was recognized as an ESI Highly Cited Paper. Paper Code
  • 2024.11 🏅 I received the National Scholarship for Ph.D. Students.
  • 2024.11 🎉 Our work "SGIFormer: Semantic-guided and Geometric-enhanced Interleaving Transformer for 3D Instance Segmentation" was accepted by IEEE TCSVT. Paper Code

Selected Publications

MAENet preview

MAENet: Boost Image-Guided Point Cloud Completion More Accurate and Even

Moyun Liu, Ziheng Yang, Bing Chen, Youping Chen, Jingming Xie, Lei Yao, Lap-Pui Chau, Jiawei Du, Joey Tianyi Zhou

Information Fusion, 2025

We propose a point cloud completion method that improves both geometric accuracy and point distribution uniformity.

BUNet preview

Towards Better Unguided Depth Completion via Cross-Modality Knowledge Distillation in the Frequency Domain

Moyun Liu, Bing Chen, Youping Chen, Jingming Xie, Lei Yao, Yang Zhang, Qin Hu, Jiawei Du, Joey Tianyi Zhou

IEEE Transactions on Intelligent Vehicles, 2024

We revisit the role of camera guidance in depth completion and design a stronger unguided framework through frequency-domain distillation.

MENet preview

MENet: Multi-Modal Mapping Enhancement Network for 3D Object Detection in Autonomous Driving

Moyun Liu, Youping Chen, Jingming Xie, Yijie Zhu, Yang Zhang, Lei Yao, Zhenshan Bing, Genghang Zhuang, Kai Huang, Joey Tianyi Zhou

IEEE Transactions on Intelligent Transportation Systems, 2024

We propose a multi-modal mapping enhancement network that improves 3D object detection performance in autonomous driving scenes.

CHNet preview

A Concise but High-performing Network for Image Guided Depth Completion in Autonomous Driving

Moyun Liu, Bing Chen, Youping Chen, Jingming Xie, Lei Yao, Yang Zhang, Joey Tianyi Zhou

Knowledge-Based Systems, 2024

We design a lightweight depth completion network that preserves strong image guidance while remaining efficient.

LF-YOLO preview

LF-YOLO: A Lighter and Faster YOLO for Weld Defect Detection of X-ray Image

ESI Highly Cited Paper

Moyun Liu, Youping Chen, Jingming Xie, Lei He, Yang Zhang

IEEE Sensors Journal, 2023

We propose an efficient defect detection framework for weld X-ray images with strong speed and accuracy trade-offs.

GEM preview

GEM: Boost Simple Network for Glass Surface Segmentation via Vision Foundation Models

Jing Hao*, Moyun Liu*, Jinrong Yang, Kuo Feng Hung

IEEE Transactions on Multimedia, 2024

We show how vision foundation models can be injected into a simple segmentation pipeline to improve glass surface understanding.

Experience

2025.06 - Present
Postdoctoral Researcher
School of Mechanical Science and Engineering, Huazhong University of Science and Technology
2023.05 - 2025.04
Visiting Ph.D. Student
A*STAR Centre for Frontier AI Research (CFAR), Singapore
2022.07 - 2022.09
Intern
Huawei Intelligent Automotive Solution Business Unit, Shanghai, China

Education

2021.09 - 2025.06
Ph.D. in Mechanical Science and Engineering
Huazhong University of Science and Technology
2019.06 - 2021.06
M.Eng. in Mechanical Science and Engineering
Huazhong University of Science and Technology
2015.09 - 2019.06
B.Eng. in Mechanical Engineering
Hubei University of Technology

Other Publications

Prompt-Driven Lightweight Foundation Model for Instance Segmentation-Based Fault Detection in Freight Trains IEEE TITS, 2026

Guodong Sun, Qihang Liang, Xingyu Pan, Moyun Liu, and Yang Zhang

HAMMER: Harnessing MLLMs via Cross-Modal Integration for Intention-Driven 3D Affordance Grounding CVPR, 2026

Lei Yao, Yong Chen, Yuejiao Su, Yi Wang, Moyun Liu, Lap-Pui Chau

T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentation IEEE TMM, 2025

Jing Hao, Yonghui Zhu, Lei He, Moyun Liu, James Kit Hon Tsoi, Kuo Feng Hung

Generalized Probabilistic Graphical Modeling for Multi-view Bipartite Graph Clustering IEEE TPAMI, 2025

Liang Li, Yuangang Pan, Yinghua Yao, Junpu Zhang, Moyun Liu, Xinwang Liu, Kenli Li, Keqin Li

Show more publications
GaussianCross: Cross-modal Self-supervised 3D Representation Learning via Gaussian Splatting ACM MM, 2025

Lei Yao, Yi Wang, Yi Zhang, Moyun Liu, Lap-Pui Chau

Multiple prior representation learning for self-supervised monocular depth estimation via hybrid transformer Engineering Applications of Artificial Intelligence, 2024

Guodong Sun, Junjie Liu, Mingxuan Liu, Moyun Liu, Yang Zhou

Efficient Visual Fault Detection for Freight Train via Neural Architecture Search With Data Volume Robustness IEEE Transactions on Industrial Informatics, 2024

Yang Zhang, Mingying Li, Huilin Pan, Moyun Liu, Yang Zhang

BF3D: Bi-directional fusion 3D detector with semantic sampling and geometric mapping Image and Vision Computing, 2023

Yijie Zhu, Jingming Xie, Moyun Liu, Lei Yao, Youping Chen

Real-time vision-based system of fault detection for freight trains IEEE Transactions on Instrumentation and Measurement, 2020

Yang Zhang, Moyun Liu, Yunian Chen, Hongjie Zhang, Yanwen Guo

Academic Service

Reviewer for Journals

  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • IEEE Transactions on Intelligent Transportation Systems
  • IEEE Transactions on Intelligent Vehicles
  • IEEE Transactions on Industrial Informatics
  • IEEE Transactions on Circuits and Systems for Video Technology
  • IEEE Transactions on Automation Science and Engineering
  • IEEE Sensors Journal
  • International Journal of Computer Vision
  • Information Fusion
  • Pattern Recognition
  • Computers in Industry
  • Knowledge-Based Systems
  • Engineering Applications of Artificial Intelligence
  • Expert Systems With Applications

Reviewer for Conferences

  • International Conference on Learning Representations (ICLR)
  • International Conference on Intelligent Robots and Systems (IROS)
  • ACM Multimedia (ACM MM)