Publications

Papers

A selection of recent work. * equal contribution, † corresponding author. See Google Scholar for the complete list.

Highlights

Selected papers

Mem4Act: Learning Effective Latent Memory for Long-Horizon Robotic Manipulation

Yun Zhang, Zhiyu Huang†, Tianhui Cai, Chen Tang, Wei Wang, Jiaqi Ma

arXiv, 2026

Paper Project Code

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

Zhiyu Huang*, Johnson Liu*, Rui Song*, Tony (Xuewei) Qi, Zewei Zhou, Ruining Yang, Yun Zhang, Tianhui Cai, Hanyin Zhang, Mingxuan Gao, Valeria Xu, Jiali Chen, Yishan Shen, Yiluan Guo, Jiaqi Ma

Neural Information Processing Systems (NeurIPS), 2026

Paper Project Dataset

TIC-VLA: A Think-in-Control Vision-Language-Action Model for Robot Navigation in Dynamic Environments

Zhiyu Huang, Yun Zhang, Johnson Liu, Rui Song, Chen Tang, Jiaqi Ma

International Conference on Machine Learning (ICML), 2026

Paper Project Code

MDG: Masked Denoising Generation for Multi-Agent Behavior Modeling in Traffic Environments

Zhiyu Huang, Zewei Zhou, Tianhui Cai, Yun Zhang, Jiaqi Ma

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Findings, 2026

Paper

AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

Zewei Zhou, Tianhui Cai, Seth Z. Zhao, Yun Zhang, Zhiyu Huang†, Bolei Zhou, Jiaqi Ma

Neural Information Processing Systems (NeurIPS), 2025

Paper Project Code

Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuning

Zhiyu Huang, Xinshuo Weng, Maximilian Igl, Yuxiao Chen, Yulong Cao, Boris Ivanovic, Marco Pavone, Chen Lv

IEEE International Conference on Robotics and Automation (ICRA), 2025

Paper Project

Versatile Behavior Diffusion for Generalized Traffic Simulation

Zhiyu Huang, Zixu Zhang, Ameya Vaidya, Yuxiao Chen, Chen Lv, Jaime Fernández Fisac

IEEE Transactions on Intelligent Transportation Systems, 2025

Paper Project Code

GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving

Zhiyu Huang, Haochen Liu, Chen Lv

IEEE/CVF International Conference on Computer Vision (ICCV), 2023 · Oral (top 3%)

Paper Project Code

EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priors

Rui Song, Tianhui Cai, Markus Gross, Yun Zhang, Walter Zimmer, Zhiyu Huang, Olaf Wysocki, Jiaqi Ma

International Conference on Machine Learning (ICML), 2026

Paper
RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors

Tianhui Cai, Yun Zhang, Zewei Zhou, Zhiyu Huang†, Jiaqi Ma

IEEE International Conference on Robotics and Automation (ICRA), 2026

Paper
Driving with Regulation: Trustworthy and Interpretable Decision-Making for Autonomous Driving with Retrieval-Augmented Reasoning

Tianhui Cai, Yifan Liu, Zewei Zhou, Haoxuan Ma, Seth Z. Zhao, Zhiwen Wu, Xu Han, Zhiyu Huang†, Jiaqi Ma

AAAI Conference on Artificial Intelligence, 2026

Paper
TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Prediction

Zewei Zhou, Seth Z. Zhao, Tianhui Cai, Zhiyu Huang†, Bolei Zhou, Jiaqi Ma

IEEE/CVF International Conference on Computer Vision (ICCV), 2025

Paper
V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction

Zewei Zhou, …, Zhiyu Huang†, Bolei Zhou, Jiaqi Ma

IEEE/CVF International Conference on Computer Vision (ICCV), 2025

Paper Code
MIC-BEV: Multi-Infrastructure Camera Bird’s-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection

Yun Zhang, Zhaoliang Zheng, Johnson Liu, Zhiyu Huang†, Zewei Zhou, Zonglin Meng, Tianhui Cai, Jiaqi Ma

arXiv, 2025

Paper
Hybrid-Prediction Integrated Planning for Autonomous Driving

Haochen Liu, Zhiyu Huang, Wenhui Huang, Haohan Yang, Xiaoyu Mo, Chen Lv

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025

Paper Code

All publications on Google Scholar Full list on Prof. Huang’s homepage

Papers

Selected papers

Mem4Act: Learning Effective Latent Memory for Long-Horizon Robotic Manipulation

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

TIC-VLA: A Think-in-Control Vision-Language-Action Model for Robot Navigation in Dynamic Environments

MDG: Masked Denoising Generation for Multi-Agent Behavior Modeling in Traffic Environments

AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuning

Versatile Behavior Diffusion for Generalized Traffic Simulation

GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving

Other recent papers