Publications

2024

1. EMNLP

   

   Learning Autonomous Driving Tasks via Human Feedbacks with Large Language Models

   Yunsheng Ma, Xu Cao, Wenqian Ye, and 3 more authors

   In Findings of the Association for Computational Linguistics: EMNLP, 2024

   Bib

   @inproceedings{ma_learning_2024,
     title = {Learning {Autonomous} {Driving} {Tasks} via {Human} {Feedbacks} with {Large} {Language} {Models}},
     author = {Ma, Yunsheng and Cao, Xu and Ye, Wenqian and Cui, Can and Mei, Kai and Wang, Ziran},
     booktitle = {Findings of the Association for Computational Linguistics: EMNLP},
     year = {2024},
   }

2. CVPR

   

   LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs

   Yunsheng Ma^*, Can Cui^*, Xu Cao^*, and 9 more authors

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

   arXiv Bib Website

   @inproceedings{ma_lampilot_2024,
     author = {Ma, Yunsheng and Cui, Can and Cao, Xu and Ye, Wenqian and Liu, Peiran and Lu, Juanwu and Abdelraouf, Amr and Gupta, Rohit and Han, Kyungtae and Bera, Aniket and Rehg, James M. and Wang, Ziran},
     title = {LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs},
     booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
     year = {2024},
   }

3. CVPR

   

   MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding

   Xu Cao^*, Tong Zhou^*, Yunsheng Ma^*, and 8 more authors

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

   Bib Website

   @inproceedings{cao_maplm_2024,
     author = {Cao, Xu and Zhou, Tong and Ma, Yunsheng and Ye, Wenqian and Cui, Can and Tang, Kun and Cao, Zhipeng and Liang, Kaizhao and Wang, Ziran and Rehg, James M. and Zheng, Chao},
     title = {MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding},
     booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
     year = {2024},
   }

4. CVPR

   

   Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture

   Juanwu Lu^*, Can Cui^*, Yunsheng Ma, and 2 more authors

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

   arXiv
5. ITSM

   

   Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles

   Can Cui, Yunsheng Ma, Xu Cao, and 2 more authors

   IEEE Intelligent Transportation Systems Magazine, 2024
6. WACV

   

   MACP: Efficient Model Adaptation for Cooperative Perception

   Yunsheng Ma^*, Juanwu Lu^*, Can Cui, and 4 more authors

   In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024

   Abs arXiv Code Website

   Vehicle-to-vehicle (V2V) communications have greatly enhanced the perception capabilities of connected and automated vehicles (CAVs) by enabling information sharing to “see through the occlusions", resulting in significant performance improvements. However, developing and training complex multi-agent perception models from scratch can be expensive and unnecessary when existing single-agent models show remarkable generalization capabilities. In this paper, we propose a new framework termed MACP, which equips a single-agent pre-trained model with cooperation capabilities. We approach this objective by identifying the key challenges of shifting from single-agent to cooperative settings, adapting the model by freezing most of its parameters and adding a few lightweight modules. We demonstrate in our experiments that the proposed framework can effectively utilize cooperative observations and outperform other state-of-the-art approaches in both simulated and real-world cooperative perception benchmarks while requiring substantially fewer tunable parameters with reduced communication costs.

7. T-IV

   

   Driver Digital Twin for Online Recognition of Distracted Driving Behaviors

   Yunsheng Ma, Runjia Du, Amr Abdelraouf, and 3 more authors

   IEEE Transactions on Intelligent Vehicles, 2024

   Website

2023

1. T-IV

   

   REDFormer: Radar Enlightens the Darkness of Camera Perception With Transformers

   Can Cui, Yunsheng Ma, Juanwu Lu, and 1 more author

   IEEE Transactions on Intelligent Vehicles, 2023
2. UAI

   

   Mitigating Transformer Overconfidence via Lipschitz Regularization

   Wenqian Ye, Yunsheng Ma, Xu Cao, and 1 more author

   In Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence, 2023

   arXiv
3. ITSC

   

   CEMFormer: Learning to Predict Driver Intentions from In-Cabin and External Cameras via Spatial-Temporal Transformers

   Yunsheng Ma, Wenqian Ye, Xu Cao, and 4 more authors

   In IEEE International Conference on Intelligent Transportation Systems, 2023

   arXiv
4. CVPRW

   

   M2DAR: Multi-View Multi-Scale Driver Action Recognition with Vision Transformer

   Yunsheng Ma, Liangqi Yuan, Amr Abdelraouf, and 4 more authors

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023

   Awarded arXiv Code

   Outstanding Speaker Award at NGTS

5. CVPRW

   

   Peer-to-Peer Federated Continual Learning for Naturalistic Driving Action Recognition

   Liangqi Yuan, Yunsheng Ma, Lu Su, and 1 more author

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023

   arXiv

2020

1. AAAI Oral

   

   An End-to-End Visual-Audio Attention Network for Emotion Recognition in User-Generated Videos

   Sicheng Zhao^*, Yunsheng Ma^*, Yang Gu, and 6 more authors

   In Proceedings of the AAAI Conference on Artificial Intelligence, 2020

   arXiv Code Website