Robust and Resilient Cooperative Perception under V2X Communication Limitations
Abstract: Environmental perception is fundamental to safe and efficient autonomous driving. With Cooperative Perception (CP) enabled by V2X networks, connected vehicles can exchange perceptual information to see through blind zones and deal with long-tail scenarios. In this talk, we propose a robust, reliable, and resilient CP framework for connected autonomous driving under V2X Communication Limitations. First, for robustness to localization error and communication delay, a calibration-free two-stage CP paradigm is proposed using deep metric learning. This fusion method only requires image data and is adaptive to the transmission rate. Then, to guarantee high reliability, hard AoI constraints are considered in sensor scheduling of CP to guarantee the timeliness of perceptual information. The required channel resources are minimized in asynchronous status update settings. Next, to resiliently adapt to the dynamic traffic environment, we propose a learning-while-scheduling approach to trade off exploration and exploitation. An online sensor scheduling algorithm is designed based on restless MAB (Multi-Armed Bandit) theory to maximize the average CP gain with low scheduling overhead. Finally, a large-scale multi-view multi-modality dataset, called Dolphins, is presented to assist further researches and verification of CP systems.
Date and Time
Location
Hosts
Registration
- Date: 18 Jun 2025
- Time: 05:30 PM UTC to 06:30 PM UTC
-
Add Event to Calendar
Speakers
Robust and Resilient Cooperative Perception under V2X Communication Limitations
Abstract: Environmental perception is fundamental to safe and efficient autonomous driving. With Cooperative Perception (CP) enabled by V2X networks, connected vehicles can exchange perceptual information to see through blind zones and deal with long-tail scenarios. In this talk, we propose a robust, reliable, and resilient CP framework for connected autonomous driving under V2X Communication Limitations. First, for robustness to localization error and communication delay, a calibration-free two-stage CP paradigm is proposed using deep metric learning. This fusion method only requires image data and is adaptive to the transmission rate. Then, to guarantee high reliability, hard AoI constraints are considered in sensor scheduling of CP to guarantee the timeliness of perceptual information. The required channel resources are minimized in asynchronous status update settings. Next, to resiliently adapt to the dynamic traffic environment, we propose a learning-while-scheduling approach to trade off exploration and exploitation. An online sensor scheduling algorithm is designed based on restless MAB (Multi-Armed Bandit) theory to maximize the average CP gain with low scheduling overhead. Finally, a large-scale multi-view multi-modality dataset, called Dolphins, is presented to assist further researches and verification of CP systems.
Biography:
Dr. Zhisheng Niu graduated from Beijing Jiaotong University, China, in 1985, and got his M.E. and D.E. degrees from Toyohashi University of Technology, Japan, in 1989 and 1992, respectively. During 1992-1994, he worked for Fujitsu Laboratories Ltd., Japan, and in 1994 joined with Tsinghua University, Beijing, China, where he is now a professor at the Department of Electronic Engineering. During 1997-1998, he visited Hitachi Central Research Laboratory as a HIVIPS senior researcher. His major research interests include queueing theory and traffic engineering, wireless communications and mobile Internet, vehicular communications and smart networking, and green communication and networks.
Dr. Niu has been serving IEEE Communications Society since 2000, first as Chair of Beijing Chapter and then as Director of Asia-Pacific Board, Director for Conference Publications, Chair of Emerging Technologies Committee, Director for Online Contents, Editor-in-Chief of IEEE Trans. Green Commun. & Networks, and currently Chair of Emerging Technologies Committee. He received the Distinguished Technical Achievement Recognition Award from IEEE Communications Society Green Communications and Computing Technical Committee in 2018. He was selected as a distinguished lecturer of IEEE Communication Society as well as IEEE Vehicular Technologies Society. He is a fellow of both IEEE and IEICE.
Address:British Columbia, Canada