CN | EN
Faculty & Staff
Zhang Xinyu

Phone: +8613381195632

E-mail:xyzhang@tsinghua.edu.cn

Education

  • Ph.D., Beihang University, 2020-2024

  • Master, Tsinghua University, 2001-2004

  • B.E., Tsinghua University, 1997-2001

Work Experience

2004-present:Tsinghua University

Research

  • Lantu Automotive Technology Co., Ltd, Research and development of autonomous driving VLM large model, Principal Investigator (20252002074), 2025-2027

  • National Key R&D Program, Intelligent Shared Mobility Platform for Smart Cities: Key Technologies and Applications (2018YFE0204300), Principal Investigator, 2019-2023

  • National Natural Science Foundation Project, Research on multi-modal fusion joint coding method for intelligent driving perception safety (62273198), Principal Investigator, 2023-2026

  • National Key R&D Program Subtopic, Research on Path planning and decision making method of intelligent electric vehicle (2016YFB0100903), Principal Investigator, 2016-2020

  • Beijing Natural Science Foundation Project, Multimodal Sensing and Navigation Localization Technology Research for Automated Guided Vehicles in Chemical Production (L241017), Principal Investigator, 2024-2027

  • China FAW Group Jilin Automotive Development Project, Commercial Vehicle Autonomous Driving Basic Software Platform Development Project (2020200254), Principal Investigator, 2020-2021

  • Toyota Motor Corporation Cross-Disciplinary Project, Intelligent Parking Management and Technology Platform Research Based on Big Data and Internet of Things (20203910011), Principal Investigator, 2020-2022

  • Tsinghua University - Meituan Digital Life Research Institute, Research on Automatic Spatial Calibration Technology for Onboard Multi-Sensors for Autonomous Driving (CO21032200380), Principal Investigator, 2021-2022

  • Shanghai Automotive Industry Development Foundation, Research on Integration Technology of Environmental Perception and Fusion (1926), Principal Investigator, 2019-2021

  • Tsinghua University Guoqiang Institute, Multimodal Sensing System for Outdoor Service Robots (2021GQS1003), Principal Investigator, 2019-2020

  • Tsinghua University Guoqiang Institute, Intelligent Research on Ground-Air Dual-Use Vehicle Systems (2019SG1010), Principal Investigator, 2019-2021

  • Beijing Jingwei Hengrun Technology Co., Ltd., Intelligent Driving Project Technology Development (20182002058), Principal Investigator, 2018-2019

Publications

Representative Papers

[1] Zhang XinYu, et al. Dual Radar: A Multi-modal Dataset with Dual 4D Radar for Autonomous Driving[J]. Scientific Data, 2025.

[2] Yang Lei, Zhang Xinyu, et al. SGV3D: Toward Scenario Generalization for Vision-Based Roadside 3D Object Detection[J]. IEEE Transactions on Intelligent Transportation Systems, 2025.

[3] Xiong Yijin, Zhang Xinyu, et al. Cooperative Camera-LiDAR Extrinsic Calibration for Vehicle-Infrastructure Systems in Urban Intersections[J]. IEEE Internet of Things Journal, 2025.

[4] Wang Huanan, Zhang Xinyu, et al. PDDepth: Pose Decoupled Monocular Depth Estimation for Roadside Perception System[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2025.

[5] Wang Li, Zhang Xinyu, et al. FMRT: Learning Accurate Feature Matching With Reconciliatory Transformer[J]. IEEE Transactions on Automation Science and Engineering, 2025.

[6] Zhang ShiYan, Zhang Xu, Zhang Xinyu, et al. TEA-IHPCR: Temporal Augmented-Invariant Vehicle-Infrastructure Cooperative Heterogeneous Point Cloud Registration[J]. IEEE Transactions on Instrumentation and Measurement, 2025.

[7] Yang Lei, Zhang Xinyu, et al. MonoGAE: Roadside Monocular 3D Object Detection With Ground-Aware Embeddings[J]. IEEE Transactions on Intelligent Transportation Systems, 2024.

[8] Wang Huanan, Zhang Xinyu, et al. Si-GAIS: Siamese Generalizable-Attention Instance Segmentation for Intersection Perception System[J]. IEEE Transactions on Intelligent Transportation Systems, 2024.

[9] Gong Yan, Zhang Xinyu, et al. Steering Angle-Guided Multimodal Fusion Lane Detection for Autonomous Driving[J]. IEEE Transactions on Intelligent Transportation Systems, 2024.

[10] Xiong Yijin, Zhang Xinyu, et al. GF-SLAM: A Novel Hybrid Localization Method Incorporating Global and Arc Features[J]. IEEE Transactions on Automation Science and Engineering, 2024.

[11] Wang Li, Zhang Xinyu, et al. Fuzzy-NMS: Improving 3D Object Detection With Fuzzy Classification in NMS[J]. IEEE Transactions on Intelligent Vehicles, 2024.

[12] Gao Xin, Zhang Xinyu, et al. A Survey of Collaborative Perception in Intelligent Vehicles at Intersections[J]. IEEE Transactions on Intelligent Vehicles, 2023.

[13] Zhang Xinyu, et al. Oblique Convolution: A Novel Convolution Idea for Redefining Lane Detection[J]. IEEE Transactions on Intelligent Vehicles, 2023.

[14] Zhang Xinyu, et al. Informative Data Selection With Uncertainty for Multimodal Object Detection, IEEE Transactions on Neural Networks and Learning Systems, 2023.

[15] Zhang Xinyu, et al. Multi-Modal Fusion Technology Based on Vehicle Information: A Survey, IEEE Transactions on Intelligent Vehicles, 2023.

[16] Zhiwei Li, Zhang Xinyu, et al. TVG-ReID: Transformer-Based Vehicle-Graph Re-Identification, IEEE Transactions on Intelligent Vehicles, 2023.

[17] Wang Li, Zhang Xinyu, et al. CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking With Camera-LiDAR Fusion, IEEE Transactions on Intelligent Transportation Systems, 2023.

[18] Yang Lei, Zhang Xinyu, et al. Mix-Teaching: A Simple, Unified and Effective Semi-Supervised Learning Framework for Monocular 3D Object Detection, IEEE Transactions on Circuits and Systems for Video Technology, 2023.

[19] Wang Li, Zhang Xinyu, et al. Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving, IEEE Transactions on Vehicular Technology, 2023.

[20] Wang Li, Xie Tao, Zhang Xinyu, et al. Auto-Points: Automatic Learning for Point Cloud Analysis with Neural Architecture Search, IEEE Transactions on Multimedia, 2023.

[21] Wang Xiaoyu, Huang Kangyao, Zhang Xinyu, et al. Path Planning for Air-Ground Robot Considering Modal Switching Point Optimization, 2023 International Conference on Unmanned Aircraft Systems (ICUAS), 2023.

[22] Zhao Yuting, Zhang Xinyu, et al. HPCR-VI: Heterogeneous point cloud registration for vehicle-infrastructure collaboration, 2023 IEEE Intelligent Vehicles Symposium (IV), 2023.

[23] Zhang Xinyu, et al. Intelligent Amphibious Ground-Aerial Vehicles: State of the Art Technology for Future Transportation. IEEE Transactions on Intelligent Vehicles (Early Access), June 2022.

[24] Zhang Xinyu, et al. OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving. IEEE Transactions on Vehicular Technology, 2022, 71 (3), pp. 2437-2447.

[25] Zhang Xinyu, et al. RI-Fusion: 3D Object Detection Using Enhanced Point Features with Range-Image Fusion for Autonomous Driving. IEEE Transactions on Instrumentation and Measurement, 2022.

[26] Wang Li, Zhang Xinyu, et al. Global Perception-based Robust Parking Space Detection Using a Low-cost Camera. IEEE Transactions on Intelligent Vehicles, June 2022.

[27] Wang Li, Zhang Xinyu, et al. Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving. IEEE Transactions on Vehicular Technology,2022.

[28] Zou Zhenhong, Zhang Xinyu, et al. A novel multimodal fusion network based on a joint coding model for lane line segmentation. Information Fusion, Volume 80, April 2022, pp.167-178.

[29] Wang Li, Song Ziying, Zhang Xinyu, et al. SAT-GCN: Self-Attention Graph Convolutional Network-Based 3D Object Detection for Autonomous Driving. Knowledge-Based Systems, November 2022, 110080.

[30] Wang Huanan, Zhang Xinyu, et al. IPS300+: a challenging multi-modal data sets for Intersection Perception System. 2022 International Conference on Robotics and Automation (ICRA), May 2022, pp. 2539-2545.

[31] Wang Li, Zhang Xinyu, et al. InterFusion: Interaction-based 4D Radar and LiDAR Fusion for 3D Object Detection. 2022 International Conference on Intelligent Robots and Systems (IROS), October 2022.

[32] Wang Shouan, Zhang Xinyu, et al. Temporal and Spatial Online Integrated Calibration for Camera and LiDAR. 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC), October 2022, pp. 3016-3022.

[33] Zhang Xinyu, et al. Channel Attention in LiDAR-camera Fusion for Lane Line Segmentation. Pattern Recognition, 2021, 118(12):108020.

[34] Zhang Xinyu, et al. Line-based Automatic Extrinsic Calibration of LiDAR and Camera. 2021 IEEE The International Conference on Robotics and Automation (ICRA), June 2021, pp.9347-9353.

[35] Tan Qifan, Zhang Xinyu, et al. Study on amphibious fly-drive vehicle: dynamic modeling and control. IEEE/ASME Transactions on Mechatronics, 2021, 26(2), pp.621-632.

Representative Patents

[1] Zhang Xinyu, Li Jun, Wang Li, Luo Jianxi, Liu Huaping, Liu Yuchao, 3D object detection method based on multi-view feature fusion of 4D RaDAR and LiDAR point clouds. US11397242B1.

[2] Zhang Xinyu, Li Jun, Li Zhiwei, Liu Huaping, Wu Xingang, All-weather target detection method based on vision and millimeter wave fusion. US11380089B1.

[3] Li Jun, Zhang Xinyu, Li Zhiwei, Zou Zhenhong, Huang Yi, Point cloud intensity completion method and system based on semantic segmentation. US11315271B2.

[4] Zhang Xinyu, Liu Huaping, Automatic calibration method and system for spatial position of laser radar and camera sensor. US11249174B1.

[5] Zhang Xinyu, Li Jun, Li Zhiwei, Tan Qifan, Wang Li. Detection Method Using Fusion Network Based on Attention Mechanism, And Terminal Device. US11222217B1.

[6] Zhang Xinyu, Li Jun, Li Zhiwei, Zou Zhenhong, Wang Li. Adaptive Multi-Sensor Data Fusion Method and System Based on Mutual Information. US11210801B1.

[7] Zhang Xinyu, Li Zhiwei, Liu Huaping, Wu Xingang. Deep Multimodal Cross-layer Intersecting Fusion Method, Terminal Device, And Storage Medium. US11120276B1.

[8] Zhang Xinyu, Li Zhiwei, Liu Huaping, Lu Yiqian, Liu Yuchao. Lidar Point Cloud Reflection Intensity Complementation Method and System. US11099275B1.

[9] Zhang Xinyu, Guo Shichun, Gao Wenju, Liu Huaping, Li Jun, Zhou Mo, Intelligent Vehicle Positioning Method Based on Feature Point Calibration, US11002859B1.

[10] Zhang Xinyu, Li Jun, Li Zhiwei, Liu Huaping, Zou Zhenhong, Lane Detection Method and System Based on Multi-level Integration of Vision and Lidar, US10929694B1.

[11] Zhang Xinyu, Yuan Jing, Guo Shichun, Positioning mapping method and system of UWB and visual SLAM fusion algorithm, CN114264297B.

[12] Zhang Xinyu, Li Zhiwei, Ma Jiahui, A sustainable learning method based on vibration information supervision, CN113255553B.

[13] Zhang Xinyu, Li Jun, Gong Yan, A semantic segmentation method and device based on vibration signal and RGB image fusion, CN114037834B.

[14] Zhang Xinyu, Li Jun, Lu Fengli, A vehicle re recognition method, device and electronic equipment based on roadside perception, CN114170516B.

[15] Zhang Xinyu, Li Jun, Wang Li, A multi-target tracking method based on stereo spatial information fusion with occlusion compensation, CN114119671B.

[16] Zhang Xinyu, Wang Li, Li Jun, A method and system for stereo space target detection based on fuzzy classification, CN114049616B.

[17] Zhang Xinyu, Li Jun, Li Zhiwei, A semantic segmentation method and system based on continuous learning, CN113569774B.

[18] Zhang Xinyu, Li Zhiwei, Li Jun, A Multi view Target Detection Method and System Based on Transformer, CN113673425B.

[19] Zhang Xinyu, Zou Zhenhong, Wang Wenjie, Robustness Testing Method and System of Autopilot Multi sensor Fusion Perception Model, CN113610141B.

Awards

  • First Prize, China Automotive Engineering Society Science and Technology Invention Award, 2025.

  • First Prize, China Command and Control Society CICC Science and Technology Award, 2020.

  • Gold Award, 49th Geneva International Invention Exhibition, 2022.

  • Gold Award, 72nd Nuremberg International Invention Exhibition, 2021.

  • Gold Award, 48th Geneva International Invention Exhibition, 2021.

  • Gold Award, 28th National Invention Exhibition, 2024.

Academic Services

  • IEEE Senior Member, 2025- Present

  • AE, Cognitive Computation, 2024- Present

School of Vehicle and Mobility,Tsinghua University

Copyright ©  All Rights Reserved