Residential College | false |
Status | 已發表Published |
Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation | |
Gu, Shuo1; Lu, Jiacheng1; Yang, Jian1; Xu, Chengzhong2![]() ![]() ![]() | |
2023-04 | |
Source Publication | IEEE Transactions on Intelligent Vehicles
![]() |
ISSN | 2379-8858 |
Volume | 9Issue:1Pages:481 - 491 |
Abstract | Dense semantic scene understanding of the surrounding environment in top-view is a crucial task for autonomous vehicles. Recent LiDAR-based semantic perception works mainly focus on point-wise predictions of the LiDAR points instead of dense predictions of the environment, making them not appropriate for path-planning tasks. Pillar and voxel representations can achieve dense predictions, but the generation of data representation and data processing are usually time-consuming. In this article, we propose a top-view semantic completion network to produce accurate dense grid-wise predictions with real-time performance. Specifically, we propose an online distillation strategy, consisting of two parts: a student model using 2D range-view and top-view representations, and a teacher model using range-view, top-view, and voxel representations. To realize information transfer between different representations, we propose a cross-view association (CVA) module, by which the range-view features and 3D voxel features are converted into the ones in the top-view. The proposed method can avoid the difficulty of direct dense semantic segmentation in the top-view, with the point-wise sparse semantic segmentation module acting as a guide for the dense grid-wise semantic completion in a semantic-completion way. It can also alleviate the computational complexity by using only the voxel representation and 3D convolution in the teacher model. The experimental results on the SemanticKITTI dataset (46.4% mIoU) and nuScenes-LidarSeg dataset (47.3% mIoU) demonstrate the effectiveness of the proposed sparse guidance and online distillation strategies. |
Keyword | Computational Modeling Convolution Dense Top-view Laser Radar Online Distillation Semantic Completion Semantic Segmentation Semantics Sparse Guidance Task Analysis Three-dimensional Displays |
DOI | 10.1109/TIV.2023.3268241 |
URL | View the original |
Indexed By | SCIE |
WOS Research Area | Computer Science ; Engineering ; Transportation |
WOS Subject | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Transportation Science & Technology |
WOS ID | WOS:001173317800049 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85153484172 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) INSTITUTE OF COLLABORATIVE INNOVATION |
Corresponding Author | Kong, Hui |
Affiliation | 1.Department of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China 2.State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau, Macau, China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Gu, Shuo,Lu, Jiacheng,Yang, Jian,et al. Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation[J]. IEEE Transactions on Intelligent Vehicles, 2023, 9(1), 481 - 491. |
APA | Gu, Shuo., Lu, Jiacheng., Yang, Jian., Xu, Chengzhong., & Kong, Hui (2023). Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation. IEEE Transactions on Intelligent Vehicles, 9(1), 481 - 491. |
MLA | Gu, Shuo,et al."Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation".IEEE Transactions on Intelligent Vehicles 9.1(2023):481 - 491. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment