UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation
Gu, Shuo1; Lu, Jiacheng1; Yang, Jian1; Xu, Chengzhong2; Kong, Hui2
2023-04
Source PublicationIEEE Transactions on Intelligent Vehicles
ISSN2379-8858
Volume9Issue:1Pages:481 - 491
Abstract

Dense semantic scene understanding of the surrounding environment in top-view is a crucial task for autonomous vehicles. Recent LiDAR-based semantic perception works mainly focus on point-wise predictions of the LiDAR points instead of dense predictions of the environment, making them not appropriate for path-planning tasks. Pillar and voxel representations can achieve dense predictions, but the generation of data representation and data processing are usually time-consuming. In this article, we propose a top-view semantic completion network to produce accurate dense grid-wise predictions with real-time performance. Specifically, we propose an online distillation strategy, consisting of two parts: a student model using 2D range-view and top-view representations, and a teacher model using range-view, top-view, and voxel representations. To realize information transfer between different representations, we propose a cross-view association (CVA) module, by which the range-view features and 3D voxel features are converted into the ones in the top-view. The proposed method can avoid the difficulty of direct dense semantic segmentation in the top-view, with the point-wise sparse semantic segmentation module acting as a guide for the dense grid-wise semantic completion in a semantic-completion way. It can also alleviate the computational complexity by using only the voxel representation and 3D convolution in the teacher model. The experimental results on the SemanticKITTI dataset (46.4% mIoU) and nuScenes-LidarSeg dataset (47.3% mIoU) demonstrate the effectiveness of the proposed sparse guidance and online distillation strategies.

KeywordComputational Modeling Convolution Dense Top-view Laser Radar Online Distillation Semantic Completion Semantic Segmentation Semantics Sparse Guidance Task Analysis Three-dimensional Displays
DOI10.1109/TIV.2023.3268241
URLView the original
Indexed BySCIE
WOS Research AreaComputer Science ; Engineering ; Transportation
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Transportation Science & Technology
WOS IDWOS:001173317800049
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85153484172
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
INSTITUTE OF COLLABORATIVE INNOVATION
Corresponding AuthorKong, Hui
Affiliation1.Department of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
2.State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau, Macau, China
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Gu, Shuo,Lu, Jiacheng,Yang, Jian,et al. Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation[J]. IEEE Transactions on Intelligent Vehicles, 2023, 9(1), 481 - 491.
APA Gu, Shuo., Lu, Jiacheng., Yang, Jian., Xu, Chengzhong., & Kong, Hui (2023). Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation. IEEE Transactions on Intelligent Vehicles, 9(1), 481 - 491.
MLA Gu, Shuo,et al."Dense Top-View Semantic Completion with Sparse Guidance and Online Distillation".IEEE Transactions on Intelligent Vehicles 9.1(2023):481 - 491.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Gu, Shuo]'s Articles
[Lu, Jiacheng]'s Articles
[Yang, Jian]'s Articles
Baidu academic
Similar articles in Baidu academic
[Gu, Shuo]'s Articles
[Lu, Jiacheng]'s Articles
[Yang, Jian]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Gu, Shuo]'s Articles
[Lu, Jiacheng]'s Articles
[Yang, Jian]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.