UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
MASK-CNN-Transformer for real-time multi-label weather recognition
Chen, Shengchao1,2; Shu, Ting1; Zhao, Huan3; Tang, Yuan Yan4
2023-08-07
Source PublicationKnowledge-Based Systems
ISSN0950-7051
Volume278Pages:110881
Abstract

Weather recognition is an essential support for many practical life applications, including traffic safety, environment, and meteorology. However, many existing related works cannot comprehensively describe weather conditions due to their complex co-occurrence dependencies. This paper proposes a novel multi-label weather recognition model considering these dependencies. The proposed model called MASK-Convolutional Neural Network-Transformer (MASK-CT) is based on the Transformer, the convolutional process, and the MASK mechanism. The model employs multiple convolutional layers to extract features from weather images and a Transformer encoder to calculate the probability of each weather condition based on the extracted features. To improve the generalization ability of MASK-CT, a MASK mechanism is used during the training phase. The effect of the MASK mechanism is explored and discussed. The Mask mechanism randomly withholds some information from one-pair training instances (one image and its corresponding label). There are two types of MASK methods. Specifically, MASK-I is designed and deployed on the image before feeding it into the weather feature extractor and MASK-II is applied to the image label. The Transformer encoder is then utilized on the randomly masked image features and labels. The experimental results from various real-world weather recognition datasets demonstrate that the proposed MASK-CT model outperforms state-of-the-art methods. Furthermore, the high-speed dynamic real-time weather recognition capability of the MASK-CT is evaluated.

KeywordConvolutional Neural Network Deep Learning Multi-label Weather Recognition Transformer
DOI10.1016/j.knosys.2023.110881
URLView the original
Language英語English
Scopus ID2-s2.0-85168416007
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorShu, Ting
Affiliation1.Guangdong-Hongkong-Macao Greater Bay Area Weather Research Center for Monitoring Warning and Forecasting (Shenzhen Institute of Meteorological Innovation), Shenzhen, 518125, China
2.Australian Artificial Intelligence Institute, School of Computer Science, FEIT, University of Technology Sydney, Sydney, Ultimo, 2007, Australia
3.The Chinese University of Hong Kong, Shenzhen, 518172, China
4.Zhuhai UM Science and Technology Research Institute, Faculty of Science & Technology, University of Macau, 519000, China
Recommended Citation
GB/T 7714
Chen, Shengchao,Shu, Ting,Zhao, Huan,et al. MASK-CNN-Transformer for real-time multi-label weather recognition[J]. Knowledge-Based Systems, 2023, 278, 110881.
APA Chen, Shengchao., Shu, Ting., Zhao, Huan., & Tang, Yuan Yan (2023). MASK-CNN-Transformer for real-time multi-label weather recognition. Knowledge-Based Systems, 278, 110881.
MLA Chen, Shengchao,et al."MASK-CNN-Transformer for real-time multi-label weather recognition".Knowledge-Based Systems 278(2023):110881.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen, Shengchao]'s Articles
[Shu, Ting]'s Articles
[Zhao, Huan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen, Shengchao]'s Articles
[Shu, Ting]'s Articles
[Zhao, Huan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen, Shengchao]'s Articles
[Shu, Ting]'s Articles
[Zhao, Huan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.