UM
Residential Collegefalse
Status即將出版Forthcoming
Vision transformer based deep joint source-channel coding of images over MIMO channels
Wu Haotian1; SHAO YULIN2; Bian Chenghong1; Mikolajczyk Krystian1; Gunduz Deniz1
2024-07
Source PublicationIEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS
Abstract

We introduce a vision transformer (ViT)-based deep joint source and channel coding (DeepJSCC) scheme for wireless image transmission over multiple-input multiple-output (MIMO) channels, called DeepJSCC-MIMO. We employ DeepJSCC-MIMO in both open-loop and closed-loop MIMO systems. The novel DeepJSCC-MIMO architecture surpasses the classical separation-based benchmarks, while exhibiting robustness to channel estimation errors and flexibility in adapting to diverse channel conditions and antenna configurations without requiring retraining. Specifically, by harnessing the self-attention mechanism of the ViT, DeepJSCC-MIMO intelligently learns feature mapping and power allocation strategies tailored to the unique characteristics of the source image and prevailing channel conditions. Extensive numerical experiments validate the significant improvements in both distortion quality and perceptual quality achieved by DeepJSCC-MIMO for both open-loop and closed-loop MIMO systems across a wide range of scenarios. Moreover, DeepJSCC-MIMO exhibits robustness to varying channel conditions, channel estimation errors, and different antenna numbers, making it an appealing technology for emerging semantic communication systems.

Indexed BySCIE
Document TypeJournal article
CollectionUniversity of Macau
Corresponding AuthorSHAO YULIN
Affiliation1.Imperial College London
2.University of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Wu Haotian,SHAO YULIN,Bian Chenghong,et al. Vision transformer based deep joint source-channel coding of images over MIMO channels[J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024.
APA Wu Haotian., SHAO YULIN., Bian Chenghong., Mikolajczyk Krystian., & Gunduz Deniz (2024). Vision transformer based deep joint source-channel coding of images over MIMO channels. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS.
MLA Wu Haotian,et al."Vision transformer based deep joint source-channel coding of images over MIMO channels".IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2024).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wu Haotian]'s Articles
[SHAO YULIN]'s Articles
[Bian Chenghong]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wu Haotian]'s Articles
[SHAO YULIN]'s Articles
[Bian Chenghong]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wu Haotian]'s Articles
[SHAO YULIN]'s Articles
[Bian Chenghong]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.