UM
Residential Collegefalse
Status已發表Published
UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network
Xina Liu1,2; Jinfan Hu1,2; Xiangyu Chen1,3,4; Chao Dong1,4
2023-02-18
Conference Name17th European Conference on Computer Vision, ECCV 2022
Source PublicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13805 LNCS
Pages113-129
Conference Date23 October 2022through 27 October 2022
Conference PlaceTel Aviv
CountryIsrael
Author of SourceLeonid Karlinsky ; Tomer Michaeli ; Ko Nishino
PublisherSpringer Science and Business Media Deutschland GmbH
Abstract

Under-Display Camera (UDC) has been widely exploited to help smartphones realize full-screen displays. However, as the screen could inevitably affect the light propagation process, the images captured by the UDC system usually contain flare, haze, blur, and noise. Particularly, flare and blur in UDC images could severely deteriorate the user experience in high dynamic range (HDR) scenes. In this paper, we propose a new deep model, namely UDC-UNet, to address the UDC image restoration problem with an estimated PSF in HDR scenes. Our network consists of three parts, including a U-shape base network to utilize multi-scale information, a condition branch to perform spatially variant modulation, and a kernel branch to leverage the prior knowledge of the PSF. According to the characteristics of HDR data, we additionally design a tone mapping loss to stabilize network optimization and achieve better visual quality. Experimental results show that the proposed UDC-UNet outperforms the state-of-the-art methods in quantitative and qualitative comparisons. Our approach won second place in the UDC image restoration track of the MIPI challenge. Codes and models are available at https://github.com/J-FHu/UDCUNet.

KeywordImage Restoration Under Display Camera
DOI10.1007/978-3-031-25072-9_8
URLView the original
Indexed BySCIE
Language英語English
Scopus ID2-s2.0-85150995638
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionUniversity of Macau
Corresponding AuthorChao Dong
Affiliation1.Shenzhen Key Lab of Computer Vision and Pattern Recognition,SIAT-SenseTime Joint Lab,Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,Beijing,China
2.University of Chinese Academy of Sciences,Beijing,China
3.University of Macau,Zhuhai,China
4.Shanghai AI Laboratory,Shanghai,China
Recommended Citation
GB/T 7714
Xina Liu,Jinfan Hu,Xiangyu Chen,et al. UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network[C]. Leonid Karlinsky, Tomer Michaeli, Ko Nishino:Springer Science and Business Media Deutschland GmbH, 2023, 113-129.
APA Xina Liu., Jinfan Hu., Xiangyu Chen., & Chao Dong (2023). UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13805 LNCS, 113-129.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Xina Liu]'s Articles
[Jinfan Hu]'s Articles
[Xiangyu Chen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Xina Liu]'s Articles
[Jinfan Hu]'s Articles
[Xiangyu Chen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Xina Liu]'s Articles
[Jinfan Hu]'s Articles
[Xiangyu Chen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.