Residential College | false |
Status | 已發表Published |
UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network | |
Xina Liu1,2; Jinfan Hu1,2; Xiangyu Chen1,3,4; Chao Dong1,4 | |
2023-02-18 | |
Conference Name | 17th European Conference on Computer Vision, ECCV 2022 |
Source Publication | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Volume | 13805 LNCS |
Pages | 113-129 |
Conference Date | 23 October 2022through 27 October 2022 |
Conference Place | Tel Aviv |
Country | Israel |
Author of Source | Leonid Karlinsky ; Tomer Michaeli ; Ko Nishino |
Publisher | Springer Science and Business Media Deutschland GmbH |
Abstract | Under-Display Camera (UDC) has been widely exploited to help smartphones realize full-screen displays. However, as the screen could inevitably affect the light propagation process, the images captured by the UDC system usually contain flare, haze, blur, and noise. Particularly, flare and blur in UDC images could severely deteriorate the user experience in high dynamic range (HDR) scenes. In this paper, we propose a new deep model, namely UDC-UNet, to address the UDC image restoration problem with an estimated PSF in HDR scenes. Our network consists of three parts, including a U-shape base network to utilize multi-scale information, a condition branch to perform spatially variant modulation, and a kernel branch to leverage the prior knowledge of the PSF. According to the characteristics of HDR data, we additionally design a tone mapping loss to stabilize network optimization and achieve better visual quality. Experimental results show that the proposed UDC-UNet outperforms the state-of-the-art methods in quantitative and qualitative comparisons. Our approach won second place in the UDC image restoration track of the MIPI challenge. Codes and models are available at https://github.com/J-FHu/UDCUNet. |
Keyword | Image Restoration Under Display Camera |
DOI | 10.1007/978-3-031-25072-9_8 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
Scopus ID | 2-s2.0-85150995638 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | University of Macau |
Corresponding Author | Chao Dong |
Affiliation | 1.Shenzhen Key Lab of Computer Vision and Pattern Recognition,SIAT-SenseTime Joint Lab,Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,Beijing,China 2.University of Chinese Academy of Sciences,Beijing,China 3.University of Macau,Zhuhai,China 4.Shanghai AI Laboratory,Shanghai,China |
Recommended Citation GB/T 7714 | Xina Liu,Jinfan Hu,Xiangyu Chen,et al. UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network[C]. Leonid Karlinsky, Tomer Michaeli, Ko Nishino:Springer Science and Business Media Deutschland GmbH, 2023, 113-129. |
APA | Xina Liu., Jinfan Hu., Xiangyu Chen., & Chao Dong (2023). UDC-UNet: Under-Display Camera Image Restoration via U-shape Dynamic Network. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13805 LNCS, 113-129. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment