Residential College | false |
Status | 已發表Published |
Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization | |
Liang, Jingtang1; Cun, Xiaodong2; Pun, Chi Man1; Wang, Jue2 | |
2022 | |
Conference Name | Proceedings of the 17th European Conference on Computer Vision (ECCV) |
Source Publication | Proceedings of the 17th European Conference on Computer Vision (ECCV) |
Volume | 13667 |
Pages | 334-349 |
Conference Date | OCT 23-27, 2022 |
Conference Place | Tel Aviv, ISRAEL |
Abstract | Image harmonization aims to modify the color of the composited region according to the specific background. Previous works model this task as a pixel-wise image translation using UNet family structures. However, the model size and computational cost limit the ability of their models on edge devices and higher-resolution images. In this paper, we propose spatial-separated curve rendering network (S CRNet), a novel framework to prove that the simple global editing can effectively address this task as well as the challenge of high-resolution image harmonization for the first time. In S CRNet, we design a curve rendering module (CRM) using spatial-specific knowledge to generate the parameters of the piece-wise curve mapping in the foreground region and we can directly render the original high-resolution images using the learned color curve. Besides, we also make two extensions of the proposed framework via cascaded refinement and semantic guidance. Experiments show that the proposed method reduces more than 90% parameters compared with previous methods but still achieves the state-of-the-art performance on 3 benchmark datasets. Moreover, our method can work smoothly on higher resolution images with much lower GPU computational resources. The source codes are available at: http://github.com/stefanLeong/S2CRNet. |
DOI | 10.1007/978-3-031-20071-7_20 |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science ; Imaging Science & Photographic Technology |
WOS Subject | Computer Science, Artificial Intelligence ; Imaging Science & Photographic Technology |
WOS ID | WOS:000897035700020 |
Scopus ID | 2-s2.0-85142712020 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Pun, Chi Man |
Affiliation | 1.University of Macau, Macao 2.Tencent AI Lab, Shenzhen, China |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Liang, Jingtang,Cun, Xiaodong,Pun, Chi Man,et al. Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization[C], 2022, 334-349. |
APA | Liang, Jingtang., Cun, Xiaodong., Pun, Chi Man., & Wang, Jue (2022). Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization. Proceedings of the 17th European Conference on Computer Vision (ECCV), 13667, 334-349. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment