Residential College | false |
Status | 已發表Published |
Low-Light Video Enhancement with Synthetic Event Guidance | |
Liu, Lin1; An, Junfeng2; Liu, Jianzhuang4; Yuan, Shanxin3; Chen, Xiangyu6,8; Zhou, Wengang1; Li, Houqiang1; Wang, Yan Feng7; Tian, Qi5 | |
2023-06-27 | |
Conference Name | 37th AAAI Conference on Artificial Intelligence, AAAI 2023 |
Source Publication | Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023 |
Volume | 37 |
Pages | 1692-1700 |
Conference Date | 7 February 2023through 14 February 2023 |
Conference Place | Washington |
Publisher | AAAI Press |
Abstract | Low-light video enhancement (LLVE) is an important yet challenging task with many applications such as photographing and autonomous driving. Unlike single image low-light enhancement, most LLVE methods utilize temporal information from adjacent frames to restore the color and remove the noise of the target frame. However, these algorithms, based on the framework of multi-frame alignment and enhancement, may produce multi-frame fusion artifacts when encountering extreme low light or fast motion. In this paper, inspired by the low latency and high dynamic range of events, we use synthetic events from multiple frames to guide the enhancement and restoration of low-light videos. Our method contains three stages: 1) event synthesis and enhancement, 2) event and image fusion, and 3) low-light enhancement. In this framework, we design two novel modules (event-image fusion transform and event-guided dual branch) for the second and third stages, respectively. Extensive experiments show that our method outperforms existing low-light video or single image enhancement approaches on both synthetic and real LLVE datasets. Our code will be available at https://gitee.com/mindspore/models/tree/master/research/cv/LLVE-SEG. |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85167731618 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | University of Macau |
Affiliation | 1.CAS Key Laboratory of Technology in GIPAS, EEIS Department, University of Science and Technology of China, China 2.Independent Researcher, 3.Queen Mary University of London, United Kingdom 4.Huawei Noah’s Ark Lab, China 5.Huawei Cloud BU, 6.University of Macau, Macao 7.Cooperative medianet innovation center, Shanghai Jiao Tong University, China 8.Shenzhen Institute of Advanced Technology (SIAT), China |
Recommended Citation GB/T 7714 | Liu, Lin,An, Junfeng,Liu, Jianzhuang,et al. Low-Light Video Enhancement with Synthetic Event Guidance[C]:AAAI Press, 2023, 1692-1700. |
APA | Liu, Lin., An, Junfeng., Liu, Jianzhuang., Yuan, Shanxin., Chen, Xiangyu., Zhou, Wengang., Li, Houqiang., Wang, Yan Feng., & Tian, Qi (2023). Low-Light Video Enhancement with Synthetic Event Guidance. Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023, 37, 1692-1700. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment