Search: onr:"swepub:oai:DiVA.org:liu-199353" >
Gated Multi-Resolut...
Gated Multi-Resolution Transfer Network for Burst Restoration and Enhancement
-
- Mehta, Nancy (author)
- Indian Inst Technol Ropar, India
-
- Dudhane, Akshay (author)
- Mohamed Bin Zayed Univ AI, U Arab Emirates
-
- Murala, Subrahmanyam (author)
- Indian Inst Technol Ropar, India
-
show more...
-
- Zamir, Syed Waqas (author)
- Incept Inst AI, U Arab Emirates
-
- Khan, Salman (author)
- Mohamed Bin Zayed Univ AI, U Arab Emirates; Australian Natl Univ, Australia
-
- Khan, Fahad (author)
- Linköpings universitet,Datorseende,Tekniska fakulteten,Mohamed Bin Zayed Univ AI, U Arab Emirates
-
show less...
-
(creator_code:org_t)
- IEEE COMPUTER SOC, 2023
- 2023
- English.
-
In: 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR). - : IEEE COMPUTER SOC. - 9798350301298 - 9798350301304 ; , s. 22201-22210
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- Burst image processing is becoming increasingly popular in recent years. However, it is a challenging task since individual burst images undergo multiple degradations and often have mutual misalignments resulting in ghosting and zipper artifacts. Existing burst restoration methods usually do not consider the mutual correlation and non-local contextual information among burst frames, which tends to limit these approaches in challenging cases. Another key challenge lies in the robust up-sampling of burst frames. The existing up-sampling methods cannot effectively utilize the advantages of single-stage and progressive up-sampling strategies with conventional and/or recent up-samplers at the same time. To address these challenges, we propose a novel Gated Multi-Resolution Transfer Network (GMTNet) to reconstruct a spatially precise high-quality image from a burst of low-quality raw images. GMT-Net consists of three modules optimized for burst processing tasks: Multi-scale Burst Feature Alignment (MBFA) for feature denoising and alignment, Transposed-Attention Feature Merging (TAFM) for multi-frame feature aggregation, and Resolution Transfer Feature Up-sampler (RTFU) to up-scale merged features and construct a high-quality output image. Detailed experimental analysis on five datasets validate our approach and sets a state-of-the-art for burst super-resolution, burst denoising, and low-light burst enhancement. Our codes and models are available at https://github.com/nanmehta/GMTNet.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database