Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution

  • Yoo, Jinsu; 
  • Kim, Taehoon; 
  • Lee, Sihaeng; 
  • Kim, Seung Hwan; 
  • Lee, Honglak; 
  • ... Kim, Tae Hyun
Citations

WEB OF SCIENCE

91
Citations

SCOPUS

110

초록

Recent transformer-based super-resolution (SR) methods have achieved promising results against conventional CNN-based methods. However, these approaches suffer from essential shortsightedness created by only utilizing the standard self-attention-based reasoning. In this paper, we introduce an effective hybrid SR network to aggregate enriched features, including local features from CNNs and long-range multi-scale dependencies captured by transformers. Specifically, our network comprises transformer and convolutional branches, which synergetically complement each representation during the restoration procedure. Furthermore, we propose a cross-scale token attention module, allowing the transformer branch to exploit the informative relationships among tokens across different scales efficiently. Our proposed method achieves state-of-the-art SR results on numerous benchmark datasets.

키워드

Algorithms: Computational photography; image and video synthesis; Low-level and physics-based vision; Computer vision; Optical resolving power; Color photography; Aggregation network; Algorithm: computational photography; Computational photography; Feature aggregation; Images synthesis; Low-level and physic-based vision; Physics based vision; Superresolution; Superresolution methods; Video synthesis
제목
Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution
저자
Yoo, Jinsu; Kim, Taehoon; Lee, Sihaeng; Kim, Seung Hwan; Lee, Honglak; Kim, Tae Hyun
DOI
10.1109/WACV56688.2023.00493
발행일
2023-01
유형
Proceedings Paper
저널명
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV)
페이지
4945 ~ 4954