Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution

  • Yoo, Jinsu
  • Kim, Taehoon
  • Lee, Sihaeng
  • Kim, Seung Hwan
  • Lee, Honglak
  • ... Kim, Tae Hyun
Citations

WEB OF SCIENCE

83
Citations

SCOPUS

104

초록

Recent transformer-based super-resolution (SR) methods have achieved promising results against conventional CNN-based methods. However, these approaches suffer from essential shortsightedness created by only utilizing the standard self-attention-based reasoning. In this paper, we introduce an effective hybrid SR network to aggregate enriched features, including local features from CNNs and long-range multi-scale dependencies captured by transformers. Specifically, our network comprises transformer and convolutional branches, which synergetically complement each representation during the restoration procedure. Furthermore, we propose a cross-scale token attention module, allowing the transformer branch to exploit the informative relationships among tokens across different scales efficiently. Our proposed method achieves state-of-the-art SR results on numerous benchmark datasets.

키워드

Algorithms: Computational photographyimage and video synthesisLow-level and physics-based visionComputer visionOptical resolving powerColor photographyAggregation networkAlgorithm: computational photographyComputational photographyFeature aggregationImages synthesisLow-level and physic-based visionPhysics based visionSuperresolutionSuperresolution methodsVideo synthesis
제목
Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution
저자
Yoo, JinsuKim, TaehoonLee, SihaengKim, Seung HwanLee, HonglakKim, Tae Hyun
DOI
10.1109/WACV56688.2023.00493
발행일
2023-01
유형
Proceedings Paper
저널명
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV)
페이지
4945 ~ 4954