Video Captioning with Vision Transformer

초록

Video captioning not only needs sequence-to-sequence captioning model but also the convolutional Neutral Network (CNN) backbones to extract features such as appearance, motion, and object features. In this paper, we propose a full transformer video captioning model without several CNNs. Moreover, we compare our captioning model to other models that use several features.