Document Image Classification with Vision Transformers

Sevim S., Omurca S. İ., Ekinci E.

1st International Congress of Electrical and Computer Engineering, ICECENG 2022, Bandirma, Türkiye, 9 - 12 Şubat 2022, cilt.436 LNICST, ss.68-81 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 436 LNICST
  • Doi Numarası: 10.1007/978-3-031-01984-5_6
  • Basıldığı Şehir: Bandirma
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.68-81
  • Anahtar Kelimeler: Deep learning, Document image classification, Transformers, Vision transformers
  • Kocaeli Üniversitesi Adresli: Evet

Özet

© 2022, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.Document image classification has received huge interest in business automation processes. Therefore, document image classification plays an important role in the document image processing (DIP) systems. And it is necessary to develop an effective framework for this task. Many methods have been proposed for the classification of document images in literature. In this paper we propose an efficient document image classification task that uses vision transformers (ViTs) and benefits from visual information of the document. Transformers are models developed for natural language processing tasks. Due to its high performances, their structures have been modified and they have started to be applied on different problems. ViT is one of these models. ViTs have demonstrated imposing performance in computer vision tasks compared with baselines. Since, scans the image and models the relation between the image patches using multi-head self-attention Experiments are conducted on a real-world dataset. Despite the limited size of training data available, our method achieves acceptable performance while performing document image classification.