Optical Flow-based Temporal Video Analysis for Hand Hygiene Monitoring El Hijyeni Takibi için Optik Akiş Tabanli Zamansal Video Analizi

Kasim F., Budak A., Genc Y.

30th Signal Processing and Communications Applications Conference, SIU 2022, Safranbolu, Türkiye, 15 - 18 Mayıs 2022, (Tam Metin Bildiri) identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu55565.2022.9864927
  • Basıldığı Şehir: Safranbolu
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: Computer Vision, Convolution Neural Network (CNN), Long Short Term Memory (LSTM), Optical Flow
  • Kocaeli Üniversitesi Adresli: Hayır

Özet

© 2022 IEEE.Touching people or surfaces can increase spread of infectious diseases. Successful hand sanitization performed with correct sequences of hand movements as described by WHO is an important step in maintaining hygiene and decreasing contamination. In this work, deep learning models are trained with inputs enriched with optical flow vectors for the recognition of hand hygiene movements differing from prior approaches. Optical flow describes the apparent movement of pixels in the image. Optical flow vectors are used as extra channels alongside the original image additionally masking them with the hand region of interest or applying image preprocessing techniques. These multi-channel inputs are used to train three different deep learning models. Experimental results show that optical flow improves performance when used along with the original images. The best results are obtained when CNN models are trained on multi-frame images including the angle of optical flow.