Deep Learning-Based Pronunciation Detection of Arabic Phonemes

Calik S. S., KÜÇÜKMANİSA A., KİLİMCİ Z. H.

16th International Conference on INnovations in Intelligent SysTems and Applications, INISTA 2022, Biarritz, Fransa, 8 - 12 Ağustos 2022 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/inista55318.2022.9894215
  • Basıldığı Şehir: Biarritz
  • Basıldığı Ülke: Fransa
  • Anahtar Kelimeler: Arabic pronunciation detection, Computer aided language learning, ConvLSTM, deep learning, hybrid deep learning
  • Kocaeli Üniversitesi Adresli: Evet

Özet

© 2022 IEEE.Nowadays, detection of mispronunciations and providing feedback to users are provided by systems called computer-assisted language learning (CALL). In this study, we propose a model that detects the correct pronunciation of Arabic phonemes and supports Arabic language learning by blending it with deep and hybrid deep learning algorithms and mel-frequency cepstrum coefficients (MFCC) and Mel spectrogram feature extraction methods. In order to demonstrate the performance of the proposed model, 29 letters in the Arabic alphabet, 7 of which are hafiz, are voiced by a total of 10 different people. The amount of data has been increased by using the methods of adding noise, time shifting, time stretching, pitch shifting, and its performance on the model has been observed. Experiment results show that the combination of Mel-spectrogram and ConvLSTM exhibit the best results with 97.3% of accuracy when compared with the studies in the literature.