Explainable depth-wise and channel-wise fusion models for multi-class skin lesion classification


ABUALKEBASH H., SALEH R. A. A., ERTUNÇ H. M.

PLOS ONE, cilt.21, sa.1 January, 2026 (SCI-Expanded, Scopus) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 21 Sayı: 1 January
  • Basım Tarihi: 2026
  • Doi Numarası: 10.1371/journal.pone.0340901
  • Dergi Adı: PLOS ONE
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, BIOSIS, Chemical Abstracts Core, EMBASE, Index Islamicus, Linguistic Bibliography, MEDLINE, Psycinfo, zbMATH, Directory of Open Access Journals
  • Kocaeli Üniversitesi Adresli: Evet

Özet

The clinical adoption of deep learning in dermatology requires models that are not only highly accurate but also transparent and trustworthy. To address this dual challenge, this study presents a systematic investigation into deep feature fusion, exploring how to effectively combine complementary representations from diverse neural network architectures. We design and rigorously evaluate six distinct fusion models, first investigating depth-wise and channel-wise strategies for integrating features from powerful Convolutional Neural Network (CNN) backbones, and subsequently incorporating the global contextual awareness of Vision Transformers (ViTs). Evaluated on the challenging 7-class HAM10000 dataset, our optimized architecture achieves a weighted average Precision, Recall, and F1 score of 90%, demonstrating superior diagnostic performance. Crucially, our comprehensive explainable AI (XAI) analysis using Grad-CAM and SHAP reveals that the fusion strategy directly dictates the model’s clinical interpretability; our most effective models learn to base their predictions on salient dermatological features, such as border irregularity and color variegation, in a manner that aligns with expert reasoning. This work provides a robust framework and valuable architectural insights for developing the next generation of high-performing, clinically reliable, and transparent AI-powered diagnostic tools.