An Ensemble Deep Learning Approach for Breast Cancer Classification Using Vision Transformers and CNNs

Jose, Teny, Stynes, Paul, Pathak, Pramod and Sahni, Anu (2025) An Ensemble Deep Learning Approach for Breast Cancer Classification Using Vision Transformers and CNNs. In: 2025 5th International Conference on Electrical, Computer and Energy Technologies (ICECET). IEEE, Paris, France. ISBN 979-8-3315-3559-9

Full text not available from this repository.

Abstract

Breast cancer is still one of the most prevalent causes of cancer death globally, indicating that there is a critical need for early and precise diagnostic methods. While histopathological examination remains best method for breast cancer diagnosis, its accuracy and reliability depend significantly on the experience and subjective interpretations of pathologists. This research examined three state-of-the-art deep neural network architectures - Inception-v4, EfficientNet-B0, and Vision Trans former (ViT) - for the binary classification of breast histology images into benign and malignant categories. This research utilized the BreakHis dataset containing 7909 histopathological images as the training dataset, in addition, an external validation BACH dataset was used consisting of 400 images. Diagnostic performance on the external test set was further increased using a novel stacking ensemble method that combined predictions from individual models via Random Forest as a meta-classifier. The stacking ensemble method significantly outperformed individual models, achieving an accuracy of 96.0% and ROC-AUC of 0.99 on the external BACH dataset. Robustness analysis was also conducted to evaluate performance against common imaging artifacts, and visual interpretability was provided through Grad-CAM analyses, enhancing the clinical relevance of the models. The study also checked how the models performed when there were common image issues or distortions. Grad-CAM visualizations were used to see which areas in the image the models relied on for making predictions. In this work, CNNs were used to capture fine details from the images, while the Vision Transformer helped to recognize the overall structure. Bringing both models together improved the accuracy and made the results clearer for medical use.

Item Type:	Book Section
Uncontrolled Keywords:	BACH; BreakHis; breast cancer; CNN; histopathology; image classification; stacking ensemble; Vision Transformer
Subjects:	R Medicine > RB Pathology R Medicine > RC Internal medicine > RC0254 Neoplasms. Tumors. Oncology (including Cancer) Q Science > QH Natural history > QH301 Biology > Methods of research. Technique. Experimental biology > Data processing. Bioinformatics > Artificial intelligence > Computer vision Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Artificial intelligence > Computer vision Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Machine learning
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Tamara Malone
Date Deposited:	13 May 2026 10:23
Last Modified:	13 May 2026 10:23
URI:	https://norma.ncirl.ie/id/eprint/9302

Actions (login required)

View Item