Spike-Based Attention Mechanisms for Enhanced Medical Image Segmentation
Received: 15 July 2025 | Revised: 8 August 2025 and 23 August 2025 | Accepted: 26 August 2025 | Online: 6 October 2025
Corresponding author: Meshari A. Al-Ebrahim
Abstract
The accurate segmentation of medical images is essential for reliable Computer-Aided Diagnosis (CAD) and treatment planning. Although deep learning has advanced the segmentation accuracy, challenges, such as modality variability, low contrast, and imaging artifacts, still exist. This study introduces a novel integration of a spike-based attention module into a DenseNet-169 backbone, combining biological spiking dynamics with deep convolutional feature representations to improve the focus on salient image features. The architecture utilizes ResNet blocks in the encoder for hierarchical feature extraction and applies spike-based attention at both the bottleneck and decoder stages to enhance the performance and computational efficiency. Experiments on two benchmark datasets demonstrate a 4.2% relative gain in Dice coefficient and a 3.9% increase in Intersection-over-Union compared to state-of-the-art baselines, while preserving the inference latency under 50 ms on standard GPU hardware. An extensive ablation study confirms that the dual placement of the attention module and the choice of DenseNet-169 maximize both the accuracy and efficiency. These results highlight the potential of spike-based attention for advancing real-time, high-fidelity medical image segmentation, with implications for improved clinical workflows and edge device deployment.
Keywords:
deep learning, image segmentation, medical image segmentation, spike-based attention mechanism, Convolutional Neural Networks (CNNs), Spiking Neural Networks (SNNs)Downloads
References
J. Bernal et al., "Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results from the MICCAI 2015 Endoscopic Vision Challenge," IEEE Transactions on Medical Imaging, vol. 36, no. 6, pp. 1231–1249, June 2017.
J. Yu, Z. Li, C. Xu, and B. Feng, "A Segmentation Algorithm of Colonoscopy Images Based on Multi-Scale Feature Fusion," Electronics, vol. 11, no. 16, Aug. 2022, Art. no. 2501.
P. Lakhani and B. Sundaram, "Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks," Radiology, vol. 284, no. 2, pp. 574–582, Aug. 2017.
J. Fu et al., "Dual Attention Network for Scene Segmentation," in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, June 2019, pp. 3141–3149.
P. Sun, J. Wu, M. Zhang, P. Devos, and D. Botteldooren, "Delay Learning Based on Temporal Coding in Spiking Neural Networks," Neural Networks, vol. 180, Dec. 2024, Art. no. 106678.
W. Li, J. Zhao, L. Su, N. Jiang, and Q. Hu, "Spiking Neural Networks for Object Detection Based on Integrating Neuronal Variants and Self-Attention Mechanisms," Applied Sciences, vol. 14, no. 20, Oct. 2024, Art. no. 9607.
G. Urban et al., "Deep Learning Localizes and Identifies Polyps in Real Time with 96% Accuracy in Screening Colonoscopy," Gastroenterology, vol. 155, no. 4, pp. 1069-1078.e8, Oct. 2018.
A. Esteva et al., "A Guide to Deep Learning in Healthcare," Nature Medicine, vol. 25, no. 1, pp. 24–29, Jan. 2019.
O. Ronneberger, P. Fischer, and T. Brox, "U-Net: Convolutional Networks for Biomedical Image Segmentation," in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, vol. 9351, N. Navab, J. Hornegger, W. M. Wells, and A. F. Frangi, Eds. Cham: Springer International Publishing, 2015, pp. 234–241.
Q. Xia et al., "A Comprehensive Review of Deep Learning for Medical Image Segmentation," Neurocomputing, vol. 613, Jan. 2025, Art. no. 128740.
Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, "UNet++: A Nested U-Net Architecture for Medical Image Segmentation," in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, vol. 11045, D. Stoyanov, Z. Taylor, G. Carneiro, T. Syeda-Mahmood, A. Martel, L. Maier-Hein, J. M. R. S. Tavares, A. Bradley, J. P. Papa, V. Belagiannis, J. C. Nascimento, Z. Lu, S. Conjeti, M. Moradi, H. Greenspan, and A. Madabhushi, Eds. Cham: Springer International Publishing, 2018, pp. 3–11.
O. Oktay et al., "Attention U-Net: Learning Where to Look for the Pancreas," in Medical Imaging with Deep Learning, MIDL 2018 Oral, 2018.
D. Dai et al., "I 2 U-Net: A Dual-path U-Net with Rich Information Interaction for Medical Image Segmentation," Medical Image Analysis, vol. 97, Oct. 2024, Art. no. 103241.
H. Zhao, J. Shi, X. Qi, X. Wang, and J. Jia, "Pyramid Scene Parsing Network," in 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, July 2017, pp. 6230–6239.
A. Haider, M. Arsalan, S. H. Nam, J. S. Hong, H. Sultan, and K. R. Park, "Multi-scale Feature Retention and Aggregation for Colorectal Cancer Diagnosis Using Gastrointestinal Images," Engineering Applications of Artificial Intelligence, vol. 125, Oct. 2023, Art. no. 106749.
G. Tetteh et al., "DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes," Frontiers in Neuroscience, vol. 14, Dec. 2020, Art. no. 592352.
A. Kotte and V. Kamakshi Prasad, "Hybrid 3D U-Net and Attention Mechanisms for Whole Heart Segmentation from CT Images," Engineering, Technology & Applied Science Research, vol. 15, no. 2, pp. 21822–21828, Apr. 2025.
Y. Gulzar and S. A. Khan, "Skin Lesion Segmentation Based on Vision Transformers and Convolutional Neural Networks—A Comparative Study," Applied Sciences, vol. 12, no. 12, June 2022, Art. no. 5990.
S. Pan, X. Liu, N. Xie, and Y. Chong, "EG-TransUNet: a Transformer-based U-Net with Enhanced and Guided Models for Biomedical Image Segmentation," BMC Bioinformatics, vol. 24, no. 1, Mar. 2023, Art. no. 85.
A. A. Demirbaş, H. Üzen, and H. Fırat, "Spatial-attention ConvMixer Architecture for Classification and Detection of Gastrointestinal Diseases Using the Kvasir Dataset," Health Information Science and Systems, vol. 12, no. 1, Apr. 2024, Art. no. 32.
S. Hamdi, M. Oussalah, A. Moussaoui, and M. Saidi, "Attention-based Hybrid CNN-LSTM and Spectral Data Augmentation for COVID-19 Diagnosis from Cough Sound," Journal of Intelligent Information Systems, vol. 59, no. 2, pp. 367–389, Oct. 2022.
J. Zhang et al., "Advances in Attention Mechanisms for Medical Image Segmentation," Computer Science Review, vol. 56, May 2025, Art. no. 100721.
S. Yan, B. Yang, A. Chen, X. Zhao, and S. Zhang, "Multi-scale Convolutional Attention Frequency-enhanced Transformer Network for Medical Image Segmentation," Information Fusion, vol. 119, July 2025, Art. no. 103019.
Y. Liu and J. Tian, "Probabilistic Attention Map: A Probabilistic Attention Mechanism for Convolutional Neural Networks," Sensors, vol. 24, no. 24, Dec. 2024, Art. no. 8187.
I. Pacal, O. Celik, B. Bayram, and A. Cunha, "Enhancing EfficientNetv2 with Global and Efficient Channel Attention Mechanisms for Accurate MRI-based Brain Tumor Classification," Cluster Computing, vol. 27, no. 8, pp. 11187–11212, Nov. 2024.
X. Li, H. Chen, X. Qi, Q. Dou, C.-W. Fu, and P.-A. Heng, "H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation from CT Volumes," IEEE Transactions on Medical Imaging, vol. 37, no. 12, pp. 2663–2674, Dec. 2018.
A. Tavanaei, M. Ghodrati, S. R. Kheradpisheh, T. Masquelier, and A. Maida, "Deep Learning in Spiking Neural Networks," Neural Networks, vol. 111, pp. 47–63, Mar. 2019.
Y. Yue et al., "Spiking Neural Networks Fine-tuning for Brain Image Segmentation," Frontiers in Neuroscience, vol. 17, Nov. 2023, Art. no. 1267639.
B. Yin, F. Corradi, and S. M. Bohté, "Accurate and Efficient Time-domain Classification with Adaptive Spiking Recurrent Neural Networks," Nature Machine Intelligence, vol. 3, no. 10, pp. 905–913, Oct. 2021.
M. E. Fouda, F. Kurdahi, A. Eltawil, and E. Neftci, "Spiking Neural Networks for Inference and Learning: A Memristor-based Design Perspective," in Memristive Devices for Brain-Inspired Computing, Elsevier, 2020, pp. 499–530.
D. Jha et al., "Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning," IEEE Access, vol. 9, pp. 40496–40510, 2021.
D.-P. Fan et al., "PraNet: Parallel Reverse Attention Network for Polyp Segmentation," in Medical Image Computing and Computer Assisted Intervention – 2020, vol. 12266, A. L. Martel, P. Abolmaesumi, D. Stoyanov, D. Mateus, M. A. Zuluaga, S. K. Zhou, D. Racoceanu, and L. Joskowicz, Eds. Cham: Springer International Publishing, 2020, pp. 263–273.
S. Safarov and T. K. Whangbo, "A-DenseUNet: Adaptive Densely Connected UNet for Polyp Segmentation in Colonoscopy Images with Atrous Convolution," Sensors, vol. 21, no. 4, Feb. 2021, Art. no. 1441.
B. Dong, W. Wang, D.-P. Fan, J. Li, H. Fu, and L. Shao, "Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers," CAAI Artificial Intelligence Research, Dec. 2023, Art. no. 9150015.
A. Srivastava et al., "MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation," IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 5, pp. 2252–2263, May 2022.
J. Irvin et al., "CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison," Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 590–597, July 2019.
J. Devasia, H. Goswami, S. Lakshminarayanan, M. Rajaram, and S. Adithan, "Deep Learning Classification of Active Tuberculosis Lung Zones Wise Manifestations Using Chest X-rays: A Multi Label Approach," Scientific Reports, vol. 13, no. 1, Jan. 2023, Art. no. 887.
S. Kazemzadeh et al., "Deep Learning Detection of Active Pulmonary Tuberculosis at Chest Radiography Matched the Clinical Performance of Radiologists," Radiology, vol. 306, no. 1, pp. 124–137, Jan. 2023.
Md. S. Alam et al., "Attention-based Multi-residual Network for Lung Segmentation in Diseased Lungs with Custom Data Augmentation," Scientific Reports, vol. 14, no. 1, Nov. 2024, Art. no. 28983.
M. Jannat et al., "Lung Segmentation with Lightweight Convolutional Attention Residual U-Net," Diagnostics, vol. 15, no. 7, Mar. 2025, Art. no. 854.
S. Din, M. Shoaib, and E. Serpedin, "CXR-Seg: A Novel Deep Learning Network for Lung Segmentation from Chest X-Ray Images," Bioengineering, vol. 12, no. 2, Feb. 2025, Art. no. 167.
C. Guo, M. Szemenyei, Y. Yi, W. Wang, B. Chen, and C. Fan, "SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation," in 2020 25th International Conference on Pattern Recognition, Milan, Italy, 2021, pp. 1236–1242.
X. Li et al., "Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds," International Journal of Network Dynamics and Intelligence, pp. 93–116, Mar. 2023.
Y. Zhang, H. Liu, and Q. Hu, "TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation," in Medical Image Computing and Computer Assisted Intervention – 2021, vol. 12901, M. De Bruijne, P. C. Cattin, S. Cotin, N. Padoy, S. Speidel, Y. Zheng, and C. Essert, Eds. Cham: Springer International Publishing, 2021, pp. 14–24.
J. Wang, L. Liu, H. Zhang, Y. Chen, and M. Zhao, "Multi-branch Attention-guided Network for Multi-label Thoracic Disease Classification in Chest X-rays," IEEE Transactions on Medical Imaging, vol. 42, pp. 1320–1331, 2023.
Z. Wang, Y. Fang, J. Cao, Q. Zhang, Z. Wang, and R. Xu, "Masked Spiking Transformer," in 2023 IEEE/CVF International Conference on Computer Vision, Paris, France, Oct. 2023, pp. 1761–1771.
Y. Wang, K. Shi, C. Lu, Y. Liu, M. Zhang, and H. Qu, "Spatial-Temporal Self-Attention for Asynchronous Spiking Neural Networks," in Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, Macau, SAR China, Aug. 2023, pp. 3085–3093.
X. Shi, Z. Hao, and Z. Yu, "SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks," in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, June 2024, pp. 5610–5619.
J. Chen et al., "TransUNet: Rethinking the U-Net architecture design for medical image segmentation through the lens of transformers," Medical Image Analysis, vol. 97, Oct. 2024, Art. no. 103280.
Y. Cai et al., "Swin Unet3D: A Three-dimensional Medical Image Segmentation Network Combining Vision Transformer and Convolution," BMC Medical Informatics and Decision Making, vol. 23, no. 1, Feb. 2023, Art. no. 33.
W. Maass, "Networks of Spiking Neurons: The Third Generation of Neural Network Models," Neural Networks, vol. 10, no. 9, pp. 1659–1671, Dec. 1997.
G. Litjens et al., "A Survey on Deep Learning in Medical Image Analysis," Medical Image Analysis, vol. 42, pp. 60–88, Dec. 2017.
F. Isensee, P. F. Jaeger, S. A. A. Kohl, J. Petersen, and K. H. Maier-Hein, "nnU-Net: A Self-configuring Method for Deep Learning-based Biomedical Image Segmentation," Nature Methods, vol. 18, no. 2, pp. 203–211, Feb. 2021.
E. Çallı, E. Sogancioglu, B. Van Ginneken, K. G. Van Leeuwen, and K. Murphy, "Deep Learning for Chest X-ray Analysis: A Survey," Medical Image Analysis, vol. 72, Aug. 2021, Art. no. 102125.
S. K. Zhou et al., "A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies with Progress Highlights, and Future Promises," Proceedings of the IEEE, vol. 109, no. 5, pp. 820–838, May 2021.
K. Zhang et al., "Early Gastric Cancer Detection and Lesion Segmentation Based on Deep Learning and Gastroscopic Images," Scientific Reports, vol. 14, no. 1, Apr. 2024, Art. no. 7847.
D. Li, H. Huo, S. Jiao, X. Sun, and S. Chen, "Automated Thorax Disease Diagnosis Using Multi-branch Residual Attention Network," Scientific Reports, vol. 14, no. 1, May 2024, Art. no. 11865.
D. Jha et al., "Kvasir-SEG: A Segmented Polyp Dataset," in MultiMedia Modeling, vol. 11962, Y. M. Ro, W.-H. Cheng, J. Kim, W.-T. Chu, P. Cui, J.-W. Choi, M.-C. Hu, and W. De Neve, Eds. Cham: Springer International Publishing, 2020, pp. 451–462.
S. Jaeger, S. Candemir, S. Antani, Y.-X. J. Wáng, P.-X. Lu, and G. Thoma, "Two Public Chest X-ray Datasets for Computer-aided Screening of Pulmonary Diseases," Quantitative Imaging in Medicine and Surgery, vol. 4, no. 6, pp. 475–477, 2014.
S. Poudel and S.-W. Lee, "Deep Multi-scale Attentional Features for Medical Image Segmentation," Applied Soft Computing, vol. 109, Sept. 2021, Art. no. 107445.
Z. Qiu, Z. Wang, M. Zhang, Z. Xu, J. Fan, and L. Xu, "BDG Net: Boundary Distribution Guided Network for Accurate Polyp Segmentation," in Medical Imaging 2022: Image Processing, San Diego, United States, Apr. 2022, Art. no. 105.
D. He, Y. Zhang, H. Huang, Y. Si, Z. Wang, and Y. Li, "Dual-branch Hybrid Network for Lesion Segmentation in Gastric Cancer Images," Scientific Reports, vol. 13, no. 1, Apr. 2023, Art. no. 6377.
Q. Chang, D. Ahmad, J. Toth, R. Bascom, and W. E. Higgins, "ESFPNet: efficient deep learning architecture for real-time lesion segmentation in autofluorescence bronchoscopic video," in Medical Imaging 2023: Biomedical Applications in Molecular, Structural, and Functional Imaging, San Diego, United States, Apr. 2023, Art. no. 1.
P. Fan, Y. Diao, F. Li, W. Zhao, and Z. Chen, "SRSegNet: Super-resolution-assisted Small Targets Polyp Segmentation Network with Combined High and Low Resolution," Journal of King Saud University - Computer and Information Sciences, vol. 36, no. 3, Mar. 2024, Art. no. 101981.
D. He et al., "Dual-guided network for endoscopic image segmentation with region and boundary cues," Biomedical Signal Processing and Control, vol. 91, May 2024, Art. no. 106059.
R. Karthikha, D. Najumnissa Jamal, and S. Syed Rafiammal, "An Approach of Polyp Segmentation from Colonoscopy Images Using Dilated-U-Net-Seg – A Deep Learning Network," Biomedical Signal Processing and Control, vol. 93, July 2024, Art. no. 106197.
A. Jafar, Z. U. Abidin, R. A. Naqvi, and S.-W. Lee, "Unmasking Colorectal Cancer: A High-performance Semantic Network for Polyp and Surgical Instrument Segmentation," Engineering Applications of Artificial Intelligence, vol. 138, Dec. 2024, Art. no. 109292.
M. Uçar, "Deep Neural Network Model with Bayesian Optimization for Tuberculosis Detection from X-ray Images," Multimedia Tools and Applications, vol. 82, no. 24, pp. 36951–36972, Oct. 2023.
D. N. Kumar and M. Kezia, "Fused Feature Vector and Dual FCM for Lung Segmentation from Chest X-Ray Images," International Journal of Intelligent Engineering and Systems, vol. 17, no. 2, pp. 464–476, Apr. 2024.
M. S. Khorasani and F. Babapour Mofrad, "The Effectiveness of FAT‐Net in Chest X‐ray Segmentation," The Journal of Engineering, vol. 2025, no. 1, Jan. 2025, Art. no. e70065.
Downloads
How to Cite
License
Copyright (c) 2025 Meshari A. Al-Ebrahim
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
