Cover Image

Beyond Conventional Transformers: The Medical X-ray Attention (MXA) Block for Improved Multi-Label Diagnosis Using Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rand, Amit, Ibrahim, Hadi
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusion
by: Hua, Wei, et al.
Published: (2025)

GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosis
by: Liu, Bo, et al.
Published: (2024)

Beyond CLIP: Knowledge-Enhanced Multimodal Transformers for Cross-Modal Alignment in Diabetic Retinopathy Diagnosis
by: Samanta, Argha Kamal, et al.
Published: (2025)

Lagrange Duality and Compound Multi-Attention Transformer for Semi-Supervised Medical Image Segmentation
by: Zheng, Fuchen, et al.
Published: (2024)

MedPromptX: Grounded Multimodal Prompting for Chest X-ray Diagnosis
by: Shaaban, Mai A., et al.
Published: (2024)

Label-Augmented Dataset Distillation
by: Kang, Seoungyoon, et al.
Published: (2024)

DiaMond: Dementia Diagnosis with Multi-Modal Vision Transformers Using MRI and PET
by: Li, Yitong, et al.
Published: (2024)

Medical Slice Transformer: Improved Diagnosis and Explainability on 3D Medical Images with DINOv2
by: Müller-Franzes, Gustav, et al.
Published: (2024)

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
by: Miles, Roy, et al.
Published: (2024)

CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer
by: Li, Xinran, et al.
Published: (2025)

GRAD-Former: Gated Robust Attention-based Differential Transformer for Change Detection
by: Ameta, Durgesh, et al.
Published: (2026)

BLADE: Block-Sparse Attention Meets Step Distillation for Efficient Video Generation
by: Gu, Youping, et al.
Published: (2025)

Evaluating Visual Explanations of Attention Maps for Transformer-based Medical Imaging
by: Chung, Minjae, et al.
Published: (2025)

DCMM-Transformer: Degree-Corrected Mixed-Membership Attention for Medical Imaging
by: Cheng, Huimin, et al.
Published: (2025)

Multi-Label Continual Learning for the Medical Domain: A Novel Benchmark
by: Ceccon, Marina, et al.
Published: (2024)

Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-Distillation
by: Yan, Xu, et al.
Published: (2026)

Interpreting Radiologist's Intention from Eye Movements in Chest X-ray Diagnosis
by: Pham, Trong-Thang, et al.
Published: (2025)

Towards Optimal Trade-offs in Knowledge Distillation for CNNs and Vision Transformers at the Edge
by: Violos, John, et al.
Published: (2024)

Comparing Deep Neural Network for Multi-Label ECG Diagnosis From Scanned ECG
by: Nguyen, Cuong V., et al.
Published: (2025)

CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs
by: Kim, Jiwan, et al.
Published: (2025)

Early Exit and Multi Stage Knowledge Distillation in VLMs for Video Summarization
by: Khan, Anas Anwarul Haq, et al.
Published: (2025)

Hybrid Explanation-Guided Learning for Transformer-Based Chest X-Ray Diagnosis
by: Shu, Shelley Zixin, et al.
Published: (2025)

MMDS: A Multimodal Medical Diagnosis System Integrating Image Analysis and Knowledge-based Departmental Consultation
by: Ren, Yi, et al.
Published: (2024)

Adaptive Explicit Knowledge Transfer for Knowledge Distillation
by: Park, Hyungkeun, et al.
Published: (2024)

Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Loss
by: Gupta, Yatharth, et al.
Published: (2024)

Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis
by: Zhai, Xinyang, et al.
Published: (2026)

PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosis
by: Xu, Jiao, et al.
Published: (2026)

How Does Pruning Impact Long-Tailed Multi-Label Medical Image Classifiers?
by: Holste, Gregory, et al.
Published: (2023)

Iterative Refinement Strategy for Automated Data Labeling: Facial Landmark Diagnosis in Medical Imaging
by: Chen, Yu-Hsi
Published: (2024)

Preventing Shortcut Learning in Medical Image Analysis through Intermediate Layer Knowledge Distillation from Specialist Teachers
by: Boland, Christopher, et al.
Published: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

EVOKE: Elevating Chest X-ray Report Generation via Multi-View Contrastive Learning and Patient-Specific Knowledge
by: Miao, Qiguang, et al.
Published: (2024)

PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
by: Ranzinger, Mike, et al.
Published: (2024)

Improving Multi-Label Contrastive Learning by Leveraging Label Distribution
by: Chen, Ning, et al.
Published: (2025)

Explainable Knowledge Distillation for Efficient Medical Image Classification
by: Mir, Aqib Nazir, et al.
Published: (2025)

Efficient Knowledge Distillation of SAM for Medical Image Segmentation
by: Patil, Kunal Dasharath, et al.
Published: (2025)

Improving Weakly-Supervised Object Localization Using Adversarial Erasing and Pseudo Label
by: Kang, Byeongkeun, et al.
Published: (2024)

Effective Attention-Guided Multi-Scale Medical Network for Skin Lesion Segmentation
by: Wang, Siyu, et al.
Published: (2025)

Chest X-ray Classification using Deep Convolution Models on Low-resolution images with Uncertain Labels
by: Agarwal, Snigdha, et al.
Published: (2025)