Cover Image

Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Grashei, Christian, Brechenmacher, Christian, Umer, Rao Muhammad, Liu, Jingsong, Marr, Carsten, Szczurek, Ewa, Schüffler, Peter J.
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC
by: Liu, Jingsong, et al.
Published: (2025)

CytoDiff: AI-Driven Cytomorphology Image Synthesis for Medical Diagnostics
by: Boada, Jan Carreras, et al.
Published: (2025)

Efficient Special Stain Classification
by: Thaeter, Oskar, et al.
Published: (2026)

Genetically Aligned Patient Representations Improve Hematological Diagnosis
by: Dasdelen, Muhammed Furkan, et al.
Published: (2026)

From Linear Probing to Joint-Weighted Token Hierarchy: A Foundation Model Bridging Global and Cellular Representations in Biomarker Detection
by: Liu, Jingsong, et al.
Published: (2025)

Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognition
by: Aslam, Muhammad Haseeb, et al.
Published: (2024)

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
by: Khan, Hikmat, et al.
Published: (2026)

Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
by: Ma, Jiabo, et al.
Published: (2024)

Dino-NestedUNet: Unlocking Foundation Vision Encoders for Pathology Tumor Bulk Segmentation via Dense Decoding
by: Wang, Tianyang, et al.
Published: (2026)

DinoBloom: A Foundation Model for Generalizable Cell Embeddings in Hematology
by: Koch, Valentin, et al.
Published: (2024)

Dataset Distillation with Probabilistic Latent Features
by: Li, Zhe, et al.
Published: (2025)

Improving Adversarial Robustness Through Adaptive Learning-Driven Multi-Teacher Knowledge Distillation
by: Ullah, Hayat, et al.
Published: (2025)

Unlocking the Potential of Digital Pathology: Novel Baselines for Compression
by: Fischer, Maximilian, et al.
Published: (2024)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
by: Parchami-Araghi, Amin, et al.
Published: (2024)

Attention Pooling Enhances NCA-based Classification of Microscopy Images
by: Yang, Chen, et al.
Published: (2025)

Compressing Multi-Task Model for Autonomous Driving via Pruning and Knowledge Distillation
by: Wang, Jiayuan, et al.
Published: (2025)

Factor Analysis with Correlated Topic Model for Multi-Modal Data
by: Łazęcka, Małgorzata, et al.
Published: (2025)

Momentum Memory for Knowledge Distillation in Computational Pathology
by: Guo, Yongxin, et al.
Published: (2026)

Deep Learning-Based Fixation Type Prediction for Quality Assurance in Digital Pathology
by: Thaeter, Oskar, et al.
Published: (2026)

Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition
by: Yang, Chuanguang, et al.
Published: (2025)

G2L:From Giga-Scale to Cancer-Specific Large-Scale Pathology Foundation Models via Knowledge Distillation
by: Cho, Yesung, et al.
Published: (2025)

Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization
by: Mazouz, Alaa, et al.
Published: (2025)

Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation
by: Liang, Renjie, et al.
Published: (2023)

Leveraging Foundation Models via Knowledge Distillation in Multi-Object Tracking: Distilling DINOv2 Features to FairMOT
by: Faber, Niels G., et al.
Published: (2024)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
by: Shen, Chaomin, et al.
Published: (2024)

MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution
by: Jiang, Yuxuan, et al.
Published: (2024)

CytoSAE: Interpretable Cell Embeddings for Hematology
by: Dasdelen, Muhammed Furkan, et al.
Published: (2025)

UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation
by: Yang, Runzhao, et al.
Published: (2024)

Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
by: Płotka, Szymon, et al.
Published: (2025)

A Multicenter Benchmark of Multiple Instance Learning Models for Lymphoma Subtyping from HE-stained Whole Slide Images
by: Umer, Rao Muhammad, et al.
Published: (2025)

Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
by: Zhang, Jianhua, et al.
Published: (2024)

Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach
by: Khan, Muhammad Saif Ullah, et al.
Published: (2024)

Topological Inductive Bias fosters Multiple Instance Learning in Data-Scarce Scenarios
by: Kazeminia, Salome, et al.
Published: (2023)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Contrast & Compress: Learning Lightweight Embeddings for Short Trajectories
by: Vivekanandan, Abhishek, et al.
Published: (2025)

Distilling Balanced Knowledge from a Biased Teacher
by: Kim, Seonghak
Published: (2025)

Enriching Knowledge Distillation with Cross-Modal Teacher Fusion
by: Mansourian, Amir M., et al.
Published: (2025)

Dynamic Guidance Adversarial Distillation with Enhanced Teacher Knowledge
by: Park, Hyejin, et al.
Published: (2024)

Feature Re-Embedding: Towards Foundation Model-Level Performance in Computational Pathology
by: Tang, Wenhao, et al.
Published: (2024)