Cover Image

Online In-Context Distillation for Low-Resource Vision Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kang, Zhiqi, Aljundi, Rahaf, Dorovatas, Vaggelis, Alahari, Karteek
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Ego: Embedding-Guided Personalization of Vision-Language Models
by: Seifi, Soroush, et al.
Published: (2026)

Recurrent Attention-based Token Selection for Efficient Streaming Video-LLMs
by: Dorovatas, Vaggelis, et al.
Published: (2025)

Personalization Toolkit: Training Free Personalization of Large Vision Language Models
by: Seifi, Soroush, et al.
Published: (2025)

Advancing Prompt-Based Methods for Replay-Independent General Continual Learning
by: Kang, Zhiqi, et al.
Published: (2025)

The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Models
by: Caldarella, Simone, et al.
Published: (2024)

Source-free Video Domain Adaptation by Learning from Noisy Labels
by: Dasgupta, Avijit, et al.
Published: (2023)

Annotation Free Semantic Segmentation with Vision Foundation Models
by: Seifi, Soroush, et al.
Published: (2024)

Exploring High-Order Self-Similarity for Video Understanding
by: Kim, Manjin, et al.
Published: (2026)

Efficient Few-Shot Continual Learning in Vision-Language Models
by: Panos, Aristeidis, et al.
Published: (2025)

Incremental Object-Based Novelty Detection with Feedback Loop
by: Caldarella, Simone, et al.
Published: (2023)

Imperfect Vision Encoders: Efficient and Robust Tuning for Vision-Language Models
by: Panos, Aristeidis, et al.
Published: (2024)

Unlocking Pre-trained Image Backbones for Semantic Image Synthesis
by: Berrada, Tariq, et al.
Published: (2023)

Overcoming Generic Knowledge Loss with Selective Parameter Update
by: Zhang, Wenxuan, et al.
Published: (2023)

SEM: Sparse Embedding Modulation for Post-Hoc Debiasing of Vision-Language Models
by: Guimard, Quentin, et al.
Published: (2026)

From CNNs to Shift-Invariant Twin Models Based on Complex Wavelets
by: Leterme, Hubert, et al.
Published: (2022)

Evaluating the Label Efficiency of Contrastive Self-Supervised Learning for Multi-Resolution Satellite Imagery
by: Bourcier, Jules, et al.
Published: (2022)

Entropy Rectifying Guidance for Diffusion and Flow Models
by: Ifriqi, Tariq Berrada, et al.
Published: (2025)

On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks
by: Leterme, Hubert, et al.
Published: (2022)

Lightweight Structure-Aware Attention for Visual Understanding
by: Kwon, Heeseung, et al.
Published: (2022)

Flowception: Temporally Expansive Flow Matching for Video Generation
by: Ifriqi, Tariq Berrada, et al.
Published: (2025)

Self-Supervised Pretraining on Satellite Imagery: a Case Study on Label-Efficient Vehicle Detection
by: BOURCIER, Jules, et al.
Published: (2022)

First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learning
by: Panos, Aristeidis, et al.
Published: (2023)

Memo: Training Memory-Efficient Embodied Agents with Reinforcement Learning
by: Gupta, Gunshi, et al.
Published: (2025)

Boosting Latent Diffusion with Perceptual Objectives
by: Berrada, Tariq, et al.
Published: (2024)

Evaluating the Impact of Post-Training Quantization on Reliable VQA with Multimodal LLMs
by: Kurz, Paul Jonas, et al.
Published: (2026)

Low-Resource Vision Challenges for Foundation Models
by: Zhang, Yunhua, et al.
Published: (2024)

Distilling Vision-Language Models on Millions of Videos
by: Zhao, Yue, et al.
Published: (2024)

Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages
by: Salmè, Marco, et al.
Published: (2025)

Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchu
by: Chung, Yan Hon Michael, et al.
Published: (2025)

Vision-Language Dataset Distillation
by: Wu, Xindi, et al.
Published: (2023)

Visual-Advantage On-Policy Distillation for Vision-Language Models
by: Liu, Ruiqi, et al.
Published: (2026)

PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation
by: Umam, Ardian, et al.
Published: (2023)

Lifelong Whole Slide Image Analysis: Online Vision-Language Adaptation and Past-to-Present Gradient Distillation
by: Bui, Doanh C., et al.
Published: (2025)

PromptKD: Unsupervised Prompt Distillation for Vision-Language Models
by: Li, Zheng, et al.
Published: (2024)

On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
by: Ifriqi, Tariq Berrada, et al.
Published: (2024)

Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models
by: Chen, Guo, et al.
Published: (2025)

Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
by: Zhang, Tiezheng, et al.
Published: (2025)

Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models
by: Hu, Yushi, et al.
Published: (2023)

Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap
by: Xu, Yige, et al.
Published: (2026)

From Local Details to Global Context: Advancing Vision-Language Models with Attention-Based Selection
by: Cai, Lincan, et al.
Published: (2025)