Cover Image

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Grigore, Diana-Nicoleta, Georgescu, Mariana-Iuliana, Justo, Jon Alvarez, Johansen, Tor, Ionescu, Andreea Iuliana, Ionescu, Radu Tudor
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning Using Generated Privileged Information by Text-to-Image Diffusion Models
by: Menadil, Rafael-Edy, et al.
Published: (2023)

Semantic Segmentation in Satellite Hyperspectral Imagery by Deep Learning
by: Justo, Jon Alvarez, et al.
Published: (2023)

Audiovisual Masked Autoencoders
by: Georgescu, Mariana-Iuliana, et al.
Published: (2022)

SlotMatch: Distilling Object-Centric Representations for Unsupervised Video Segmentation
by: Grigore, Diana-Nicoleta, et al.
Published: (2025)

MTL-MAD: Multi-Task Learners are Effective Medical Anomaly Detectors
by: Bercean, Bogdan Alexandru, et al.
Published: (2026)

Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation
by: Hondru, Vlad, et al.
Published: (2023)

A Large-Scale Benchmark for Evaluating Large Language Models on Medical Question Answering in Romanian
by: Rogoz, Ana-Cristina, et al.
Published: (2025)

X-Aligner: Composed Visual Retrieval without the Bells and Whistles
by: Zheng, Yuqian, et al.
Published: (2026)

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets
by: Iordache, Adrian, et al.
Published: (2024)

Machine Unlearning in the Era of Quantum Machine Learning: An Empirical Study
by: Crivoi, Carla, et al.
Published: (2025)

Every Character Counts: From Vulnerability to Defense in Phishing Detection
by: Chiper, Maria, et al.
Published: (2025)

COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training
by: Kim, Sanghwan, et al.
Published: (2024)

Subspace-Boosted Model Merging
by: Skorobogat, Ronald, et al.
Published: (2025)

UnibucLLM: Harnessing LLMs for Automated Prediction of Item Difficulty and Response Time for Multiple-Choice Questions
by: Rogoz, Ana-Cristina, et al.
Published: (2024)

Cascaded Cross-Modal Transformer for Audio-Textual Classification
by: Ristea, Nicolae-Catalin, et al.
Published: (2024)

Moment matching based reduced closed-loop design to achieve asymptotic performance
by: Ionescu, Tudor C.
Published: (2024)

CLewR: Curriculum Learning with Restarts for Machine Translation Preference Learning
by: Dragomir, Alexandra, et al.
Published: (2026)

Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation
by: Carlesso, Hugo, et al.
Published: (2025)

A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference Corpus
by: Poesina, Eduard, et al.
Published: (2024)

Diffusion Models in Vision: A Survey
by: Croitoru, Florinel-Alin, et al.
Published: (2022)

EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
by: Hummel, Thomas, et al.
Published: (2024)

Q-Former Autoencoder: A Modern Framework for Medical Anomaly Detection
by: Dalmonte, Francesco, et al.
Published: (2025)

LaDe: Unified Multi-Layered Graphic Media Generation and Decomposition
by: Lungu-Stan, Vlad-Constantin, et al.
Published: (2026)

VQPP: Video Query Performance Prediction Benchmark
by: Lutu, Adrian Catalin, et al.
Published: (2026)

PRNU-Bench: A Novel Benchmark and Model for PRNU-Based Camera Identification
by: Croitoru, Florinel Alin, et al.
Published: (2025)

Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text
by: Jarca, Andrei, et al.
Published: (2025)

RoDia: A New Dataset for Romanian Dialect Identification from Speech
by: Rotaru, Codrut, et al.
Published: (2023)

CBM: Curriculum by Masking
by: Jarca, Andrei, et al.
Published: (2024)

Large Multimodal Models for Low-Resource Languages: A Survey
by: Lupascu, Marian, et al.
Published: (2025)

Families of moment matching based, structure preserving approximations for linear port Hamiltonian systems
by: Ionescu, Tudor C., et al.
Published: (2013)

Time-Domain Moment Matching for Second-Order Systems
by: Cheng, Xiaodong, et al.
Published: (2023)

New Species Of Tubixaba And Enchodelus (Nematoda: Dorylaimida) From Romania
by: Popovici, Iuliana
Published: (1995)

PPARevolution . First PPARδ Agonist and a Dual PPARα / PPARδ Activator Approved for the Treatment of Primary Biliary Cholangitis
by: Iuliana Popescu
Published: (2025)

PoPreRo: A New Dataset for Popularity Prediction of Romanian Reddit Posts
by: Rogoz, Ana-Cristina, et al.
Published: (2024)

ExDDV: A New Dataset for Explainable Deepfake Detection in Video
by: Hondru, Vlad, et al.
Published: (2025)

SegMate: Asymmetric Attention-Based Lightweight Architecture for Efficient Multi-Organ Segmentation
by: Bunea, Andrei-Alexandru, et al.
Published: (2026)

Rip Current Segmentation: A Novel Benchmark and YOLOv8 Baseline Results
by: Dumitriu, Andrei, et al.
Published: (2025)

FLAIR: VLM with Fine-grained Language-informed Image Representations
by: Xiao, Rui, et al.
Published: (2024)

Reverse Stable Diffusion: What prompt was used to generate this image?
by: Croitoru, Florinel-Alin, et al.
Published: (2023)

MOSLD-Bench: Multilingual Open-Set Learning and Discovery Benchmark for Text Categorization
by: Costache, Adriana-Valentina, et al.
Published: (2026)