Imagen de Portada

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ma, Jing, Xiang, Xiang, Wang, Ke, Wu, Yuchuan, Li, Yongbin
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
por: Li, Yuqi, et al.
Publicado: (2025)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
por: Xiang, Qianlong, et al.
Publicado: (2024)

Logit-Based Losses Limit the Effectiveness of Feature Knowledge Distillation
por: Cooper, Nicholas, et al.
Publicado: (2025)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
por: Xiang, Jinlin, et al.
Publicado: (2025)

Learning to Learn from APIs: Black-Box Data-Free Meta-Learning
por: Hu, Zixuan, et al.
Publicado: (2023)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
por: Wu, Wenyuan, et al.
Publicado: (2025)

Towards Black-Box Membership Inference Attack for Diffusion Models
por: Li, Jingwei, et al.
Publicado: (2024)

ADBA:Approximation Decision Boundary Approach for Black-Box Adversarial Attacks
por: Wang, Feiyang, et al.
Publicado: (2024)

Connecting the Dots: Collaborative Fine-tuning for Black-Box Vision-Language Models
por: Wang, Zhengbo, et al.
Publicado: (2024)

Align and Distill: Unifying and Improving Domain Adaptive Object Detection
por: Kay, Justin, et al.
Publicado: (2024)

Logit Scaling for Out-of-Distribution Detection
por: Djurisic, Andrija, et al.
Publicado: (2024)

Small Scale Data-Free Knowledge Distillation
por: Liu, He, et al.
Publicado: (2024)

Dynamic Temperature Knowledge Distillation
por: Wei, Yukang, et al.
Publicado: (2024)

Multi-Label Knowledge Distillation
por: Yang, Penghui, et al.
Publicado: (2023)

Generative Dataset Distillation Based on Self-knowledge Distillation
por: Li, Longzhen, et al.
Publicado: (2025)

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
por: Van Landeghem, Jordy, et al.
Publicado: (2024)

Prompting the Unseen: Detecting Hidden Backdoors in Black-Box Models
por: Huang, Zi-Xuan, et al.
Publicado: (2024)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
por: Mistretta, Marco, et al.
Publicado: (2024)

Incorporating Geo-Diverse Knowledge into Prompting for Increased Geographical Robustness in Object Recognition
por: Buettner, Kyle, et al.
Publicado: (2024)

The Role of Teacher Calibration in Knowledge Distillation
por: Kim, Suyoung, et al.
Publicado: (2025)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
por: Lv, Jiaming, et al.
Publicado: (2024)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
por: Adhane, Gereziher, et al.
Publicado: (2024)

What You See is What You Classify: Black Box Attributions
por: Stalder, Steven, et al.
Publicado: (2022)

ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
por: Chen, Junying, et al.
Publicado: (2025)

From Logits to Hierarchies: Hierarchical Clustering made Simple
por: Palumbo, Emanuele, et al.
Publicado: (2024)

Transition Matching Distillation for Fast Video Generation
por: Nie, Weili, et al.
Publicado: (2026)

Self-Supervised Quantization-Aware Knowledge Distillation
por: Zhao, Kaiqi, et al.
Publicado: (2024)

Hyperbolic Coarse-to-Fine Few-Shot Class-Incremental Learning
por: Dai, Jiaxin, et al.
Publicado: (2025)

Trust-Region Noise Search for Black-Box Alignment of Diffusion and Flow Models
por: Schweiger, Niklas, et al.
Publicado: (2026)

Box6D : Zero-shot Category-level 6D Pose Estimation of Warehouse Boxes
por: Ma, Yintao, et al.
Publicado: (2025)

GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMs
por: Basani, Advik Raj, et al.
Publicado: (2024)

VARestorer: One-Step VAR Distillation for Real-World Image Super-Resolution
por: Zhu, Yixuan, et al.
Publicado: (2026)

Simplex Clustering via sBeta with Applications to Online Adjustment of Black-Box Predictions
por: Chiaroni, Florent, et al.
Publicado: (2022)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
por: Parchami-Araghi, Amin, et al.
Publicado: (2024)

Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning
por: Zhou, Qinhao, et al.
Publicado: (2024)

Dual-Model Weight Selection and Self-Knowledge Distillation for Medical Image Classification
por: Tsutsumi, Ayaka, et al.
Publicado: (2025)

TriDeNT: Triple Deep Network Training for Privileged Knowledge Distillation in Histopathology
por: Farndale, Lucas, et al.
Publicado: (2023)

MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation
por: Fu, Yuxiang, et al.
Publicado: (2025)

VidModEx: Interpretable and Efficient Black Box Model Extraction for High-Dimensional Spaces
por: Kumar, Somnath Sendhil, et al.
Publicado: (2024)

Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
por: Zhou, Mingyuan, et al.
Publicado: (2024)