Copertina

Who Taught You That? Tracing Teachers in Model Distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wadhwa, Somin, Shaib, Chantal, Amir, Silvio, Wallace, Byron C.
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Circuit Distillation
di: Wadhwa, Somin, et al.
Pubblicazione: (2025)

Investigating Mysteries of CoT-Augmented Distillation
di: Wadhwa, Somin, et al.
Pubblicazione: (2024)

Revisiting Relation Extraction in the era of Large Language Models
di: Wadhwa, Somin, et al.
Pubblicazione: (2023)

Measuring AI "Slop" in Text
di: Shaib, Chantal, et al.
Pubblicazione: (2025)

Detection and Measurement of Syntactic Templates in Generated Text
di: Shaib, Chantal, et al.
Pubblicazione: (2024)

How Much Annotation is Needed to Compare Summarization Models?
di: Shaib, Chantal, et al.
Pubblicazione: (2024)

Learning the Wrong Lessons: Syntactic-Domain Spurious Correlations in Language Models
di: Shaib, Chantal, et al.
Pubblicazione: (2025)

Learning from Natural Language Explanations for Generalizable Entity Matching
di: Wadhwa, Somin, et al.
Pubblicazione: (2024)

Faithfulness vs. Safety: Evaluating LLM Behavior Under Counterfactual Medical Evidence
di: Mo, Kaijie, et al.
Pubblicazione: (2026)

Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scores
di: Shaib, Chantal, et al.
Pubblicazione: (2024)

Distilling Event Sequence Knowledge From Large Language Models
di: Wadhwa, Somin, et al.
Pubblicazione: (2024)

Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting
di: Kambhatla, Gauri, et al.
Pubblicazione: (2025)

Elucidating Mechanisms of Demographic Bias in LLMs for Healthcare
di: Ahsan, Hiba, et al.
Pubblicazione: (2025)

On-the-fly Definition Augmentation of LLMs for Biomedical NER
di: Munnangi, Monica, et al.
Pubblicazione: (2024)

Retrieving Evidence from EHRs with LLMs: Possibilities and Challenges
di: Ahsan, Hiba, et al.
Pubblicazione: (2023)

Can SAEs reveal and mitigate racial biases of LLMs in healthcare?
di: Ahsan, Hiba, et al.
Pubblicazione: (2025)

Do Automatic Factuality Metrics Measure Factuality? A Critical Evaluation
di: Ramprasad, Sanjana, et al.
Pubblicazione: (2024)

Open (Clinical) LLMs are Sensitive to Instruction Phrasings
di: Arroyo, Alberto Mario Ceballos, et al.
Pubblicazione: (2024)

Self-Taught Evaluators
di: Wang, Tianlu, et al.
Pubblicazione: (2024)

Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both
di: Nath, Abhijnan, et al.
Pubblicazione: (2024)

Vector Arithmetic in Concept and Token Subspaces
di: Feucht, Sheridan, et al.
Pubblicazione: (2025)

Do Multi-Document Summarization Models Synthesize?
di: DeYoung, Jay, et al.
Pubblicazione: (2023)

Self-Taught Self-Correction for Small Language Models
di: Moskvoretskii, Viktor, et al.
Pubblicazione: (2025)

Leveraging ChatGPT in Pharmacovigilance Event Extraction: An Empirical Study
di: Sun, Zhaoyue, et al.
Pubblicazione: (2024)

Multilingual Self-Taught Faithfulness Evaluators
di: Alfano, Carlo, et al.
Pubblicazione: (2025)

Your Teacher Can't Help You Here: Combating Supervision Fidelity Decay in On-Policy Distillation
di: Liu, Yanjiang, et al.
Pubblicazione: (2026)

Can ChatGPT Read Who You Are?
di: Derner, Erik, et al.
Pubblicazione: (2023)

And Who Taught You Children's Literature?
di: Adamson, Lynda G.
Pubblicazione: (1985)

SAND: Boosting LLM Agents with Self-Taught Action Deliberation
di: Xia, Yu, et al.
Pubblicazione: (2025)

STaR-SQL: Self-Taught Reasoner for Text-to-SQL
di: He, Mingqian, et al.
Pubblicazione: (2025)

Self-Taught Agentic Long Context Understanding
di: Zhuang, Yufan, et al.
Pubblicazione: (2025)

Automatically Extracting Numerical Results from Randomized Controlled Trials with Large Language Models
di: Yun, Hye Sun, et al.
Pubblicazione: (2024)

SkillFactory: Self-Distillation For Learning Cognitive Behaviors
di: Sprague, Zayne, et al.
Pubblicazione: (2025)

SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models
di: Koo, Jahyun, et al.
Pubblicazione: (2024)

Compared to What? Baselines and Metrics for Counterfactual Prompting
di: Yang, Zihao, et al.
Pubblicazione: (2026)

Don't Pay Attention, PLANT It: Pretraining Attention via Learning-to-Rank
di: Roy, Debjyoti Saha, et al.
Pubblicazione: (2024)

The Dual-Route Model of Induction
di: Feucht, Sheridan, et al.
Pubblicazione: (2025)

Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights
di: Ballout, Mohamad, et al.
Pubblicazione: (2024)

On Teacher Hacking in Language Model Distillation
di: Tiapkin, Daniil, et al.
Pubblicazione: (2025)

Who Does This Name Remind You of ? Nationality Prediction via Large Language Model Associative Memory
di: Inoshita, Keito
Pubblicazione: (2026)