Cover Image

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Jiachen, Zhao, Wenlong, Drozdov, Andrew, Rozonoyer, Benjamin, Sultan, Md Arafat, Lee, Jay-Yoon, Iyyer, Mohit, McCallum, Andrew
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Insertion Based Sequence Generation with Learnable Order Dynamics
by: Patel, Dhruvesh, et al.
Published: (2026)

Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval
by: Song, Jonghyun, et al.
Published: (2024)

XLM: A Python package for non-autoregressive language models
by: Patel, Dhruvesh, et al.
Published: (2025)

Interactive Topic Models with Optimal Transport
by: Dhanania, Garima, et al.
Published: (2024)

Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketching
by: Angell, Rico, et al.
Published: (2023)

An Empirical Investigation into the Effect of Parameter Choices in Knowledge Distillation
by: Sultan, Md Arafat, et al.
Published: (2024)

Autoregressive Ranking: Bridging the Gap Between Dual and Cross Encoders
by: Rozonoyer, Benjamin, et al.
Published: (2026)

Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
by: Rozonoyer, Benjamin, et al.
Published: (2026)

Machine Reading Comprehension using Case-based Reasoning
by: Thai, Dung, et al.
Published: (2023)

A proof of P!=NP
by: McCallum, Rupert
Published: (2020)

Maximize Resource Recovery Synergies for Infrastructure Projects
by: Conrad McCallum
Published: (2024)

Inconsistency of Reinhardt cardinals with $\mathsf{ZF}$
by: McCallum, Rupert
Published: (2026)

Extending MARC for Bibliographic Control in the Web Environment: Challenges and Alternatives.
by: McCallum, Sally
Published: (2000)

The On-Line ERIC Project at the National Library of Australia.
by: McCallum, Ian S.
Published: (1976)

Information Technology Standards: Implementation, Maintenance, and Coordination.
by: McCallum, Sally
Published: (1993)

Returning to Ithaca To Get On with the Mission: Defining Value in Terms of Our Contribution to our Customers and Our Profession.
by: McCallum, Ian
Published: (2002)

From Malin Head to Mizen Head: A Journey Around the Sea Area Forecast, JoannaDonnelly, Gill Books, 2023, Hardback £21‐99, 244 pp., ISBN 978‐0‐71‐719736‐1
by: Ewen McCallum
Published: (2024)

Parentesco, gênero e individuação no cotidiano da casa em um bairro popular de Salvador da Bahia
by: Cecilia McCallum
Published: (2012)

Users' and providers' perspectives on technological procedures for 'normal' childbirth in a public maternity hospital in Salvador, Brazil
by: Cecilia McCallum
Published: (2008)

O dilema de uma prática: experiências de aborto em uma maternidade pública de Salvador, Bahia
by: Cecilia McCallum
Published: (2016)

A Geometric Approach to Personalized Recommendation with Set-Theoretic Constraints Using Box Embeddings
by: Dasgupta, Shib, et al.
Published: (2025)

Comprehensive VLBI observations of Galileo satellites with the AuScope array
by: Schunck, David, et al.
Published: (2026)

An experiment to observe GNSS signals with the Australian VGOS array
by: McCallum, Lucia, et al.
Published: (2024)

Export processing zones: comparative data from China, Honduras, Nicaragua, and South Africa
by: Jamie K. McCallum
Published: (2011)

Le problème des "régions éprouvées" en Grande-Bretagne
by: E. D. McCallum
Published: (1934)

The problem of the depressed areas in Great Britain
by: E. D. McCallum
Published: (1934)

Serials for Information Services; Report on a Survey to Examine Current Subscriptions of the Major Libraries of the Midwestern Regional Library System to a Selected List of Indexed Serial Titles.
by: McCallum, John D.
Published: (1972)

Standards and Linked Online Information Systems.
by: McCallum, Sally H.
Published: (1990)

Harmonization of USMARC, CAN/MARC, and UKMARC.
by: McCallum, Sally H.
Published: (2000)

The Role of Standards in Networking.
by: McCallum, Sally H.
Published: (1980)

Literary Evidence Retrieval via Long-Context Language Models
by: Thai, Katherine, et al.
Published: (2025)

OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics
by: Dorna, Vineeth, et al.
Published: (2025)

Insertion Language Models: Sequence Generation with Arbitrary-Position Insertions
by: Patel, Dhruvesh, et al.
Published: (2025)

Efficient, Accurate and Stable Gradients for Neural ODEs
by: McCallum, Sam, et al.
Published: (2024)

Special Section: Format Integration.
by: McCallum, Sally H., et al.
Published: (1990)

Valuing Libraries
by: McCallum, Ian, et al.
Published: (2004)

Confidence-Weighted Token Set Cover for Early Hypothesis Pruning in Self-Consistency
by: Sultan, Md Arafat, et al.
Published: (2025)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

The impact of observation losses on IVS-R1/R4 VLBI sessions
by: McCarthy, Tiege, et al.
Published: (2025)

ML Researchers Support Openness in Peer Review But Are Concerned About Resubmission Bias
by: Rao, Vishisht, et al.
Published: (2025)