Cover Image

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Junjie, Song, Junhao, Han, Xudong, Bi, Ziqian, Wang, Tianyang, Liang, Chia Xin, Song, Xinyuan, Zhang, Yichao, Niu, Qian, Peng, Benji, Chen, Keyu, Liu, Ming
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Noise to Nuance: Advances in Deep Generative Image Models
by: Peng, Benji, et al.
Published: (2024)

Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
by: Han, Xudong, et al.
Published: (2025)

AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveys
by: Wu, Siyi, et al.
Published: (2025)

Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attacks
by: Peng, Benji, et al.
Published: (2024)

CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization
by: Bi, Ziqian, et al.
Published: (2025)

Active Learning Methods for Efficient Data Utilization and Model Performance Enhancement
by: Tseng, Chiung-Yi, et al.
Published: (2025)

Jailbreaking and Mitigation of Vulnerabilities in Large Language Models
by: Peng, Benji, et al.
Published: (2024)

From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
by: Sun, Xintian, et al.
Published: (2024)

From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models
by: Zhang, Charles, et al.
Published: (2024)

Mixture of Experts in Large Language Models
by: Zhang, Danyang, et al.
Published: (2025)

Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques
by: Feng, Pohsun, et al.
Published: (2024)

Deep Learning and Machine Learning: Advancing Big Data Analytics and Management with Design Patterns
by: Chen, Keyu, et al.
Published: (2024)

Surveying the MLLM Landscape: A Meta-Review of Current Surveys
by: Li, Ming, et al.
Published: (2024)

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Object-Oriented Programming
by: Wang, Tianyang, et al.
Published: (2024)

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Tensorflow Pretrained Models
by: Chen, Keyu, et al.
Published: (2024)

Large Language Model Benchmarks in Medical Tasks
by: Yan, Lawrence K. Q., et al.
Published: (2024)

From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice
by: Niu, Qian, et al.
Published: (2024)

Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges
by: Niu, Qian, et al.
Published: (2024)

A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Tasks
by: Liang, Chia Xin, et al.
Published: (2024)

Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Models
by: Deng, Zechun, et al.
Published: (2025)

Multimodal Representation Learning and Fusion
by: Jin, Qihang, et al.
Published: (2025)

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Handy Appetizer
by: Peng, Benji, et al.
Published: (2024)

Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- Blockchain and Applications
by: Feng, Pohsun, et al.
Published: (2024)

Deep Learning, Machine Learning, Advancing Big Data Analytics and Management
by: Hsieh, Weiche, et al.
Published: (2024)

A Comprehensive Guide to Explainable AI: From Classical Models to LLMs
by: Hsieh, Weiche, et al.
Published: (2024)

Deep Learning Model Security: Threats and Defenses
by: Wang, Tianyang, et al.
Published: (2024)

Advanced Deep Learning Methods for Protein Structure Prediction and Design
by: Zhang, Yichao, et al.
Published: (2025)

FMCW Radar Principles and Human Activity Recognition Systems: Foundations, Techniques, and Applications
by: Bi, Ziqian, et al.
Published: (2024)

Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Unveiling AI's Potential Through Tools, Techniques, and Applications
by: Feng, Pohsun, et al.
Published: (2024)

Deep Learning and Machine Learning with GPGPU and CUDA: Unlocking the Power of Parallel Computing
by: Li, Ming, et al.
Published: (2024)

From Aleatoric to Epistemic: Exploring Uncertainty Quantification Techniques in Artificial Intelligence
by: Wang, Tianyang, et al.
Published: (2025)

From Bench to Bedside: A Review of Clinical Trials in Drug Discovery and Development
by: Wang, Tianyang, et al.
Published: (2024)

Generative Adversarial Networks Bridging Art and Machine Intelligence
by: Song, Junhao, et al.
Published: (2025)

Data Verification is the Future of Quantum Computing Copilots
by: Song, Junhao, et al.
Published: (2026)

From In Silico to In Vitro: A Comprehensive Guide to Validating Bioinformatics Findings
by: Wang, Tianyang, et al.
Published: (2025)

Deep Learning and Machine Learning -- Python Data Structures and Mathematics Fundamental: From Theory to Practice
by: Chen, Silin, et al.
Published: (2024)

Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
by: Bi, Ziqian, et al.
Published: (2025)

Is GPT-OSS All You Need? Benchmarking Large Language Models for Financial Intelligence and the Surprising Efficiency Paradox
by: Bi, Ziqian, et al.
Published: (2025)

Deep Learning, Machine Learning -- Digital Signal and Image Processing: From Theory to Application
by: Hsieh, Weiche, et al.
Published: (2024)

Deep Learning and Machine Learning -- Object Detection and Semantic Segmentation: From Theory to Applications
by: Ren, Jintao, et al.
Published: (2024)