Imagen de Portada

Knowledge Distillation from Large Language Models for Household Energy Modeling

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Takrouri, Mohannad, Cuadrado, Nicolás M., Takáč, Martin
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Tractable Probabilistic Models for Investment Planning
por: A., Nicolas M. Cuadrado, et al.
Publicado: (2025)

A Survey on Symbolic Knowledge Distillation of Large Language Models
por: Acharya, Kamal, et al.
Publicado: (2024)

Delta Knowledge Distillation for Large Language Models
por: Cao, Yihan, et al.
Publicado: (2025)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
por: Yang, Junjie, et al.
Publicado: (2025)

Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions
por: Fang, Luyang, et al.
Publicado: (2025)

Enhancing BERT Fine-Tuning for Sentiment Analysis in Lower-Resourced Languages
por: Kubík, Jozef, et al.
Publicado: (2025)

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation
por: Zhao, Jiachen, et al.
Publicado: (2023)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Models
por: Zhao, Siyan, et al.
Publicado: (2026)

Language Model Knowledge Distillation for Efficient Question Answering in Spanish
por: Bazaga, Adrián, et al.
Publicado: (2023)

Demystifying Low-Rank Knowledge Distillation in Large Language Models: Convergence, Generalization, and Information-Theoretic Guarantees
por: Soarez, Alberlucia Rafael, et al.
Publicado: (2026)

A Dual-Space Framework for General Knowledge Distillation of Large Language Models
por: Zhang, Xue, et al.
Publicado: (2025)

A Survey of On-Policy Distillation for Large Language Models
por: Song, Mingyang, et al.
Publicado: (2026)

Adversarial Moment-Matching Distillation of Large Language Models
por: Jia, Chen
Publicado: (2024)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
por: Wagner, Nicolas, et al.
Publicado: (2024)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
por: Zhang, Songming, et al.
Publicado: (2026)

Cache & Distil: Optimising API Calls to Large Language Models
por: Ramírez, Guillem, et al.
Publicado: (2023)

Distilling Large Language Models for Text-Attributed Graph Learning
por: Pan, Bo, et al.
Publicado: (2024)

MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models
por: Zhang, Ying, et al.
Publicado: (2024)

Compact Language Models via Pruning and Knowledge Distillation
por: Muralidharan, Saurav, et al.
Publicado: (2024)

FRESCO: Federated Reinforcement Energy System for Cooperative Optimization
por: Cuadrado, Nicolas Mauricio, et al.
Publicado: (2024)

Iterative Layer-wise Distillation for Efficient Compression of Large Language Models
por: Kovalev, Grigory, et al.
Publicado: (2025)

Self-Data Distillation for Recovering Quality in Pruned Large Language Models
por: Thangarasa, Vithursan, et al.
Publicado: (2024)

SODA: Semi On-Policy Black-Box Distillation for Large Language Models
por: Chen, Xiwen, et al.
Publicado: (2026)

Structured Agent Distillation for Large Language Model
por: Liu, Jun, et al.
Publicado: (2025)

Large Language Models Explore by Latent Distilling
por: Zeng, Yuanhao, et al.
Publicado: (2026)

Neuron-Level Knowledge Attribution in Large Language Models
por: Yu, Zeping, et al.
Publicado: (2023)

metabench -- A Sparse Benchmark of Reasoning and Knowledge in Large Language Models
por: Kipnis, Alex, et al.
Publicado: (2024)

GeoLLM: Extracting Geospatial Knowledge from Large Language Models
por: Manvi, Rohin, et al.
Publicado: (2023)

UniDetox: Universal Detoxification of Large Language Models via Dataset Distillation
por: Lu, Huimin, et al.
Publicado: (2025)

Self-Calibrating Language Models via Test-Time Discriminative Distillation
por: Hedna, Mohamed Rissal, et al.
Publicado: (2026)

Testing Uncertainty of Large Language Models for Physics Knowledge and Reasoning
por: Reganova, Elizaveta, et al.
Publicado: (2024)

Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models
por: Chua, Lynn, et al.
Publicado: (2024)

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
por: Ruis, Laura, et al.
Publicado: (2024)

Large Language Models Lack Temporal Awareness of Medical Knowledge
por: Guan, Zihan, et al.
Publicado: (2026)

Reasoning-preserved Efficient Distillation of Large Language Models via Activation-aware Initialization
por: He, Junlin, et al.
Publicado: (2026)

Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework
por: Liu, Lingyuan, et al.
Publicado: (2025)

Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
por: Bhardwaj, Kartikeya, et al.
Publicado: (2024)

Energy Considerations of Large Language Model Inference and Efficiency Optimizations
por: Fernandez, Jared, et al.
Publicado: (2025)

A Fused Large Language Model for Predicting Startup Success
por: Maarouf, Abdurahman, et al.
Publicado: (2024)