Image de couverture de livre

LLM Modules: Knowledge Transfer from a Large to a Small Model using Enhanced Cross-Attention

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Kolomeitsev, Konstantin
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Machine Learning I.2.7; D.2.11
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Agent Capsules: Quality-Gated Granularity Control for Multi-Agent LLM Pipelines
par: Ray, Aninda
Publié: (2026)

Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications
par: Weber, Irene
Publié: (2024)

Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey
par: Huang, Yunpeng, et autres
Publié: (2023)

PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation
par: Wang, Yuchen, et autres
Publié: (2026)

Towards Resource-Efficient Multimodal Intelligence: Learned Routing among Specialized Expert Models
par: Saini, Mayank, et autres
Publié: (2025)

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews
par: Li, Bowen, et autres
Publié: (2026)

Post Hoc Extraction of Pareto Fronts for Continuous Control
par: Thakar, Raghav, et autres
Publié: (2026)

Seeing the Forest through the Trees: Data Leakage from Partial Transformer Gradients
par: Li, Weijun, et autres
Publié: (2024)

Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillation
par: Shafique, Muhammad Ali, et autres
Publié: (2025)

Automated MCQA Benchmarking at Scale: Evaluating Reasoning Traces as Retrieval Sources for Domain Adaptation of Small Language Models
par: Gokdemir, Ozan, et autres
Publié: (2025)

Contrastive Learning-Enhanced Large Language Models for Monolith-to-Microservice Decomposition
par: Sellami, Khaled, et autres
Publié: (2025)

A Simple Architecture for Enterprise Large Language Model Applications based on Role based security and Clearance Levels using Retrieval-Augmented Generation or Mixture of Experts
par: Özgür, Atilla, et autres
Publié: (2024)

Eliciting Problem Specifications via Large Language Models
par: Wray, Robert E., et autres
Publié: (2024)

STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts
par: Bamberger, Zachary, et autres
Publié: (2026)

A Scalable Communication Protocol for Networks of Large Language Models
par: Marro, Samuele, et autres
Publié: (2024)

Making a Pipeline Production-Ready: Challenges and Lessons Learned in the Healthcare Domain
par: Lawand, Daniel Angelo Esteves, et autres
Publié: (2025)

PRIMA: Operational Patterns for Resilient Multi-Agent Research with Verifiable Identity and Convergent Feedback
par: Annapureddy, Sasank
Publié: (2026)

Exploring Design of Multi-Agent LLM Dialogues for Research Ideation
par: Ueda, Keisuke, et autres
Publié: (2025)

DAGER: Exact Gradient Inversion for Large Language Models
par: Petrov, Ivo, et autres
Publié: (2024)

Latent Cache Flow: Model-to-Model Communication Without Text
par: Rossi, Maximillian, et autres
Publié: (2026)

SPIRA: Building an Intelligent System for Respiratory Insufficiency Detection
par: Ferreira, Renato Cordeiro, et autres
Publié: (2025)

Fuzzy, Symbolic, and Contextual: Enhancing LLM Instruction via Cognitive Scaffolding
par: Figueiredo, Vanessa
Publié: (2025)

Reinforcement Learning for Scalable and Trustworthy Intelligent Systems
par: Lan, Guangchen
Publié: (2026)

FediLoRA: Practical Federated Fine-Tuning of Foundation Models Under Missing-Modality Constraints
par: Yang, Lishan, et autres
Publié: (2025)

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents
par: Mazaheri, Parsa, et autres
Publié: (2026)

How Generation Architecture Shapes Code Complexity in Multi-Agent LLM Systems: A Paired Study on HumanEval
par: Ashrafi, Nazmus
Publié: (2026)

CRAwDAD: Causal Reasoning Augmentation with Dual-Agent Debate
par: Vamosi, Finn G., et autres
Publié: (2025)

MMiC: Mitigating Modality Incompleteness in Clustered Federated Learning
par: Yang, Lishan, et autres
Publié: (2025)

Performance Evaluation of Sentiment Analysis on Text and Emoji Data Using End-to-End, Transfer Learning, Distributed and Explainable AI Models
par: Velampalli, Sirisha, et autres
Publié: (2025)

SIGN: Schema-Induced Games for Naming
par: Zhang, Ryan, et autres
Publié: (2025)

A Multimodal GUI Architecture for Interfacing with LLM-Based Conversational Assistants
par: van Dam, Hans G. W.
Publié: (2025)

AutoBench: Automating LLM Evaluation through Reciprocal Peer Assessment
par: Loi, Dario, et autres
Publié: (2025)

Council Mode: A Heterogeneous Multi-Agent Consensus Framework for Reducing LLM Hallucination and Bias
par: Wu, Shuai, et autres
Publié: (2026)

Prompt Fencing: A Cryptographic Approach to Establishing Security Boundaries in Large Language Model Prompts
par: Peh, Steven
Publié: (2025)

Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications
par: Chauhan, Dikshit, et autres
Publié: (2025)

ART: Adaptive Response Tuning Framework -- A Multi-Agent Tournament-Based Approach to LLM Response Optimization
par: Khan, Omer Jauhar
Publié: (2025)

VIGOR+: Iterative Confounder Generation and Validation via LLM-CEVAE Feedback Loop
par: Zhu, JiaWei, et autres
Publié: (2025)

SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia
par: Saputra, Muhammad Apriandito Arya, et autres
Publié: (2026)

A Language for Describing Agentic LLM Contexts
par: Pelc, Noga Peleg, et autres
Publié: (2026)

Applying Cognitive Design Patterns to General LLM Agents
par: Wray, Robert E., et autres
Publié: (2025)