Image de couverture de livre

Transformer Layer Injection: A Novel Approach for Efficient Upscaling of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Vo, James
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SCALE: Upscaled Continual Learning of Large Language Models
par: Lee, Jin-woo, et autres
Publié: (2025)

Combining Entropy and Matrix Nuclear Norm for Enhanced Evaluation of Language Models
par: Vo, James
Publié: (2024)

Vi-Mistral-X: Building a Vietnamese Language Model with Advanced Continual Pre-training
par: Vo, James
Publié: (2024)

SparseAccelerate: Efficient Long-Context Inference for Mid-Range GPUs
par: Vo, James
Publié: (2024)

DIEKAE: Difference Injection for Efficient Knowledge Augmentation and Editing of Large Language Models
par: Galatolo, Alessio, et autres
Publié: (2024)

Efficient Second-Order Neural Network Optimization via Adaptive Trust Region Methods
par: Vo, James
Publié: (2024)

Layer-Condensed KV Cache for Efficient Inference of Large Language Models
par: Wu, Haoyi, et autres
Publié: (2024)

Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models
par: Fan, Yuchun, et autres
Publié: (2025)

Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models
par: Kang, Minki, et autres
Publié: (2024)

Structure-aware Domain Knowledge Injection for Large Language Models
par: Liu, Kai, et autres
Publié: (2024)

Contextual Compression Encoding for Large Language Models: A Novel Framework for Multi-Layered Parameter Space Pruning
par: Schmitt, Barnaby, et autres
Publié: (2025)

Iterative Layer-wise Distillation for Efficient Compression of Large Language Models
par: Kovalev, Grigory, et autres
Publié: (2025)

Latent Lexical Projection in Large Language Models: A Novel Approach to Implicit Representation Refinement
par: Shaker, Ziad, et autres
Publié: (2025)

Latent Convergence Modulation in Large Language Models: A Novel Approach to Iterative Contextual Realignment
par: Porretta, Patricia, et autres
Publié: (2025)

Contextual Morphogenesis in Large Language Models: A Novel Approach to Self-Organizing Token Representations
par: Dombrowski, Alistair, et autres
Publié: (2025)

Lexical Manifold Reconfiguration in Large Language Models: A Novel Architectural Approach for Contextual Modulation
par: Vassilis, Koinis, et autres
Publié: (2025)

Memory-based Language Models: An Efficient, Explainable, and Eco-friendly Approach to Large Language Modeling
par: Bosch, Antal van den, et autres
Publié: (2025)

Goal Hijacking Attack on Large Language Models via Pseudo-Conversation Injection
par: Chen, Zheng, et autres
Publié: (2024)

Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study
par: Hou, Guanyu, et autres
Publié: (2025)

E$^3$-Pruner: Towards Efficient, Economical, and Effective Layer Pruning for Large Language Models
par: Yuan, Tao, et autres
Publié: (2025)

Exploring Contextual Flux in Large Language Models: A Novel Approach to Self-Modulating Semantic Networks
par: Evidail, Henry, et autres
Publié: (2025)

Intrinsic Tensor Field Propagation in Large Language Models: A Novel Approach to Contextual Information Flow
par: Bexley, Alfred, et autres
Publié: (2025)

A Semantic-Aware Layer-Freezing Approach to Computation-Efficient Fine-Tuning of Language Models
par: Gu, Jian, et autres
Publié: (2024)

Intra-Layer Recurrence in Transformers for Language Modeling
par: Nguyen, Anthony, et autres
Publié: (2025)

Scaling Behavior of Machine Translation with Large Language Models under Prompt Injection Attacks
par: Sun, Zhifan, et autres
Publié: (2024)

Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Model
par: Ye, Qichen, et autres
Publié: (2023)

An Ensemble Classification Approach in A Multi-Layered Large Language Model Framework for Disease Prediction
par: Hamdi, Ali, et autres
Publié: (2025)

Vintern-1B: An Efficient Multimodal Large Language Model for Vietnamese
par: Doan, Khang T., et autres
Publié: (2024)

Large Language Models for Medical OSCE Assessment: A Novel Approach to Transcript Analysis
par: Shakur, Ameer Hamza, et autres
Publié: (2024)

A Novel Approach to Eliminating Hallucinations in Large Language Model-Assisted Causal Discovery
par: Sng, Grace, et autres
Publié: (2024)

Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models
par: Lian, Haoran, et autres
Publié: (2024)

Generation-Augmented Generation: A Plug-and-Play Framework for Private Knowledge Injection in Large Language Models
par: Li, Rongji, et autres
Publié: (2026)

GreenMind: A Next-Generation Vietnamese Large Language Model for Structured and Logical Reasoning
par: Tung, Luu Quy, et autres
Publié: (2025)

ARPA: A Novel Hybrid Model for Advancing Visual Word Disambiguation Using Large Language Models and Transformers
par: Papastavrou, Aristi, et autres
Publié: (2024)

Credal Transformer: A Principled Approach for Quantifying and Mitigating Hallucinations in Large Language Models
par: Ji, Shihao, et autres
Publié: (2025)

Systematic Knowledge Injection into Large Language Models via Diverse Augmentation for Domain-Specific RAG
par: Bhushan, Kushagra, et autres
Publié: (2025)

PromptDistill: Query-based Selective Token Retention in Intermediate Layers for Efficient Large Language Model Inference
par: Jin, Weisheng, et autres
Publié: (2025)

A Novel Psychometrics-Based Approach to Developing Professional Competency Benchmark for Large Language Models
par: Kardanova, Elena, et autres
Publié: (2024)

Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models
par: Ye, Haotian, et autres
Publié: (2025)

Bounded Hyperbolic Tangent: A Stable and Efficient Alternative to Pre-Layer Normalization in Large Language Models
par: Byun, Hoyoon, et autres
Publié: (2025)