Imagen de Portada

Layer-wise Representation Dynamics: An Empirical Investigation Across Embedders and Base LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jiang, Jingzhou, Yang, Yi, Tam, Kar Yan
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FLARE: Task-agnostic embedding model evaluation through a normalization process
por: Jiang, Jingzhou, et al.
Publicado: (2026)

Internal Chain-of-Thought: Empirical Evidence for Layer-wise Subtask Scheduling in LLMs
por: Yang, Zhipeng, et al.
Publicado: (2025)

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States
por: Duan, Hanyu, et al.
Publicado: (2024)

A Comparative analysis of Layer-wise Representational Capacity in AR and Diffusion LLMs
por: Goel, Raghavv, et al.
Publicado: (2026)

Mitigating Bias in RAG: Controlling the Embedder
por: Kim, Taeyoun, et al.
Publicado: (2025)

On the Effect of Uncertainty on Layer-wise Inference Dynamics
por: Kim, Sunwoo, et al.
Publicado: (2025)

Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition
por: Xu, Jingjing, et al.
Publicado: (2024)

Calibration Across Layers: Understanding Calibration Evolution in LLMs
por: Joshi, Abhinav, et al.
Publicado: (2025)

Iterative Layer-wise Distillation for Efficient Compression of Large Language Models
por: Kovalev, Grigory, et al.
Publicado: (2025)

Bridging the Dimensional Chasm: Uncover Layer-wise Dimensional Reduction in Transformers through Token Correlation
por: Song, Zhuo-Yang, et al.
Publicado: (2025)

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
por: Bae, Sangmin, et al.
Publicado: (2024)

Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate
por: Bochkov, A.
Publicado: (2025)

SpecBound: Adaptive Bounded Self-Speculation with Layer-wise Confidence Calibration
por: Wen, Zhuofan, et al.
Publicado: (2026)

Investigating Layer Importance in Large Language Models
por: Zhang, Yang, et al.
Publicado: (2024)

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
por: Zhu, Dawei, et al.
Publicado: (2023)

GRASS: Gradient-based Adaptive Layer-wise Importance Sampling for Memory-efficient Large Language Model Fine-tuning
por: Tian, Kaiyuan, et al.
Publicado: (2026)

Semantic Convergence: Investigating Shared Representations Across Scaled LLMs
por: Son, Daniel, et al.
Publicado: (2025)

CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought
por: Zhang, Boxuan, et al.
Publicado: (2025)

The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation
por: Pavlovic, Maja, et al.
Publicado: (2024)

Dr.LLM: Dynamic Layer Routing in LLMs
por: Heakl, Ahmed, et al.
Publicado: (2025)

Beyond Outliers: A Data-Free Layer-wise Mixed-Precision Quantization Approach Driven by Numerical and Structural Dual-Sensitivity
por: Zhang, Hengyuan, et al.
Publicado: (2026)

Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs
por: Lai, Xin, et al.
Publicado: (2024)

LayerBoost: Layer-Aware Attention Reduction for Efficient LLMs
por: Souibgui, Mohamed Ali, et al.
Publicado: (2026)

SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget
por: Wang, Zihao, et al.
Publicado: (2024)

LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
por: Kapadia, Shashank, et al.
Publicado: (2026)

DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies
por: Yang, Ning, et al.
Publicado: (2025)

Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models
por: Yao, Kai, et al.
Publicado: (2024)

An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning
por: Chen, Zui, et al.
Publicado: (2024)

DLO: Dynamic Layer Operation for Efficient Vertical Scaling of LLMs
por: Tan, Zhen, et al.
Publicado: (2024)

MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
por: Qin, Jiayu, et al.
Publicado: (2025)

Can Large Language Models Generalize Procedures Across Representations?
por: Lin, Fangru, et al.
Publicado: (2026)

Reliability Under Randomness: An Empirical Analysis of Sparse and Dense Language Models Across Decoding Temperatures
por: Grover, Kabir
Publicado: (2026)

Are LLMs Ready for Conflict Monitoring? Empirical Evidence from West Africa
por: Muki, Hoffmann, et al.
Publicado: (2026)

Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization
por: Song, Guanghui, et al.
Publicado: (2025)

ULMA: Unified Language Model Alignment with Human Demonstration and Point-wise Preference
por: Cai, Tianchi, et al.
Publicado: (2023)

DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning
por: Zarch, Hossein Entezari, et al.
Publicado: (2025)

DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding
por: Zarch, Hossein Entezari, et al.
Publicado: (2025)

Improving LLM Final Representations with Inter-Layer Geometry
por: Ulanovski, Tom, et al.
Publicado: (2026)

Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insights
por: Choi, Sooyung, et al.
Publicado: (2025)

TeleLoRA: Teleporting Model-Specific Alignment Across LLMs
por: Lin, Xiao, et al.
Publicado: (2025)