Imagen de Portada

VORT: Adaptive Power-Law Memory for NLP Transformers

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Mlaiki, Nabil
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning 68T50, 68T07, 26A33, 41A25, 60G22 I.2.7; I.2.6; G.1.2
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Unified Framework for Critical Scaling of Inverse Temperature in Self-Attention
por: Hayase, Tomohiro, et al.
Publicado: (2026)

Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guarantees
por: Zhou, Zhuoping, et al.
Publicado: (2026)

Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization
por: Li, Weizhao, et al.
Publicado: (2026)

When Does Content-Based Routing Work? Representation Requirements for Selective Attention in Hybrid Sequence Models
por: Basu, Abhinaba
Publicado: (2026)

NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution
por: Breneur, Oleksandr Marchenko, et al.
Publicado: (2026)

Rethinking the Multilingual Reasoning Gap with Layer Swap
por: Lasbordes, Maxence, et al.
Publicado: (2026)

Drift and selection in LLM text ecosystems
por: Riis, Søren
Publicado: (2026)

SAGE: Sign-Adaptive Gradient for Memory-Efficient LLM Optimization
por: Lee, Wooin, et al.
Publicado: (2026)

Harnessing non-adversarial robustness in large language models
por: Zhou, Qinghua, et al.
Publicado: (2026)

The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
por: Henry, James
Publicado: (2026)

CLMN: Concept based Language Models via Neural Symbolic Reasoning
por: Yang, Yibo
Publicado: (2025)

Measuring Alignment-Induced Activation Shifts Correctly: A Template-Controlled Difference-in-Differences Protocol
por: Nakamura, Yuki
Publicado: (2026)

Generative AI and the Transformation of Software Development Practices
por: Acharya, Vivek
Publicado: (2025)

Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
por: Alpay, Faruk, et al.
Publicado: (2026)

Causal Dimensionality of Transformer Representations: Measurement, Scaling, and Layer Structure
por: Sarkar, Nilesh, et al.
Publicado: (2026)

Graded Transformers
por: Shaska Sr, Tony
Publicado: (2025)

How Pruning Reshapes Features: Sparse Autoencoder Analysis of Weight-Pruned Language Models
por: Borobia, Hector, et al.
Publicado: (2026)

AIPsy-Affect: A Keyword-Free Clinical Stimulus Battery for Mechanistic Interpretability of Emotion in Language Models
por: Keeman, Michael
Publicado: (2026)

Product-of-Experts Training Reduces Dataset Artifacts in Natural Language Inference
por: Mathew, Aby Mammen
Publicado: (2026)

Alpay Algebra V: Multi-Layered Semantic Games and Transfinite Fixed-Point Simulation
por: Kilictas, Bugra, et al.
Publicado: (2025)

Alpay Algebra IV: Symbiotic Semantics and the Fixed-Point Convergence of Observer Embeddings
por: Kilictas, Bugra, et al.
Publicado: (2025)

Latent-Autoregressive GP-VAE Language Model
por: Ruffenach, Yves
Publicado: (2025)

Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
por: Mitchell, Rupert, et al.
Publicado: (2025)

DRO-InstructZero: Distributionally Robust Prompt Optimization for Large Language Models
por: Li, Yangyang
Publicado: (2025)

ProactBench: Beyond What The User Asked For
por: Harfi, Sepehr, et al.
Publicado: (2026)

Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
por: Imanov, Olaf Yunus Laitinen
Publicado: (2026)

Inference acceleration for large language models using "stairs" assisted greedy generation
por: Grigaliūnas, Domas, et al.
Publicado: (2024)

Strategic Doctrine Language Models (sdLM): A Learning-System Framework for Doctrinal Consistency and Geopolitical Forecasting
por: Imanov, Olaf Yunus Laitinen, et al.
Publicado: (2026)

Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibration
por: Lin, Shuhang, et al.
Publicado: (2026)

ProbeScale: Probing Analysis to Optimize Neural Scaling Laws for Efficient Small Language Model Inference
por: Das, Sourav
Publicado: (2026)

$δ$-STEAL: LLM Stealing Attack with Local Differential Privacy
por: Dang, Kieu, et al.
Publicado: (2025)

SafeAnchor: Preventing Cumulative Safety Erosion in Continual Domain Adaptation of Large Language Models
por: Guo, Dongxin, et al.
Publicado: (2026)

Unpacking Hateful Memes: Presupposed Context and False Claims
por: Cai, Weibin, et al.
Publicado: (2025)

Optimizing Large Language Models for OpenAPI Code Completion
por: Petryshyn, Bohdan, et al.
Publicado: (2024)

Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models
por: Sharma, Shubham, et al.
Publicado: (2025)

Extracting Sentence Embeddings from Pretrained Transformer Models
por: Stankevičius, Lukas, et al.
Publicado: (2024)

Vis-CoT: A Human-in-the-Loop Framework for Interactive Visualization and Intervention in LLM Chain-of-Thought Reasoning
por: Pather, Kaviraj, et al.
Publicado: (2025)

Compressive sensing inspired self-supervised single-pixel imaging
por: Lu, Jijun, et al.
Publicado: (2026)

The Trilemma of Truth in Large Language Models
por: Savcisens, Germans, et al.
Publicado: (2025)

Optimizing Retrieval-Augmented Generation (RAG) for Colloquial Cantonese: A LoRA-Based Systematic Review
por: Calonge, David Santandreu, et al.
Publicado: (2025)