Image de couverture de livre

Hypertokens: Holographic Associative Memory in Tokenized LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Augeri, Christopher James
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings
par: Deiseroth, Björn, et autres
Publié: (2024)

Phase-Associative Memory: Sequence Modeling in Complex Hilbert Space
par: Vishwakarma, Gowrav, et autres
Publié: (2026)

Learning to Route LLMs with Confidence Tokens
par: Chuang, Yu-Neng, et autres
Publié: (2024)

Do LLMs Encode Functional Importance of Reasoning Tokens?
par: Singh, Janvijay, et autres
Publié: (2026)

Memory Tokens: Large Language Models Can Generate Reversible Sentence Embeddings
par: Sastre, Ignacio, et autres
Publié: (2025)

Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
par: Yang, Zhihe, et autres
Publié: (2025)

RSQ: Learning from Important Tokens Leads to Better Quantized LLMs
par: Sung, Yi-Lin, et autres
Publié: (2025)

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
par: Wu, Wei, et autres
Publié: (2024)

SparsePO: Controlling Preference Alignment of LLMs via Sparse Token Masks
par: Christopoulou, Fenia, et autres
Publié: (2024)

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
par: Kallini, Julie, et autres
Publié: (2024)

Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks
par: Pink, Mathis, et autres
Publié: (2024)

Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs
par: Miyamoto, Sora, et autres
Publié: (2026)

LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings
par: Wang, Duo, et autres
Publié: (2024)

Sparse but Critical: A Token-Level Analysis of Distributional Shifts in RLVR Fine-Tuning of LLMs
par: Meng, Haoming, et autres
Publié: (2026)

SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs
par: Wang, Sijia, et autres
Publié: (2026)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
par: Arteaga, Gabriel Y., et autres
Publié: (2024)

Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction
par: Shi, Zhenmei, et autres
Publié: (2024)

TokenButler: Token Importance is Predictable
par: Akhauri, Yash, et autres
Publié: (2025)

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs
par: Kim, Taeho, et autres
Publié: (2024)

From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs
par: Rezazadeh, Alireza, et autres
Publié: (2024)

Language Diffusion Models are Associative Memories Capable of Retrieving Unseen Data
par: Pham, Bao, et autres
Publié: (2026)

AQUA: Attention via QUery mAgnitudes for Memory and Compute Efficient Inference in LLMs
par: S, Santhosh G, et autres
Publié: (2025)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
par: Xiao, Chaojun, et autres
Publié: (2024)

Lossless Token Sequence Compression via Meta-Tokens
par: Harvill, John, et autres
Publié: (2025)

Easy Problems That LLMs Get Wrong
par: Williams, Sean, et autres
Publié: (2024)

In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss
par: Kuratov, Yuri, et autres
Publié: (2024)

Adversarial Tokenization
par: Geh, Renato Lui, et autres
Publié: (2025)

From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs
par: Schiekiera, Louis, et autres
Publié: (2026)

Probabilistic Token Alignment for Large Language Model Fusion
par: Zeng, Runjia, et autres
Publié: (2025)

Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies
par: Ovalle, Anaelia, et autres
Publié: (2023)

OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference
par: Shin, Seungjun, et autres
Publié: (2025)

Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capability
par: Lin, Zicheng, et autres
Publié: (2024)

Multimodal Medical Code Tokenizer
par: Su, Xiaorui, et autres
Publié: (2025)

Soft Tokens, Hard Truths
par: Butt, Natasha, et autres
Publié: (2025)

Learning to Reason with Mixture of Tokens
par: Jain, Adit, et autres
Publié: (2025)

Cautious Next Token Prediction
par: Wang, Yizhou, et autres
Publié: (2025)

Revisiting Graph-Tokenizing Large Language Models: A Systematic Evaluation of Graph Token Understanding
par: Zhang, Zhongjian, et autres
Publié: (2026)

Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment
par: Pustejovsky, James, et autres
Publié: (2026)

Does Visual Rendering Bypass Tokenization? Investigating Script-Tokenizer Misalignment in Pixel-Based Language Models
par: Susanto, Lucky, et autres
Publié: (2026)

MarginSel : Max-Margin Demonstration Selection for LLMs
par: Ambati, Rajeev Bhatt, et autres
Publié: (2025)