Imagen de Portada

ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Deekeswar, Harshavardhanan
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Token Distillation: Attention-aware Input Embeddings For New Tokens
por: Dobler, Konstantin, et al.
Publicado: (2025)

Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
por: Li, Shiwei, et al.
Publicado: (2025)

Not All Tokens Matter: Towards Efficient LLM Reasoning via Token Significance in Reinforcement Learning
por: Liu, Hanbing, et al.
Publicado: (2025)

Efficient LLM Inference using Dynamic Input Pruning and Cache-Aware Masking
por: Federici, Marco, et al.
Publicado: (2024)

Optimized Multi-Token Joint Decoding with Auxiliary Model for LLM Inference
por: Qin, Zongyue, et al.
Publicado: (2024)

IAPO: Information-Aware Policy Optimization for Token-Efficient Reasoning
por: He, Yinhan, et al.
Publicado: (2026)

DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies
por: Yang, Ning, et al.
Publicado: (2025)

Probe and Skip: Self-Predictive Token Skipping for Efficient Long-Context LLM Inference
por: Wu, Zimeng, et al.
Publicado: (2026)

OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference
por: Shin, Seungjun, et al.
Publicado: (2025)

LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
por: Fu, Qichen, et al.
Publicado: (2024)

LLM Prompt Duel Optimizer: Efficient Label-Free Prompt Optimization
por: Wu, Yuanchen, et al.
Publicado: (2025)

TIDE: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference
por: Jaber, Jaber, et al.
Publicado: (2026)

One Token to Fool LLM-as-a-Judge
por: Zhao, Yulai, et al.
Publicado: (2025)

Token Sparse Attention: Efficient Long-Context Inference with Interleaved Token Selection
por: Jo, Dongwon, et al.
Publicado: (2026)

Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing
por: Liu, Tianci, et al.
Publicado: (2025)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
por: Zhang, Yihua, et al.
Publicado: (2024)

From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Prediction
por: Zhu, Mingcheng, et al.
Publicado: (2026)

SENTRA: Selected-Next-Token Transformer for LLM Text Detection
por: Plyler, Mitchell, et al.
Publicado: (2025)

STS: Efficient Sparse Attention with Speculative Token Sparsity
por: Xu, Ceyu, et al.
Publicado: (2026)

Attention-Aware GNN-based Input Defense against Multi-Turn LLM Jailbreak
por: Huang, Zixuan, et al.
Publicado: (2025)

Implicit Optimization Bias of Next-Token Prediction in Linear Models
por: Thrampoulidis, Christos
Publicado: (2024)

Efficient Temporal Tokenization for Mobility Prediction with Large Language Models
por: He, Haoyu, et al.
Publicado: (2025)

Memory-Efficient Fine-Tuning of Transformers via Token Selection
por: Simoulin, Antoine, et al.
Publicado: (2025)

Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks
por: Li, Zongqian, et al.
Publicado: (2026)

ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
por: Zhong, Shuzhang, et al.
Publicado: (2024)

Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potential
por: Samragh, Mohammad, et al.
Publicado: (2025)

Hierarchical Token Prepending: Enhancing Information Flow in Decoder-based LLM Embeddings
por: Ding, Xueying, et al.
Publicado: (2025)

Token-Budget-Aware LLM Reasoning
por: Han, Tingxu, et al.
Publicado: (2024)

Efficient Training of Language Models with Compact and Consistent Next Token Distributions
por: Sathe, Ashutosh, et al.
Publicado: (2024)

Divergent Token Metrics: Measuring degradation to prune away LLM components -- and optimize quantization
por: Deiseroth, Björn, et al.
Publicado: (2023)

Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction
por: Shi, Zhenmei, et al.
Publicado: (2024)

Prior-Informed Zeroth-Order Optimization with Adaptive Direction Alignment for Memory-Efficient LLM Fine-Tuning
por: Jin, Feihu, et al.
Publicado: (2026)

Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capability
por: Lin, Zicheng, et al.
Publicado: (2024)

BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search
por: Sun, Linzhuang, et al.
Publicado: (2024)

LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversity
por: Tekin, Selim Furkan, et al.
Publicado: (2024)

TRIM: Token-wise Attention-Derived Saliency for Data-Efficient Instruction Tuning
por: Nagaraj, Manish, et al.
Publicado: (2025)

DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning
por: Zarch, Hossein Entezari, et al.
Publicado: (2025)

Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracing
por: Kim, JongWoo, et al.
Publicado: (2024)

LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction
por: Zhou, Enshuai, et al.
Publicado: (2026)

Token-Level LLM Collaboration via FusionRoute
por: Xiong, Nuoya, et al.
Publicado: (2026)