Saved in:
| Main Authors: | Firestone, Preston, Ugare, Shubham, Singh, Gagandeep, Misailovic, Sasa |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.05578 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Back to Bytes: Revisiting Tokenization Through UTF-8
by: Moryossef, Amit, et al.
Published: (2025)
by: Moryossef, Amit, et al.
Published: (2025)
DINGO: Constrained Inference for Diffusion LLMs
by: Suresh, Tarun, et al.
Published: (2025)
by: Suresh, Tarun, et al.
Published: (2025)
SynCode: LLM Generation with Grammar Augmentation
by: Ugare, Shubham, et al.
Published: (2024)
by: Ugare, Shubham, et al.
Published: (2024)
IterGen: Iterative Semantic-aware Structured LLM Generation with Backtracking
by: Ugare, Shubham, et al.
Published: (2024)
by: Ugare, Shubham, et al.
Published: (2024)
Enforcing Temporal Constraints for LLM Agents
by: Kamath, Adharsh, et al.
Published: (2025)
by: Kamath, Adharsh, et al.
Published: (2025)
CRANE: Reasoning with constrained LLM generation
by: Banerjee, Debangshu, et al.
Published: (2025)
by: Banerjee, Debangshu, et al.
Published: (2025)
Incremental Randomized Smoothing Certification
by: Ugare, Shubham, et al.
Published: (2023)
by: Ugare, Shubham, et al.
Published: (2023)
Is The Watermarking Of LLM-Generated Code Robust?
by: Suresh, Tarun, et al.
Published: (2024)
by: Suresh, Tarun, et al.
Published: (2024)
RefineStat: Efficient Exploration for Probabilistic Program Synthesis
by: Kanda, Madhav, et al.
Published: (2025)
by: Kanda, Madhav, et al.
Published: (2025)
ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs
by: Yang, Yuchen, et al.
Published: (2024)
by: Yang, Yuchen, et al.
Published: (2024)
Validating UTF-8 In Less Than One Instruction Per Byte
by: Keiser, John, et al.
Published: (2020)
by: Keiser, John, et al.
Published: (2020)
Fixing ill-formed UTF-16 strings with SIMD instructions
by: Clausecker, Robert, et al.
Published: (2026)
by: Clausecker, Robert, et al.
Published: (2026)
BBPE16: UTF-16-based byte-level byte-pair encoding for improved multilingual speech recognition
by: Kim, Hyunsik, et al.
Published: (2026)
by: Kim, Hyunsik, et al.
Published: (2026)
UTF:Undertrained Tokens as Fingerprints A Novel Approach to LLM Identification
by: Cai, Jiacheng, et al.
Published: (2024)
by: Cai, Jiacheng, et al.
Published: (2024)
Demo: ViolentUTF as An Accessible Platform for Generative AI Red Teaming
by: Nguyen, Tam n.
Published: (2025)
by: Nguyen, Tam n.
Published: (2025)
Agentic Code Reasoning
by: Ugare, Shubham, et al.
Published: (2026)
by: Ugare, Shubham, et al.
Published: (2026)
Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels
by: Zhao, Yifan, et al.
Published: (2026)
by: Zhao, Yifan, et al.
Published: (2026)
Certifying Knowledge Comprehension in LLMs
by: Chaudhary, Isha, et al.
Published: (2024)
by: Chaudhary, Isha, et al.
Published: (2024)
Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs
by: Zhao, Yifan, et al.
Published: (2025)
by: Zhao, Yifan, et al.
Published: (2025)
Cross-Tokenizer LLM Distillation through a Byte-Level Interface
by: Singh, Avyav Kumar, et al.
Published: (2026)
by: Singh, Avyav Kumar, et al.
Published: (2026)
Byte BPE Tokenization as an Inverse string Homomorphism
by: Geng, Saibo, et al.
Published: (2024)
by: Geng, Saibo, et al.
Published: (2024)
Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers
by: Jang, Eugene, et al.
Published: (2024)
by: Jang, Eugene, et al.
Published: (2024)
Decoupling the Benefits of Subword Tokenization for Language Model Training via Byte-level Simulation
by: Gigant, Théo, et al.
Published: (2026)
by: Gigant, Théo, et al.
Published: (2026)
Entropy-Driven Pre-Tokenization for Byte-Pair Encoding
by: Hu, Yifan, et al.
Published: (2025)
by: Hu, Yifan, et al.
Published: (2025)
Distilling Token-Trained Models into Byte-Level Models
by: Bao, Zishuo, et al.
Published: (2026)
by: Bao, Zishuo, et al.
Published: (2026)
Bypassing the Safety Training of Open-Source LLMs with Priming Attacks
by: Vega, Jason, et al.
Published: (2023)
by: Vega, Jason, et al.
Published: (2023)
ByteFlow: Language Modeling through Adaptive Byte Compression without a Tokenizer
by: Deng, Chunyuan, et al.
Published: (2026)
by: Deng, Chunyuan, et al.
Published: (2026)
Byte Latent Transformer: Patches Scale Better Than Tokens
by: Pagnoni, Artidoro, et al.
Published: (2024)
by: Pagnoni, Artidoro, et al.
Published: (2024)
MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
by: Kallini, Julie, et al.
Published: (2024)
by: Kallini, Julie, et al.
Published: (2024)
MambaByte: Token-free Selective State Space Model
by: Wang, Junxiong, et al.
Published: (2024)
by: Wang, Junxiong, et al.
Published: (2024)
Kathleen: Oscillator-Based Byte-Level Text Classification Without Tokenization or Attention
by: Fountzoulas, George
Published: (2026)
by: Fountzoulas, George
Published: (2026)
GPUTOK: GPU Accelerated Byte Level BPE Tokenization
by: Kadamba, Venu Gopal, et al.
Published: (2026)
by: Kadamba, Venu Gopal, et al.
Published: (2026)
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs
by: Singh, Aaditya K., et al.
Published: (2024)
by: Singh, Aaditya K., et al.
Published: (2024)
EduVidQA: Generating and Evaluating Long-form Answers to Student Questions based on Lecture Videos
by: Ray, Sourjyadip, et al.
Published: (2025)
by: Ray, Sourjyadip, et al.
Published: (2025)
ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling
by: Han, William, et al.
Published: (2024)
by: Han, William, et al.
Published: (2024)
KazByte: Adapting Qwen models to Kazakh via Byte-level Adapter
by: Akylzhanov, Rauan
Published: (2026)
by: Akylzhanov, Rauan
Published: (2026)
From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities
by: Zhang, Wanpeng, et al.
Published: (2024)
by: Zhang, Wanpeng, et al.
Published: (2024)
MARS: Enabling Autoregressive Models Multi-Token Generation
by: Jin, Ziqi, et al.
Published: (2026)
by: Jin, Ziqi, et al.
Published: (2026)
Do LLMs Encode Functional Importance of Reasoning Tokens?
by: Singh, Janvijay, et al.
Published: (2026)
by: Singh, Janvijay, et al.
Published: (2026)
MUTANT: A Recipe for Multilingual Tokenizer Design
by: Rana, Souvik, et al.
Published: (2025)
by: Rana, Souvik, et al.
Published: (2025)
Similar Items
-
Back to Bytes: Revisiting Tokenization Through UTF-8
by: Moryossef, Amit, et al.
Published: (2025) -
DINGO: Constrained Inference for Diffusion LLMs
by: Suresh, Tarun, et al.
Published: (2025) -
SynCode: LLM Generation with Grammar Augmentation
by: Ugare, Shubham, et al.
Published: (2024) -
IterGen: Iterative Semantic-aware Structured LLM Generation with Backtracking
by: Ugare, Shubham, et al.
Published: (2024) -
Enforcing Temporal Constraints for LLM Agents
by: Kamath, Adharsh, et al.
Published: (2025)