Cover Image

Test-Time Steering for Lossless Text Compression via Weighted Product of Experts

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Qihang, Li, Muchen, Wang, Ziao, Liao, Renjie, Wang, Lele
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compression
by: Zhang, Junxuan, et al.
Published: (2024)

Seq2Seq2Seq: Lossless Data Compression via Discrete Latent Transformers and Reinforcement Learning
by: Khodabandeh, Mahdi, et al.
Published: (2026)

AlphaZip: Neural Network-Enhanced Lossless Text Compression
by: Narashiman, Swathi Shree, et al.
Published: (2024)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
by: Shani, Chen, et al.
Published: (2025)

Astro-NER -- Astronomy Named Entity Recognition: Is GPT a Good Domain Expert Annotator?
by: Evans, Julia, et al.
Published: (2024)

Compression Represents Intelligence Linearly
by: Huang, Yuzhen, et al.
Published: (2024)

Robust AI-Generated Text Detection by Restricted Embeddings
by: Kuznetsov, Kristian, et al.
Published: (2024)

Language Modeling Is Compression
by: Delétang, Grégoire, et al.
Published: (2023)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

Lossless KV Cache Compression to 2%
by: Yang, Zhen, et al.
Published: (2024)

Memorization-Compression Cycles Improve Generalization
by: Yu, Fangyuan
Published: (2025)

Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding
by: Tacconelli, Roberto
Published: (2026)

Learning is Forgetting: LLM Training As Lossy Compression
by: Conklin, Henry C., et al.
Published: (2026)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

Lossless data compression by large models
by: Li, Ziguang, et al.
Published: (2024)

Universal Graph Compression: Stochastic Block Models
by: Bhatt, Alankrita, et al.
Published: (2020)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
by: Badger, Benjamin L., et al.
Published: (2025)

Training Sparse Mixture Of Experts Text Embedding Models
by: Nussbaum, Zach, et al.
Published: (2025)

Towards Lossless Token Pruning in Late-Interaction Retrieval Models
by: Zong, Yuxuan, et al.
Published: (2025)

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification
by: Zhu, He, et al.
Published: (2024)

Improving Robustness of Tabular Retrieval via Representational Stability
by: Bhandari, Kushal Raj, et al.
Published: (2026)

Lossless Token Sequence Compression via Meta-Tokens
by: Harvill, John, et al.
Published: (2025)

Refine Thought: A Test-Time Inference Method for Embedding Model Reasoning
by: Wang, Guangzhi, et al.
Published: (2025)

Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluation
by: Mahdavi, Sadegh, et al.
Published: (2025)

A Training-free Method for LLM Text Attribution
by: Radvand, Tara, et al.
Published: (2025)

MixLM: High-Throughput and Effective LLM Ranking via Text-Embedding Mix-Interaction
by: Li, Guoyao, et al.
Published: (2025)

Complexity Agnostic Recursive Decomposition of Thoughts
by: Qasim, Kaleem Ullah, et al.
Published: (2025)

SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?
by: Shi, Yucheng, et al.
Published: (2025)

Multi-Type Context-Aware Conversational Recommender Systems via Mixture-of-Experts
by: Zou, Jie, et al.
Published: (2025)

Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models
by: Wei, Lai, et al.
Published: (2024)

Surprisal and Metaphor Novelty Judgments: Moderate Correlations and Divergent Scaling Effects Revealed by Corpus-Based and Synthetic Datasets
by: Momen, Omar, et al.
Published: (2026)

Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph
by: Nechakhin, Vladyslav, et al.
Published: (2024)

On Theoretical Interpretations of Concept-Based In-Context Learning
by: Tang, Huaze, et al.
Published: (2025)

Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratio
by: Shen, Hanwen, et al.
Published: (2025)

Task-Centric Acceleration of Small-Language Models
by: Tsur, Dor, et al.
Published: (2026)

Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models
by: Bell, Tyler, et al.
Published: (2024)

Large Language Models as Evaluators for Scientific Synthesis
by: Evans, Julia, et al.
Published: (2024)

Graph-Enhanced Retrieval-Augmented Question Answering for E-Commerce Customer Support
by: Patel, Piyushkumar
Published: (2025)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

On the Reasoning Capacity of AI Models and How to Quantify It
by: Radha, Santosh Kumar, et al.
Published: (2025)