Imagen de Portada

An Enhanced Text Compression Approach Using Transformer-based Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Rahman, Chowdhury Mofizur, Sobhani, Mahbub E, Rodela, Anika Tasnim, Shatabda, Swakkhar
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Information Theory Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
por: Sobhani, Mahbub E, et al.
Publicado: (2025)

Language Modeling Is Compression
por: Delétang, Grégoire, et al.
Publicado: (2023)

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
por: Nagle, Alliot, et al.
Publicado: (2024)

Embedding Is (Almost) All You Need: Retrieval-Augmented Inference for Generalizable Genomic Prediction Tasks
por: Datta, Nirjhor, et al.
Publicado: (2025)

Efficient Learned Data Compression via Dual-Stream Feature Decoupling
por: Ma, Huidong, et al.
Publicado: (2026)

MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression
por: Elias, Noel, et al.
Publicado: (2024)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
por: Badger, Benjamin L., et al.
Publicado: (2025)

BanglishRev: A Large-Scale Bangla-English and Code-mixed Dataset of Product Reviews in E-Commerce
por: Shamael, Mohammad Nazmush, et al.
Publicado: (2024)

Effective Context in Transformers: An Analysis of Fragmentation and Tokenization
por: Fesharaki, Amirmehdi Jafari, et al.
Publicado: (2026)

Transformers on Markov Data: Constant Depth Suffices
por: Rajaraman, Nived, et al.
Publicado: (2024)

From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledge
por: Chowdhury, Nafis, et al.
Publicado: (2025)

Understanding Factual Recall in Transformers via Associative Memories
por: Nichani, Eshaan, et al.
Publicado: (2024)

Compression Represents Intelligence Linearly
por: Huang, Yuzhen, et al.
Publicado: (2024)

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
por: Makkuva, Ashok Vardhan, et al.
Publicado: (2024)

Memorization-Compression Cycles Improve Generalization
por: Yu, Fangyuan
Publicado: (2025)

AlphaZip: Neural Network-Enhanced Lossless Text Compression
por: Narashiman, Swathi Shree, et al.
Publicado: (2024)

Learning is Forgetting: LLM Training As Lossy Compression
por: Conklin, Henry C., et al.
Publicado: (2026)

BN-AuthProf: Benchmarking Machine Learning for Bangla Author Profiling on Social Media Texts
por: Tasnim, Raisa, et al.
Publicado: (2024)

A Mathematical Theory for Learning Semantic Languages by Abstract Learners
por: Liao, Kuo-Yu, et al.
Publicado: (2024)

Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
por: Lei, Eric, et al.
Publicado: (2024)

Cost-aware LLM-based Online Dataset Annotation
por: Elumar, Eray Can, et al.
Publicado: (2025)

An Information-theoretic Multi-task Representation Learning Framework for Natural Language Understanding
por: Hu, Dou, et al.
Publicado: (2025)

BnMMLU: Measuring Massive Multitask Language Understanding in Bengali
por: Joy, Saman Sarker, et al.
Publicado: (2025)

Optimizing Small Transformer-Based Language Models for Multi-Label Sentiment Analysis in Short Texts
por: Neumann, Julius, et al.
Publicado: (2025)

Quantifying Logical Consistency in Transformers via Query-Key Alignment
por: Tulchinskii, Eduard, et al.
Publicado: (2025)

The Information of Large Language Model Geometry
por: Tan, Zhiquan, et al.
Publicado: (2024)

Theoretical Limits of Language Model Alignment
por: Paes, Lucas Monteiro, et al.
Publicado: (2026)

A Training-free Method for LLM Text Attribution
por: Radvand, Tara, et al.
Publicado: (2025)

A Survey on Large Language Models from Concept to Implementation
por: Wang, Chen, et al.
Publicado: (2024)

Integrating Pre-Trained Language Model with Physical Layer Communications
por: Lee, Ju-Hyung, et al.
Publicado: (2024)

Geometric Signatures of Compositionality Across a Language Model's Lifetime
por: Lee, Jin Hwa, et al.
Publicado: (2024)

New Directions in Text Classification Research: Maximizing The Performance of Sentiment Classification from Limited Data
por: Agustian, Surya, et al.
Publicado: (2024)

Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach
por: Rajamanickam, Duraimurugan
Publicado: (2024)

Proposal and study of statistical features for string similarity computation and classification
por: Rodrigues, E. O., et al.
Publicado: (2026)

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency
por: Krasnovsky, Anatoly A.
Publicado: (2025)

In-Context Learning with Representations: Contextual Generalization of Trained Transformers
por: Yang, Tong, et al.
Publicado: (2024)

Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models
por: Wei, Lai, et al.
Publicado: (2024)

Subjective Depth and Timescale Transformers: Learning Where and When to Compute
por: Wieser, Frederico, et al.
Publicado: (2025)

PashtoCorp: A 1.25-Billion-Word Corpus, Evaluation Suite, and Reproducible Pipeline for Low-Resource Language Development
por: Rahman, Hanif
Publicado: (2026)

Lossless and Near-Lossless Compression for Foundation Models
por: Hershcovitch, Moshik, et al.
Publicado: (2024)