Cover Image

TexShape: Information Theoretic Sentence Embedding for Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kale, Kaan, Esfahanizadeh, Homa, Elias, Noel, Baser, Oguzhan, Medard, Muriel, Vishwanath, Sriram
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression
by: Elias, Noel, et al.
Published: (2024)

Successive Refinement in Large-Scale Computation: Advancing Model Inference Applications
by: Esfahanizadeh, Homa, et al.
Published: (2024)

WavShape: Information-Theoretic Speech Representation Learning for Fair and Privacy-Aware Audio Processing
by: Baser, Oguzhan, et al.
Published: (2025)

PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detection
by: Baser, Oguzhan, et al.
Published: (2025)

On the Benefits of Coding for Network Slicing
by: Esfahanizadeh, Homa, et al.
Published: (2024)

Precoding-Oriented CSI Feedback Design with Mutual Information Regularized VQ-VAE
by: Chen, Xi, et al.
Published: (2026)

Learning Obfuscations Of LLM Embedding Sequences: Stained Glass Transform
by: Roberts, Jay, et al.
Published: (2025)

Theoretical Limits of Language Model Alignment
by: Paes, Lucas Monteiro, et al.
Published: (2026)

Information-Theoretic Generative Clustering of Documents
by: Du, Xin, et al.
Published: (2024)

CRC Codes as Error Correction Codes
by: An, Wei, et al.
Published: (2021)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

Group Probability Decoding of Turbo Product Codes over Higher-Order Fields
by: Rapp, Lukas, et al.
Published: (2025)

Soft-Output Successive Cancellation List Decoding
by: Yuan, Peihong, et al.
Published: (2024)

SOGRAND Assisted Guesswork Reduction
by: Rapp, Lukas, et al.
Published: (2025)

The Linear Reliability Channel
by: Mariona, Alexander, et al.
Published: (2025)

Near-Optimal Generalized Decoding of Polar-like Codes
by: Yuan, Peihong, et al.
Published: (2024)

Turbo product decoding of cubic tensor codes
by: Khalifeh, Sarah, et al.
Published: (2024)

Leveraging Code Structure to Improve Soft Output for GRAND, GCD, OSD, and SCL
by: Feng, Jiewei, et al.
Published: (2025)

The optimality of word lengths. Theoretical foundations and an empirical study
by: Petrini, Sonia, et al.
Published: (2022)

Can Cross Encoders Produce Useful Sentence Embeddings?
by: Ananthakrishnan, Haritha, et al.
Published: (2025)

SecureSpectra: Safeguarding Digital Identity from Deep Fake Threats via Intelligent Signatures
by: Baser, Oguzhan, et al.
Published: (2024)

Multi-level Reliability Interface for Semantic Communications over Wireless Networks
by: Tung, Tze-Yang, et al.
Published: (2024)

Pricing Innovation Under Latency Constraints: A Mean-Field Analysis of Coded Payload Delivery
by: Médard, Muriel, et al.
Published: (2026)

An Information Theoretic Perspective on Agentic System Design
by: He, Shizhe, et al.
Published: (2025)

Predicting Oscar-Nominated Screenplays with Sentence Embeddings
by: Gross, Francis
Published: (2025)

Joint Error Correction and Fading Channel Estimation Enhancement Leveraging GRAND
by: Wiame, Charles, et al.
Published: (2025)

Error correction in interference-limited wireless systems
by: Wiame, Charles, et al.
Published: (2024)

Guessing random additive noise decoding with symbol reliability information (SRGRAND)
by: Duffy, Ken R., et al.
Published: (2019)

Cryptanalysis via Machine Learning Based Information Theoretic Metrics
by: Kim, Benjamin D., et al.
Published: (2025)

Soft-output (SO) GRAND and Iterative Decoding to Outperform LDPCs
by: Yuan, Peihong, et al.
Published: (2023)

Optimum Peer-Turbo: A Scalable and Efficient Solution for P2P Broadcasting
by: Médard, Muriel, et al.
Published: (2026)

A Balanced Tree Transformation to Reduce GRAND Queries
by: Rapp, Lukas, et al.
Published: (2025)

Using a Single-Parity-Check to Reduce the Guesswork of Guessing Codeword Decoding
by: Griffin, Joseph, et al.
Published: (2024)

Soft-output Guessing Codeword Decoding
by: Duffy, Ken R., et al.
Published: (2024)

LINC: An In-Network Coding Approach to Tame Packet Loss in Hybrid Wireless-Fiber Backbones
by: Pit-Claudel, Benoit, et al.
Published: (2025)

Repeated Sequences Reveal Gaps between Large Language Models and Natural Language
by: Tanaka-Ishii, Kumiko
Published: (2026)

Theoretical guarantees on the best-of-n alignment policy
by: Beirami, Ahmad, et al.
Published: (2024)

On Theoretical Interpretations of Concept-Based In-Context Learning
by: Tang, Huaze, et al.
Published: (2025)

The Information of Large Language Model Geometry
by: Tan, Zhiquan, et al.
Published: (2024)