:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Tan, Zhiquan, Li, Chenghai, Huang, Weiran
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Computation and Language Information Theory
Accesso online:	https://arxiv.org/abs/2402.03471
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models
di: Wei, Lai, et al.
Pubblicazione: (2024)

A Survey on Large Language Models from Concept to Implementation
di: Wang, Chen, et al.
Pubblicazione: (2024)

Language Modeling Is Compression
di: Delétang, Grégoire, et al.
Pubblicazione: (2023)

Geometric Signatures of Compositionality Across a Language Model's Lifetime
di: Lee, Jin Hwa, et al.
Pubblicazione: (2024)

Graph-based Confidence Calibration for Large Language Models
di: Li, Yukun, et al.
Pubblicazione: (2024)

An Information Theoretic Perspective on Agentic System Design
di: He, Shizhe, et al.
Pubblicazione: (2025)

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency
di: Krasnovsky, Anatoly A.
Pubblicazione: (2025)

Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory
di: Anwar, Usman, et al.
Pubblicazione: (2026)

The Stepwise Informativeness Assumption: Why are Entropy Dynamics and Reasoning Correlated in LLMs?
di: Català, Mar Gonzàlez I, et al.
Pubblicazione: (2026)

Understanding Grokking Through A Robustness Viewpoint
di: Tan, Zhiquan, et al.
Pubblicazione: (2023)

Self-Play Only Evolves When Self-Synthetic Pipeline Ensures Learnable Information Gain
di: Liu, Wei, et al.
Pubblicazione: (2026)

How Many Features Can a Language Model Store Under the Linear Representation Hypothesis?
di: Garg, Nikhil, et al.
Pubblicazione: (2026)

Learning is Forgetting: LLM Training As Lossy Compression
di: Conklin, Henry C., et al.
Pubblicazione: (2026)

Compression Represents Intelligence Linearly
di: Huang, Yuzhen, et al.
Pubblicazione: (2024)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
di: Badger, Benjamin L., et al.
Pubblicazione: (2025)

The Detection-Extraction Gap: Models Know the Answer Before They Can Say It
di: Wang, Hanyang, et al.
Pubblicazione: (2026)

On Bilingual Lexicon Induction with Large Language Models
di: Li, Yaoyiran, et al.
Pubblicazione: (2023)

Language Models Can Reduce Asymmetry in Information Markets
di: Rahaman, Nasim, et al.
Pubblicazione: (2024)

Visual Language Model based Cross-modal Semantic Communication Systems
di: Jiang, Feibo, et al.
Pubblicazione: (2024)

Uncertainty-Aware Explainable Recommendation with Large Language Models
di: Peng, Yicui, et al.
Pubblicazione: (2024)

L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
di: Chen, Zhuo, et al.
Pubblicazione: (2025)

Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Models
di: Zhang, Jiaxin, et al.
Pubblicazione: (2024)

Large Language Models are Learnable Planners for Long-Term Recommendation
di: Shi, Wentao, et al.
Pubblicazione: (2024)

Optimal Quantization for Matrix Multiplication
di: Ordentlich, Or, et al.
Pubblicazione: (2024)

A Training-free Method for LLM Text Attribution
di: Radvand, Tara, et al.
Pubblicazione: (2025)

Memorization-Compression Cycles Improve Generalization
di: Yu, Fangyuan
Pubblicazione: (2025)

SPEX: Scaling Feature Interaction Explanations for LLMs
di: Kang, Justin Singh, et al.
Pubblicazione: (2025)

A Communication-Theoretic Framework for LLM Agents: Cost-Aware Adaptive Reliability
di: Omidvar, Hamed, et al.
Pubblicazione: (2026)

Subjective Depth and Timescale Transformers: Learning Where and When to Compute
di: Wieser, Frederico, et al.
Pubblicazione: (2025)

SQuat: Subspace-orthogonal KV Cache Quantization
di: Wang, Hao, et al.
Pubblicazione: (2025)

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models
di: Hartman, Max, et al.
Pubblicazione: (2025)

Graph Machine Learning in the Era of Large Language Models (LLMs)
di: Wang, Shijie, et al.
Pubblicazione: (2024)

The Factuality of Large Language Models in the Legal Domain
di: Hamdani, Rajaa El, et al.
Pubblicazione: (2024)

Demystifying and Enhancing the Efficiency of Large Language Model Based Search Agents
di: Yang, Tiannuo, et al.
Pubblicazione: (2025)

Large Language Model Augmented Exercise Retrieval for Personalized Language Learning
di: Xu, Austin, et al.
Pubblicazione: (2024)

Can I understand what I create? Self-Knowledge Evaluation of Large Language Models
di: Tan, Zhiquan, et al.
Pubblicazione: (2024)

Forgetting-MarI: LLM Unlearning via Marginal Information Regularization
di: Xu, Shizhou, et al.
Pubblicazione: (2025)

ATLAS: Adapter-Based Multi-Modal Continual Learning with a Two-Stage Learning Strategy
di: Li, Hong, et al.
Pubblicazione: (2024)

OD-Stega: LLM-Based Relatively Secure Steganography via Optimized Distributions
di: Huang, Yu-Shin, et al.
Pubblicazione: (2024)

Retrieval meets Long Context Large Language Models
di: Xu, Peng, et al.
Pubblicazione: (2023)