Imagen de Portada

Fundamental Properties of Causal Entropy and Information Gain

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Simoes, Francisco N. F. Q., Dastani, Mehdi, van Ommen, Thijs
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Information Theory
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Causal Entropy and Information Gain for Measuring Causal Control
por: Simoes, Francisco Nunes Ferreira Quialheiro, et al.
Publicado: (2023)

The Causal Information Bottleneck and Optimal Causal Variable Abstractions
por: Simoes, Francisco N. F. Q., et al.
Publicado: (2024)

The Minimal Search Space for Conditional Causal Bandits
por: Simoes, Francisco N. F. Q., et al.
Publicado: (2025)

Efficiently Deciding Algebraic Equivalence of Bow-Free Acyclic Path Diagrams
por: van Ommen, Thijs
Publicado: (2024)

Dictionary Based Pattern Entropy for Causal Direction Discovery
por: B, Harikrishnan N, et al.
Publicado: (2026)

A Neural Difference-of-Entropies Estimator for Mutual Information
por: Ni, Haoran, et al.
Publicado: (2025)

Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization
por: Daunas, Francisco, et al.
Publicado: (2024)

Vendi Information Gain for Active Learning and its Application to Ecology
por: Nguyen, Quan, et al.
Publicado: (2025)

Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decomposition
por: Tian, Chao, et al.
Publicado: (2025)

Functional Properties of the Focal-Entropy
por: Shah, Jaimin, et al.
Publicado: (2026)

On the Properties and Estimation of Pointwise Mutual Information Profiles
por: Czyż, Paweł, et al.
Publicado: (2023)

On Causality in Domain Adaptation and Semi-Supervised Learning: an Information-Theoretic Analysis for Parametric Models
por: Wu, Xuetong, et al.
Publicado: (2022)

Semantic Communication meets System 2 ML: How Abstraction, Compositionality and Emergent Languages Shape Intelligence
por: Bennis, Mehdi, et al.
Publicado: (2025)

Epistemic Throughput: Fundamental Limits of Attention-Constrained Inference
por: You, Lei
Publicado: (2026)

Fundamental Limits of CSI Compression in FDD Massive MIMO
por: Park, Bumsu, et al.
Publicado: (2026)

Minimum Entropy Coupling with Bottleneck
por: Ebrahimi, M. Reza, et al.
Publicado: (2024)

Entropy-informed Decoding: Adaptive Information-Driven Branching
por: Evans, Benjamin Patrick, et al.
Publicado: (2026)

Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs
por: Gündüz, Deniz, et al.
Publicado: (2024)

Learning Causality for Longitudinal Data
por: Bouchattaoui, Mouad EL
Publicado: (2025)

TREET: TRansfer Entropy Estimation via Transformers
por: Luxembourg, Omer, et al.
Publicado: (2024)

Transfer Entropy in Graph Convolutional Neural Networks
por: Moldovan, Adrian, et al.
Publicado: (2024)

Accelerating Relative Entropy Coding with Space Partitioning
por: He, Jiajun, et al.
Publicado: (2024)

Hierarchical Maximum Entropy via the Renormalization Group
por: Asadi, Amir R.
Publicado: (2025)

Out-of-Distribution Detection using Maximum Entropy Coding
por: Abolfazli, Mojtaba, et al.
Publicado: (2024)

Breaking the Finite-Sample Barrier in Entropy Coupling
por: Asoodeh, Shahab, et al.
Publicado: (2026)

Empirical Risk Minimization with Relative Entropy Regularization
por: Perlaza, Samir M., et al.
Publicado: (2022)

Predictability Analysis of Regression Problems via Conditional Entropy Estimations
por: Fang, Yu-Hsueh, et al.
Publicado: (2024)

How Transformers Learn Causal Structure with Gradient Descent
por: Nichani, Eshaan, et al.
Publicado: (2024)

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization
por: Xie, Li, et al.
Publicado: (2024)

The Maximum von Neumann Entropy Principle: Theory and Applications in Machine Learning
por: Wu, Youqi, et al.
Publicado: (2026)

On the Minimax Regret of Sequential Probability Assignment via Square-Root Entropy
por: Jia, Zeyu, et al.
Publicado: (2025)

Cross-Domain Lossy Compression via Constrained Minimum Entropy Coupling
por: Nguyen, Nam, et al.
Publicado: (2026)

Generalized Talagrand Inequality for Sinkhorn Distance using Entropy Power Inequality
por: Wang, Shuchan, et al.
Publicado: (2021)

Entropy Coding of Unordered Data Structures
por: Kunze, Julius, et al.
Publicado: (2024)

The Causal Description Gap: Information-Theoretic Separations Across Pearl's Hierarchy
por: Emadi, Seyed Morteza
Publicado: (2026)

Entropy-Based Dimension-Free Convergence and Loss-Adaptive Schedules for Diffusion Models
por: Aghapour, Ahmad, et al.
Publicado: (2026)

Neural Entropy
por: Premkumar, Akhil
Publicado: (2024)

Fundamental limits of distributed covariance matrix estimation via a conditional strong data processing inequality
por: Rahmani, Mohammad Reza, et al.
Publicado: (2025)

Information Entropy-Based Scheduling for Communication-Efficient Decentralized Learning
por: Nagar, Jaiprakash, et al.
Publicado: (2025)

Context Steering: A New Paradigm for Compression-based Embeddings by Synthesizing Relevant Information Features
por: Sarasa, Guillermo, et al.
Publicado: (2025)