Cover Image

Advancing Deep Active Learning & Data Subset Selection: Unifying Principles with Information-Theory Intuitions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kirsch, Andreas
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection
by: Beck, Nathan, et al.
Published: (2024)

A Generalized Information Bottleneck Theory of Deep Learning
by: Westphal, Charles, et al.
Published: (2025)

The Maximum von Neumann Entropy Principle: Theory and Applications in Machine Learning
by: Wu, Youqi, et al.
Published: (2026)

A Theory of Machine Understanding via the Minimum Description Length Principle
by: Zhang, Canlin, et al.
Published: (2025)

Application of Deep Learning in Biological Data Compression
by: Zou, Chunyu
Published: (2025)

In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory
by: Zecchin, Matteo, et al.
Published: (2025)

Redundancy as a Structural Information Principle for Learning and Generalization
by: Bi, Yuda, et al.
Published: (2025)

OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data
by: Zhao, Yan, et al.
Published: (2026)

Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learning
by: Hamzi, Boumediene, et al.
Published: (2023)

Learning Regularities from Data using Spiking Functions: A Theory
by: Zhang, Canlin, et al.
Published: (2024)

Ensuring Reliability via Hyperparameter Selection: Review and Advances
by: Farzaneh, Amirmohammad, et al.
Published: (2025)

Representative, Informative, and De-Amplifying: Requirements for Robust Bayesian Active Learning under Model Misspecification
by: Tang, Roubing, et al.
Published: (2025)

Subset-Based Instance Optimality in Private Estimation
by: Dick, Travis, et al.
Published: (2023)

Learning to Compress: Local Rank and Information Compression in Deep Neural Networks
by: Patel, Niket, et al.
Published: (2024)

Unifying Summary Statistic Selection for Approximate Bayesian Computation
by: Hoffmann, Till, et al.
Published: (2022)

Unifying Information-Theoretic and Pair-Counting Clustering Similarity
by: Gates, Alexander J.
Published: (2025)

Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination
by: Zhang, Dong-Xiao, et al.
Published: (2026)

Partial Information Decomposition for Data Interpretability and Feature Selection
by: Westphal, Charles, et al.
Published: (2024)

Vendi Information Gain for Active Learning and its Application to Ecology
by: Nguyen, Quan, et al.
Published: (2025)

Estimating Conditional Mutual Information for Dynamic Feature Selection
by: Gadgil, Soham, et al.
Published: (2023)

A Unified Probabilistic Framework for Dictionary Learning with Parsimonious Activation
by: Zhao, Zihui, et al.
Published: (2025)

Information-Theoretic State Variable Selection for Reinforcement Learning
by: Westphal, Charles, et al.
Published: (2024)

Information-Theoretic Generalization Bounds for Deep Neural Networks
by: He, Haiyun, et al.
Published: (2024)

The Critical Horizon: Inspection Design Principles for Multi-Stage Operations and Deep Reasoning
by: Emadi, Seyed Morteza
Published: (2026)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
by: Taheri, Hossein, et al.
Published: (2025)

Deep Dict: Deep Learning-based Lossy Time Series Compressor for IoT Data
by: Liu, Jinxin, et al.
Published: (2024)

Theory of Minimal Weight Perturbations in Deep Networks and its Applications for Low-Rank Activated Backdoor Attacks
by: Evans, Bethan, et al.
Published: (2026)

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication
by: Zhou, Yujie, et al.
Published: (2025)

DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning
by: Hebbar, S Ashwin, et al.
Published: (2024)

The Gap Between Principle and Practice of Lossy Image Coding
by: Zhang, Haotian, et al.
Published: (2025)

Continual Deep Reinforcement Learning for Decentralized Satellite Routing
by: Lozano-Cuadra, Federico, et al.
Published: (2024)

Interpretive Efficiency: Information-Geometric Foundations of Data Usefulness
by: Katende, Ronald
Published: (2025)

Learning Causality for Longitudinal Data
by: Bouchattaoui, Mouad EL
Published: (2025)

The Information Theory of Similarity
by: Phadke, Nikit
Published: (2025)

FMLFS: A Federated Multi-Label Feature Selection Based on Information Theory in IoT Environment
by: Mahanipour, Afsaneh, et al.
Published: (2024)

Multi-Agent Deep Reinforcement Learning for Distributed Satellite Routing
by: Lozano-Cuadra, Federico, et al.
Published: (2024)

Online Clustering of Data Sequences with Bandit Information
by: Chandran, G Dhinesh, et al.
Published: (2025)

Fault Detection and Monitoring using a Data-Driven Information-Based Strategy: Method, Theory, and Application
by: Ramírez, Camilo, et al.
Published: (2024)

Computation-aware Energy-harvesting Federated Learning: Cyclic Scheduling with Selective Participation
by: Jeong, Eunjeong, et al.
Published: (2025)

An Information-Theoretic Analysis of In-Context Learning
by: Jeon, Hong Jun, et al.
Published: (2024)