Cover Image

Occam's Razor is Only as Sharp as Your ELBO

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Harvey, Ethan, Hughes, Michael C.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Geometric Modeling of Occam's Razor in Deep Learning
by: Sun, Ke, et al.
Published: (2019)

Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood
by: Dhahri, Rayen, et al.
Published: (2024)

In-Context Occam's Razor: How Transformers Prefer Simpler Hypotheses on the Fly
by: Deora, Puneesh, et al.
Published: (2025)

Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?
by: Ibrahim, Mark, et al.
Published: (2024)

Transfer Learning with Informative Priors: Simple Baselines Better than Previously Reported
by: Harvey, Ethan, et al.
Published: (2024)

Learning Hyperparameters via a Data-Emphasized Variational Objective
by: Harvey, Ethan, et al.
Published: (2025)

Learning the Regularization Strength for Deep Fine-Tuning via a Data-Emphasized Variational Objective
by: Harvey, Ethan, et al.
Published: (2024)

Occam's Razor and Bender and Koller's Octopus
by: Guerzhoy, Michael
Published: (2024)

Normal Guidance is what Attention Needs
by: Harvey, Ethan, et al.
Published: (2026)

Synthetic Data Reveals Generalization Gaps in Correlated Multiple Instance Learning
by: Harvey, Ethan, et al.
Published: (2025)

Multimodal ELBO with Diffusion Decoders
by: Wesego, Daniel, et al.
Published: (2024)

The ELBO of Variational Autoencoders Converges to a Sum of Three Entropies
by: Damm, Simon, et al.
Published: (2020)

Occam Gradient Descent
by: Kausik, B. N.
Published: (2024)

Analytical Approximation of the ELBO Gradient in the Context of the Clutter Problem
by: Popov, Roumen Nikolaev
Published: (2024)

ED-VAE: Entropy Decomposition of ELBO in Variational Autoencoders
by: Lygerakis, Fotios, et al.
Published: (2024)

Simple or Simplistic? Scientists' Views on Occam's Razor
by: Hauke Riesch
Published: (2010)

In-context learning and Occam's razor
by: Elmoznino, Eric, et al.
Published: (2024)

RL's Razor: Why Online Reinforcement Learning Forgets Less
by: Shenfeld, Idan, et al.
Published: (2025)

On the Convergence of the ELBO to Entropy Sums
by: Lücke, Jörg, et al.
Published: (2022)

OccamNets: Mitigating Dataset Bias by Favoring Simpler Hypotheses
by: Shrestha, Robik, et al.
Published: (2022)

A Multi-Dataset Benchmark of Multiple Instance Learning for 3D Neuroimage Classification
by: Harvey, Ethan, et al.
Published: (2026)

Statistical learning theory and Occam's razor: The core argument
by: Sterkenburg, Tom F.
Published: (2023)

Deep neural networks have an inbuilt Occam's razor
by: Mingard, Chris, et al.
Published: (2023)

Qrazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring
by: Lee, Dongyoung, et al.
Published: (2025)

On the equivalence of Occam algorithms
by: Keinath-Esmail, Zaman
Published: (2023)

Occam's model: Selecting simpler representations for better transferability estimation
by: Singh, Prabhant, et al.
Published: (2025)

RazorAttention: Efficient KV Cache Compression Through Retrieval Heads
by: Tang, Hanlin, et al.
Published: (2024)

Learning on a Razor's Edge: Identifiability and Singularity of Polynomial Neural Networks
by: Shahverdi, Vahid, et al.
Published: (2025)

Superchannel without Tears: A Generalized Occam's Razor for Quantum Processes
by: Xiao, Yunlong
Published: (2025)

General Mathematical Proof of Occam's Razor; Upgrading Theoretical Physicists' Methodology
by: Leuenberger, Gabriel
Published: (2025)

Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching
by: Gupta, Aditi, et al.
Published: (2026)

Leo Breiman, the Rashomon Effect, and the Occam Dilemma
by: Rudin, Cynthia
Published: (2025)

BitDelta: Your Fine-Tune May Only Be Worth One Bit
by: Liu, James, et al.
Published: (2024)

SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes
by: Yang, Yifan, et al.
Published: (2025)

You Only Need Your Transformer 25% of the Time: Meaning-First Execution for Eliminating Unnecessary Inference
by: Shamim, Ryan
Published: (2025)

OccamVTS: Distilling Vision Models to 1% Parameters for Time Series Forecasting
by: Lyu, Sisuo, et al.
Published: (2025)

OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step
by: Dugan, Owen, et al.
Published: (2024)

Go Beyond Your Means: Unlearning with Per-Sample Gradient Orthogonalization
by: Shamsian, Aviv, et al.
Published: (2025)

EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation
by: Zhang, Shu-Hao, et al.
Published: (2026)

Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
by: Lu, Haiquan, et al.
Published: (2024)