Cover Image

Sparser, Better, Faster, Stronger: Sparsity Detection for Efficient Automatic Differentiation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hill, Adrian, Dalle, Guillaume
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Mathematical Software
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Common Interface for Automatic Differentiation
by: Dalle, Guillaume, et al.
Published: (2025)

Smoothing Methods for Automatic Differentiation Across Conditional Branches
by: Kreikemeyer, Justin N., et al.
Published: (2023)

Reproducibility, energy efficiency and performance of pseudorandom number generators in machine learning: a comparative study of python, numpy, tensorflow, and pytorch implementations
by: Antunes, Benjamin, et al.
Published: (2024)

Differentiable Parameter Optimization for DAEs with State-Dependent Events
by: Matei, Ion, et al.
Published: (2026)

Learning to Optimize by Differentiable Programming
by: Tao, Liping, et al.
Published: (2026)

Efficiently Vectorized MCMC on Modern Accelerators
by: Dance, Hugh, et al.
Published: (2025)

evomap: A Toolbox for Dynamic Mapping in Python
by: Matthe, Maximilian
Published: (2025)

Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization
by: Nowak, Aleksandra Irena, et al.
Published: (2024)

auto-fpt: Automating Free Probability Theory Calculations for Machine Learning Theory
by: Subramonian, Arjun, et al.
Published: (2025)

MissMecha: An All-in-One Python Package for Studying Missing Data Mechanisms
by: Zhou, Youran, et al.
Published: (2025)

CausalVerse: Benchmarking Causal Representation Learning with Configurable High-Fidelity Simulations
by: Chen, Guangyi, et al.
Published: (2025)

EarlyStopping: Implicit Regularization for Iterative Learning Procedures in Python
by: Ziebell, Eric, et al.
Published: (2025)

Cooper: A Library for Constrained Optimization in Deep Learning
by: Gallego-Posada, Jose, et al.
Published: (2025)

NNTile: a machine learning framework capable of training extremely large GPT language models on a single node
by: Mikhalev, Aleksandr, et al.
Published: (2025)

Self-Scaled Broyden Family of Quasi-Newton Methods in JAX
by: Bioli, Ivan, et al.
Published: (2026)

NUBO: A Transparent Python Package for Bayesian Optimization
by: Diessner, Mike, et al.
Published: (2023)

Jaya R Package -- A Parameter-Free Solution for Advanced Single and Multi-Objective Optimization
by: Bokde, Neeraj Dhanraj
Published: (2024)

A method of using RSVD in residual calculation of LowBit GEMM
by: Gu, Hongyaoxing
Published: (2024)

Dimensional Peeking for Low-Variance Gradients in Zeroth-Order Discrete Optimization via Simulation
by: Andelfinger, Philipp, et al.
Published: (2026)

PlasmoData.jl -- A Julia Framework for Modeling and Analyzing Complex Data as Graphs
by: Cole, David L, et al.
Published: (2024)

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions
by: Cheng, Sibo, et al.
Published: (2024)

KHRONOS: a Kernel-Based Neural Architecture for Rapid, Resource-Efficient Scientific Computation
by: Batley, Reza T., et al.
Published: (2025)

A Fast and Scalable Pathwise-Solver for Group Lasso and Elastic Net Penalized Regression via Block-Coordinate Descent
by: Yang, James, et al.
Published: (2024)

Efficient $1$-bit tensor approximations
by: Riasanovsky, Alex W. Neal, et al.
Published: (2024)

Differentiable programming across the PDE and Machine Learning barrier
by: Bouziani, Nacime, et al.
Published: (2024)

Linearized Optimal Transport pyLOT Library: A Toolkit for Machine Learning on Point Clouds
by: Linwu, Jun, et al.
Published: (2025)

DB-KSVD: Scalable Alternating Optimization for Disentangling High-Dimensional Embedding Spaces
by: Valentin, Romeo, et al.
Published: (2025)

BlackJAX: Composable Bayesian inference in JAX
by: Cabezas, Alberto, et al.
Published: (2024)

Torch-Choice: A PyTorch Package for Large-Scale Choice Modeling with Python
by: Du, Tianyu, et al.
Published: (2023)

scikit-fda: A Python Package for Functional Data Analysis
by: Ramos-Carreño, Carlos, et al.
Published: (2022)

forester: A Tree-Based AutoML Tool in R
by: Ruczyński, Hubert, et al.
Published: (2024)

Adaptation of XAI to Auto-tuning for Numerical Libraries
by: Aoki, Shota, et al.
Published: (2024)

Sparse Automatic Differentiation for Complex Networks of Differential-Algebraic Equations Using Abstract Elementary Algebra
by: Peles, Slaven, et al.
Published: (2015)

Minimization of Nonlinear Energies in Python Using FEM and Automatic Differentiation Tools
by: Béreš, Michal, et al.
Published: (2024)

UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEs
by: Han, Xi, et al.
Published: (2024)

El0ps: An Exact L0-regularized Problems Solver
by: Guyard, Théo, et al.
Published: (2025)

Int2Int: a framework for mathematics with transformers
by: Charton, François
Published: (2025)

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations
by: Wang, Jiaping, et al.
Published: (2025)

DRO: A Python Library for Distributionally Robust Optimization in Machine Learning
by: Liu, Jiashuo, et al.
Published: (2025)

Zipf-Gramming: Scaling Byte N-Grams Up to Production Sized Malware Corpora
by: Raff, Edward, et al.
Published: (2025)