Cover Image

PyLO: Towards Accessible Learned Optimizers in PyTorch

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Janson, Paul, Therien, Benjamin, Anthony, Quentin, Huang, Xiaolong, Moudgil, Abhinav, Belilovsky, Eugene
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Meta-learning Optimizers for Communication-Efficient Learning
by: Joseph, Charles-Étienne, et al.
Published: (2023)

Celo2: Towards Learned Optimization Free Lunch
by: Moudgil, Abhinav, et al.
Published: (2026)

TorchAO: PyTorch-Native Training-to-Serving Model Optimization
by: Or, Andrew, et al.
Published: (2025)

Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
by: You, Bozhi, et al.
Published: (2025)

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch
by: Ghosh, Abhishek, et al.
Published: (2025)

Celo: Training Versatile Learned Optimizers on a Compute Diet
by: Moudgil, Abhinav, et al.
Published: (2025)

Venom: A PyTorch Generative Modeling Toolkit
by: Yan, Liang
Published: (2026)

Lowering PyTorch's Memory Consumption for Selective Differentiation
by: Bhatia, Samarth, et al.
Published: (2024)

torchgfn: A PyTorch GFlowNet library
by: Viviano, Joseph D., et al.
Published: (2023)

Learning Bug Context for PyTorch-to-JAX Translation with LLMs
by: Phan, Hung, et al.
Published: (2025)

Torch Geometric Pool: the PyTorch library for pooling in Graph Neural Networks
by: Abate, Carlo, et al.
Published: (2025)

torchtune: PyTorch native post-training library
by: Obozov, Mark, et al.
Published: (2026)

ExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Device
by: Nachin, Mergen, et al.
Published: (2026)

A PyTorch Library of Turing-Complete Neural Networks
by: Bates, Jonathan
Published: (2026)

PiShield: A PyTorch Package for Learning with Requirements
by: Stoian, Mihaela Cătălina, et al.
Published: (2024)

torchmil: A PyTorch-based library for deep Multiple Instance Learning
by: Castro-Macías, Francisco M., et al.
Published: (2025)

$μ$LO: Compute-Efficient Meta-Generalization of Learned Optimizers
by: Thérien, Benjamin, et al.
Published: (2024)

A PyTorch Framework for Scalable Non-Crossing Quantile Regression
by: Chang, Kaihua
Published: (2025)

PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning
by: Hu, Weihua, et al.
Published: (2024)

MuLoCo: Muon is a practical inner optimizer for DiLoCo
by: Thérien, Benjamin, et al.
Published: (2025)

VMAF Re-implementation on PyTorch: Some Experimental Results
by: Aistov, Kirill, et al.
Published: (2023)

Fuzzy PyTorch: Rapid Numerical Variability Evaluation for Deep Learning Models
by: Gonzalez-Pepe, Inés, et al.
Published: (2026)

Torch-Choice: A PyTorch Package for Large-Scale Choice Modeling with Python
by: Du, Tianyu, et al.
Published: (2023)

Fully Differentiable dMRI Streamline Propagation in PyTorch
by: Yoon, Jongyeon, et al.
Published: (2025)

TiledAttention: a CUDA Tile SDPA Kernel for PyTorch
by: Khan, Taimur
Published: (2026)

Scalable GPU-Accelerated Euler Characteristic Curves: Optimization and Differentiable Learning for PyTorch
by: Saxena, Udit
Published: (2025)

pyvene: A Library for Understanding and Improving PyTorch Models via Interventions
by: Wu, Zhengxuan, et al.
Published: (2024)

depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers
by: You, Kaichao, et al.
Published: (2024)

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
by: Singh, Vaibhav, et al.
Published: (2025)

HAT-CL: A Hard-Attention-to-the-Task PyTorch Library for Continual Learning
by: Duan, Xiaotian
Published: (2023)

SoftDTW-CUDA-Torch: Memory-Efficient GPU-Accelerated Soft Dynamic Time Warping for PyTorch
by: Weber, Ron Shapira, et al.
Published: (2026)

A PyTorch-Compatible Spike Encoding Framework for Energy-Efficient Neuromorphic Applications
by: Vasilache, Alexandru, et al.
Published: (2025)

Soft Decision Tree classifier: explainable and extendable PyTorch implementation
by: Shamir, Reuben R
Published: (2025)

Comparative Analysis of CNN Performance in Keras, PyTorch and JAX on PathMNIST
by: Nezović, Anida, et al.
Published: (2025)

GraphMend: Code Transformations for Fixing Graph Breaks in PyTorch 2
by: Kashmira, Savini, et al.
Published: (2025)

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
by: Liang, Wanchao, et al.
Published: (2024)

torchsom: The Reference PyTorch Library for Self-Organizing Maps
by: Berthier, Louis, et al.
Published: (2025)

Communication Efficient LLM Pre-training with SparseLoCo
by: Sarfi, Amir, et al.
Published: (2025)

TorchSISSO: A PyTorch-Based Implementation of the Sure Independence Screening and Sparsifying Operator for Efficient and Interpretable Model Discovery
by: Muthyala, Madhav, et al.
Published: (2024)

Modalities, a PyTorch-native Framework For Large-scale LLM Training and Research
by: Lübbering, Max, et al.
Published: (2026)