Cover Image

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liang, Wanchao, Liu, Tianyu, Wright, Less, Constable, Will, Gu, Andrew, Huang, Chien-Chin, Zhang, Iris, Feng, Wei, Huang, Howard, Wang, Junjie, Purandare, Sanket, Nadathur, Gokul, Idreos, Stratos
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Distributed, Parallel, and Cluster Computing Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

torchtune: PyTorch native post-training library
by: Obozov, Mark, et al.
Published: (2026)

Torch-Choice: A PyTorch Package for Large-Scale Choice Modeling with Python
by: Du, Tianyu, et al.
Published: (2023)

DMFF in PyTorch backend
by: Zhu, Jia-Xin, et al.
Published: (2026)

ADMP in PyTorch backend
by: Zhu, Jia-Xin, et al.
Published: (2026)

TorchSim: An efficient atomistic simulation engine in PyTorch
by: Cohen, Orion, et al.
Published: (2025)

NewsTorch: A PyTorch-based Toolkit for Learner-oriented News Recommendation
by: Wang, Rongyao, et al.
Published: (2026)

Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond
by: Oncescu, Costin-Andrei, et al.
Published: (2024)

PyLO: Towards Accessible Learned Optimizers in PyTorch
by: Janson, Paul, et al.
Published: (2025)

TorchAO: PyTorch-Native Training-to-Serving Model Optimization
by: Or, Andrew, et al.
Published: (2025)

Torch Geometric Pool: the PyTorch library for pooling in Graph Neural Networks
by: Abate, Carlo, et al.
Published: (2025)

TorchFX: A modern approach to Audio DSP with PyTorch and GPU acceleration
by: Spanio, Matteo, et al.
Published: (2025)

ExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Device
by: Nachin, Mergen, et al.
Published: (2026)

Modalities, a PyTorch-native Framework For Large-scale LLM Training and Research
by: Lübbering, Max, et al.
Published: (2026)

Venom: A PyTorch Generative Modeling Toolkit
by: Yan, Liang
Published: (2026)

Demystifying the Silence of Correctness Bugs in PyTorch Compiler
by: Li, Meiziniu, et al.
Published: (2026)

Lowering PyTorch's Memory Consumption for Selective Differentiation
by: Bhatia, Samarth, et al.
Published: (2024)

LTNtorch: PyTorch Implementation of Logic Tensor Networks
by: Carraro, Tommaso, et al.
Published: (2024)

torchgfn: A PyTorch GFlowNet library
by: Viviano, Joseph D., et al.
Published: (2023)

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch
by: Ghosh, Abhishek, et al.
Published: (2025)

CrypTorch: PyTorch-based Auto-tuning Compiler for Machine Learning with Multi-party Computation
by: Liu, Jinyu, et al.
Published: (2025)

PhoTorch: A robust and generalized biochemical photosynthesis model fitting package based on PyTorch
by: Lei, Tong, et al.
Published: (2025)

A PyTorch Library of Turing-Complete Neural Networks
by: Bates, Jonathan
Published: (2026)

Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
by: You, Bozhi, et al.
Published: (2025)

torchsom: The Reference PyTorch Library for Self-Organizing Maps
by: Berthier, Louis, et al.
Published: (2025)

VMAF Re-implementation on PyTorch: Some Experimental Results
by: Aistov, Kirill, et al.
Published: (2023)

PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction
by: Binder, Arne, et al.
Published: (2024)

Fully Differentiable dMRI Streamline Propagation in PyTorch
by: Yoon, Jongyeon, et al.
Published: (2025)

Learning Bug Context for PyTorch-to-JAX Translation with LLMs
by: Phan, Hung, et al.
Published: (2025)

PiShield: A PyTorch Package for Learning with Requirements
by: Stoian, Mihaela Cătălina, et al.
Published: (2024)

pyvene: A Library for Understanding and Improving PyTorch Models via Interventions
by: Wu, Zhengxuan, et al.
Published: (2024)

SoftDTW-CUDA-Torch: Memory-Efficient GPU-Accelerated Soft Dynamic Time Warping for PyTorch
by: Weber, Ron Shapira, et al.
Published: (2026)

Ep. 170: The Heavy Metal of Machine Learning: Inside PyTorch
by: Rosehill, Daniel, et al.
Published: (2026)

Soft Decision Tree classifier: explainable and extendable PyTorch implementation
by: Shamir, Reuben R
Published: (2025)

SCOREQ: Speech Quality Assessment with Contrastive Regression - PyTorch weights
by: Ragano, Alessandro
Published: (2025)

TiledAttention: a CUDA Tile SDPA Kernel for PyTorch
by: Khan, Taimur
Published: (2026)

Optimizing PyTorch Inference with LLM-Based Multi-Agent Systems
by: Nagaitsev, Kirill, et al.
Published: (2025)

A PyTorch Benchmark for High-Contrast Imaging Post Processing
by: Ko, Chia-Lin, et al.
Published: (2024)

A PyTorch Framework for Scalable Non-Crossing Quantile Regression
by: Chang, Kaihua
Published: (2025)

MRpro - open PyTorch-based MR reconstruction and processing package
by: Zimmermann, Felix Frederik, et al.
Published: (2025)

optHIM: Hybrid Iterative Methods for Continuous Optimization in PyTorch
by: Sridhar, Nikhil, et al.
Published: (2025)