Cover Image

NNTile: a machine learning framework capable of training extremely large GPT language models on a single node

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mikhalev, Aleksandr, Katrutsa, Aleksandr, Sozykin, Konstantin, Oseledets, Ivan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Mathematical Software
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Run LoRA Run: Faster and Lighter LoRA Implementations
by: Cherniuk, Daria, et al.
Published: (2023)

Reproducibility, energy efficiency and performance of pseudorandom number generators in machine learning: a comparative study of python, numpy, tensorflow, and pytorch implementations
by: Antunes, Benjamin, et al.
Published: (2024)

LoTR: Low Tensor Rank Weight Adaptation
by: Bershatsky, Daniel, et al.
Published: (2024)

Empirical evaluation of the Frank-Wolfe methods for constructing white-box adversarial attacks
by: Korotkova, Kristina, et al.
Published: (2025)

Int2Int: a framework for mathematics with transformers
by: Charton, François
Published: (2025)

Self-Scaled Broyden Family of Quasi-Newton Methods in JAX
by: Bioli, Ivan, et al.
Published: (2026)

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions
by: Cheng, Sibo, et al.
Published: (2024)

Data-driven optimal prediction with control
by: Katrutsa, Aleksandr, et al.
Published: (2024)

Cluster Topology-Driven Placement of Experts Reduces Network Traffic in MoE Inference
by: Sivtsov, Danil, et al.
Published: (2025)

evomap: A Toolbox for Dynamic Mapping in Python
by: Matthe, Maximilian
Published: (2025)

Implementation of tangent linear and adjoint models for neural networks based on a compiler library tool
by: Xiao, Sa, et al.
Published: (2026)

Quantization of Large Language Models with an Overdetermined Basis
by: Merkulov, Daniil, et al.
Published: (2024)

Dynamic Low-rank Approximation of Full-Matrix Preconditioner for Training Generalized Linear Models
by: Matveeva, Tatyana, et al.
Published: (2025)

auto-fpt: Automating Free Probability Theory Calculations for Machine Learning Theory
by: Subramonian, Arjun, et al.
Published: (2025)

NUBO: A Transparent Python Package for Bayesian Optimization
by: Diessner, Mike, et al.
Published: (2023)

MissMecha: An All-in-One Python Package for Studying Missing Data Mechanisms
by: Zhou, Youran, et al.
Published: (2025)

Jaya R Package -- A Parameter-Free Solution for Advanced Single and Multi-Objective Optimization
by: Bokde, Neeraj Dhanraj
Published: (2024)

Differentiable Parameter Optimization for DAEs with State-Dependent Events
by: Matei, Ion, et al.
Published: (2026)

A method of using RSVD in residual calculation of LowBit GEMM
by: Gu, Hongyaoxing
Published: (2024)

CausalVerse: Benchmarking Causal Representation Learning with Configurable High-Fidelity Simulations
by: Chen, Guangyi, et al.
Published: (2025)

EarlyStopping: Implicit Regularization for Iterative Learning Procedures in Python
by: Ziebell, Eric, et al.
Published: (2025)

Sparser, Better, Faster, Stronger: Sparsity Detection for Efficient Automatic Differentiation
by: Hill, Adrian, et al.
Published: (2025)

Dimensional Peeking for Low-Variance Gradients in Zeroth-Order Discrete Optimization via Simulation
by: Andelfinger, Philipp, et al.
Published: (2026)

Cooper: A Library for Constrained Optimization in Deep Learning
by: Gallego-Posada, Jose, et al.
Published: (2025)

PlasmoData.jl -- A Julia Framework for Modeling and Analyzing Complex Data as Graphs
by: Cole, David L, et al.
Published: (2024)

A Fast and Scalable Pathwise-Solver for Group Lasso and Elastic Net Penalized Regression via Block-Coordinate Descent
by: Yang, James, et al.
Published: (2024)

The Range Shrinks, the Threat Remains: Re-evaluating LLM Package Hallucinations on the 2026 Frontier-Model Cohort
by: Churilov, Aleksandr
Published: (2026)

Linearized Optimal Transport pyLOT Library: A Toolkit for Machine Learning on Point Clouds
by: Linwu, Jun, et al.
Published: (2025)

DB-KSVD: Scalable Alternating Optimization for Disentangling High-Dimensional Embedding Spaces
by: Valentin, Romeo, et al.
Published: (2025)

BlackJAX: Composable Bayesian inference in JAX
by: Cabezas, Alberto, et al.
Published: (2024)

Torch-Choice: A PyTorch Package for Large-Scale Choice Modeling with Python
by: Du, Tianyu, et al.
Published: (2023)

Efficiently Vectorized MCMC on Modern Accelerators
by: Dance, Hugh, et al.
Published: (2025)

scikit-fda: A Python Package for Functional Data Analysis
by: Ramos-Carreño, Carlos, et al.
Published: (2022)

forester: A Tree-Based AutoML Tool in R
by: Ruczyński, Hubert, et al.
Published: (2024)

KHRONOS: a Kernel-Based Neural Architecture for Rapid, Resource-Efficient Scientific Computation
by: Batley, Reza T., et al.
Published: (2025)

Adaptation of XAI to Auto-tuning for Numerical Libraries
by: Aoki, Shota, et al.
Published: (2024)

A framework for assessing the capabilities of code generation of constraint domain-specific languages with large language models
by: Delgado, David, et al.
Published: (2026)

Architecting software monitors for control-flow anomaly detection through large language models and conformance checking
by: Vitale, Francesco, et al.
Published: (2025)

Stack Trace Deduplication: Faster, More Accurately, and in More Realistic Scenarios
by: Shibaev, Egor, et al.
Published: (2024)

Scorio.jl: A Julia package for ranking stochastic responses
by: Hariri, Mohsen, et al.
Published: (2026)