Copertina

Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Oncescu, Costin-Andrei, Purandare, Sanket, Idreos, Stratos, Kakade, Sham
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
di: Meterez, Alexandru, et al.
Pubblicazione: (2025)

A Simplified Analysis of SGD for Linear Regression with Weight Averaging
di: Meterez, Alexandru, et al.
Pubblicazione: (2025)

The Recurrent Transformer: Greater Effective Depth and Efficient Decoding
di: Oncescu, Costin-Andrei, et al.
Pubblicazione: (2026)

Feature emergence via margin maximization: case studies in algebraic tasks
di: Morwani, Depen, et al.
Pubblicazione: (2023)

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
di: Liang, Wanchao, et al.
Pubblicazione: (2024)

Learning Hidden Markov Models Using Conditional Samples
di: Kakade, Sham M., et al.
Pubblicazione: (2023)

Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants
di: Morwani, Depen, et al.
Pubblicazione: (2025)

The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton
di: Abreu, Natalie, et al.
Pubblicazione: (2025)

Deconstructing What Makes a Good Optimizer for Language Models
di: Zhao, Rosie, et al.
Pubblicazione: (2024)

Prescriptive Scaling Reveals the Evolution of Language Model Capabilities
di: Zhang, Hanlin, et al.
Pubblicazione: (2026)

Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning
di: Jin, Jikai, et al.
Pubblicazione: (2025)

Scaling Laws in Linear Regression: Compute, Parameters, and Data
di: Lin, Licong, et al.
Pubblicazione: (2024)

Repeat After Me: Transformers are Better than State Space Models at Copying
di: Jelassi, Samy, et al.
Pubblicazione: (2024)

FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models
di: Shao, Zishan, et al.
Pubblicazione: (2025)

Soup to go: mitigating forgetting during continual learning with model averaging
di: Kleiman, Anat, et al.
Pubblicazione: (2025)

Model Editing by Standard Fine-Tuning
di: Gangadhar, Govind, et al.
Pubblicazione: (2024)

Star Attention: Efficient LLM Inference over Long Sequences
di: Acharya, Shantanu, et al.
Pubblicazione: (2024)

FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference
di: Tranheden, Wilhelm, et al.
Pubblicazione: (2026)

CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training
di: Brandfonbrener, David, et al.
Pubblicazione: (2024)

Scaling Laws for Imitation Learning in Single-Agent Games
di: Tuyls, Jens, et al.
Pubblicazione: (2023)

Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers
di: Massoudi, Soheyl, et al.
Pubblicazione: (2026)

MOM: Memory-Efficient Offloaded Mini-Sequence Inference for Long Context Language Models
di: Zhang, Junyang, et al.
Pubblicazione: (2025)

Constructive Symbolic Reinforcement Learning via Intuitionistic Logic and Goal-Chaining Inference
di: Patrascu, Andrei T.
Pubblicazione: (2025)

Loss-to-Loss Prediction: Scaling Laws for All Datasets
di: Brandfonbrener, David, et al.
Pubblicazione: (2024)

Efficient Large Language Model Inference with Neural Block Linearization
di: Erdogan, Mete, et al.
Pubblicazione: (2025)

RosettaSearch: Multi-Objective Inference-Time Search for Protein Sequence Design
di: Kshirsagar, Meghana, et al.
Pubblicazione: (2026)

EVIL: Evolving Interpretable Algorithms for Zero-Shot Inference on Event Sequences and Time Series with LLMs
di: Berghaus, David
Pubblicazione: (2026)

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging
di: Meterez, Alexandru, et al.
Pubblicazione: (2026)

The Role of Sparsity for Length Generalization in Transformers
di: Golowich, Noah, et al.
Pubblicazione: (2025)

Scaling On-Device GPU Inference for Large Generative Models
di: Tang, Jiuqiang, et al.
Pubblicazione: (2025)

Mamba: Linear-Time Sequence Modeling with Selective State Spaces
di: Gu, Albert, et al.
Pubblicazione: (2023)

FlashSVD v1.5: Making Low-Rank Transformers Inference Actually Fast
di: Wu, Wenhao, et al.
Pubblicazione: (2026)

Membership Inference Attacks Against Time-Series Models
di: Koren, Noam, et al.
Pubblicazione: (2024)

Diversified Scaling Inference in Time Series Foundation Models
di: Hua, Ruijin, et al.
Pubblicazione: (2026)

Dynamic Search for Inference-Time Alignment in Diffusion Models
di: Li, Xiner, et al.
Pubblicazione: (2025)

Inference-Time Toxicity Mitigation in Protein Language Models
di: Burda, Manuel Fernández, et al.
Pubblicazione: (2026)

Transcendence: Generative Models Can Outperform The Experts That Train Them
di: Zhang, Edwin, et al.
Pubblicazione: (2024)

Progressive Inference: Explaining Decoder-Only Sequence Classification Models Using Intermediate Predictions
di: Kariyappa, Sanjay, et al.
Pubblicazione: (2024)

MatKV: Trading Compute for Flash Storage in LLM Inference
di: Shin, Kun-Woo, et al.
Pubblicazione: (2025)

MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learning
di: Dymchenko, Sofya, et al.
Pubblicazione: (2024)