Imagen de Portada

FluidML: Fast and Memory Efficient Inference Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Jinjie, Qiu, Hang
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Model
por: Liu, Yuqiu, et al.
Publicado: (2024)

Fast Compute for ML Optimization
por: Polson, Nick, et al.
Publicado: (2026)

FAST: An Optimization Framework for Fast Additive Segmentation in Transparent ML
por: Liu, Brian, et al.
Publicado: (2024)

Optimizing LLM Inference: Fluid-Guided Online Scheduling with Memory Constraints
por: Ao, Ruicheng, et al.
Publicado: (2025)

Toward Robust and Efficient ML-Based GPU Caching for Modern Inference
por: Chen, Peng, et al.
Publicado: (2025)

Memory-Efficient Optimization with Factorized Hamiltonian Descent
por: Nguyen, Son, et al.
Publicado: (2024)

The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization
por: Chung, Jae-Won, et al.
Publicado: (2025)

ML Inference Scheduling with Predictable Latency
por: Zhao, Haidong, et al.
Publicado: (2025)

MicroFlow: An Efficient Rust-Based Inference Engine for TinyML
por: Carnelos, Matteo, et al.
Publicado: (2024)

Fast and Robust Simulation-Based Inference With Optimization Monte Carlo
por: Gkolemis, Vasilis, et al.
Publicado: (2025)

On Simplifying Large-Scale Spatial Vectors: Fast, Memory-Efficient, and Cost-Predictable k-means
por: Ji, Yushuai, et al.
Publicado: (2024)

MLonMCU: TinyML Benchmarking with Fast Retargeting
por: van Kempen, Philipp, et al.
Publicado: (2023)

ZipServ: Fast and Memory-Efficient LLM Inference with Hardware-Aware Lossless Compression
por: Fan, Ruibo, et al.
Publicado: (2026)

Strait: Perceiving Priority and Interference in ML Inference Serving
por: Zhao, Haidong, et al.
Publicado: (2026)

MCUBERT: Memory-Efficient BERT Inference on Commodity Microcontrollers
por: Yang, Zebin, et al.
Publicado: (2024)

Fast and Compact Tsetlin Machine Inference on CPUs Using Instruction-Level Optimization
por: Zeng, Yefan, et al.
Publicado: (2025)

Rectified Flows for Fast Multiscale Fluid Flow Modeling
por: Armegioiu, Victor, et al.
Publicado: (2025)

COSMOS: A Hybrid Adaptive Optimizer for Memory-Efficient Training of LLMs
por: Liu, Liming, et al.
Publicado: (2025)

Accelerating TinyML Inference on Microcontrollers through Approximate Kernels
por: Armeniakos, Giorgos, et al.
Publicado: (2024)

Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
por: Barrak, Amine, et al.
Publicado: (2025)

Applied Causal Inference Powered by ML and AI
por: Chernozhukov, Victor, et al.
Publicado: (2024)

FastAV: Efficient Token Pruning for Audio-Visual Large Language Model Inference
por: Jung, Chaeyoung, et al.
Publicado: (2026)

A Memory Efficient Randomized Subspace Optimization Method for Training Large Language Models
por: Chen, Yiming, et al.
Publicado: (2025)

FlashSampling: Fast and Memory-Efficient Exact Sampling
por: Ruiz, Tomas, et al.
Publicado: (2026)

FERMI-ML: A Flexible and Resource-Efficient Memory-In-Situ SRAM Macro for TinyML acceleration
por: Lokhande, Mukul, et al.
Publicado: (2025)

Fast-PGM: Fast Probabilistic Graphical Model Learning and Inference
por: Jiang, Jiantong, et al.
Publicado: (2024)

Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction
por: Kim, Jang-Hyun, et al.
Publicado: (2026)

FlashOptim: Optimizers for Memory-Efficient Training
por: Ortiz, Jose Javier Gonzalez, et al.
Publicado: (2026)

Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines
por: Chang, Chaokun, et al.
Publicado: (2024)

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
por: Luo, Cheng, et al.
Publicado: (2025)

Fast Inference with Kronecker-Sparse Matrices
por: Gonon, Antoine, et al.
Publicado: (2024)

Impact of ML Optimization Tactics on Greener Pre-Trained ML Models
por: Álvarez, Alexandra González, et al.
Publicado: (2024)

FRUGAL: Memory-Efficient Optimization by Reducing State Overhead for Scalable Training
por: Zmushko, Philip, et al.
Publicado: (2024)

Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
por: He, Xiaoyu, et al.
Publicado: (2025)

MISA: Memory-Efficient LLMs Optimization with Module-wise Importance Sampling
por: Liu, Yuxi, et al.
Publicado: (2025)

Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference
por: Mavromatis, Ioannis, et al.
Publicado: (2024)

vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs
por: Zheng, Size, et al.
Publicado: (2024)

SERFLOW: A Cross-Service Cost Optimization Framework for SLO-Aware Dynamic ML Inference
por: Zhang, Zongshun, et al.
Publicado: (2025)

InferF: Declarative Factorization of AI/ML Inferences over Joins
por: Chowdhury, Kanchan, et al.
Publicado: (2025)

FDC: Fast KV Dimensionality Compression for Efficient LLM Inference
por: Zhang, Zeyu, et al.
Publicado: (2024)