Copertina

Asymmetric Virtual Memory Paging for Hybrid Mamba-Transformer Inference

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Nguyen, An Xuan
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing Performance D.4.2; B.3.2
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Predictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU Inference
di: Ganjihal, Sanjeev Rao
Pubblicazione: (2026)

DDS: DPU-optimized Disaggregated Storage [Extended Report]
di: Zhang, Qizhen, et al.
Pubblicazione: (2024)

Sky$^ε$-Tree: Embracing the Batch Updates of B$^ε$-trees through Access Port Parallelism on Skyrmion Racetrack Memory
di: Tsai, Yu-Shiang, et al.
Pubblicazione: (2024)

Reexamining Paradigms of End-to-End Data Movement
di: Fang, Chin, et al.
Pubblicazione: (2025)

SLO-Guard: Crash-Aware, Budget-Consistent Autotuning for SLO-Constrained LLM Serving
di: Lysenstøen, Christian
Pubblicazione: (2026)

Flexible Swapping for the Cloud
di: Pandurov, Milan, et al.
Pubblicazione: (2024)

Vectorized Adaptive Histograms for Sparse Oblique Forests
di: Lubonja, Ariel, et al.
Pubblicazione: (2026)

Reproduction Research of FSA-Benchmark
di: Ludolf, Joshua, et al.
Pubblicazione: (2024)

Intelligent Cloud Orchestration: A Hybrid Predictive and Heuristic Framework for Cost Optimization
di: Nagoriya, Heet, et al.
Pubblicazione: (2026)

Cost-Aware Logging: Measuring the Financial Impact of Excessive Log Retention in Small-Scale Cloud Deployments
di: Putra, Jody Almaida
Pubblicazione: (2026)

TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
di: Bian, Zhuohang, et al.
Pubblicazione: (2025)

Comparative Analysis of Large Language Model Inference Serving Systems: A Performance Study of vLLM and HuggingFace TGI
di: Kolluru, Saicharan
Pubblicazione: (2025)

DF* PageRank: Improved Incrementally Expanding Approaches for Updating PageRank on Dynamic Graphs
di: Sahu, Subhajit
Pubblicazione: (2024)

Polynomial Histograms for Memory-Efficient Representation of Long-tailed System Distributions
di: Stokely, Murray, et al.
Pubblicazione: (2026)

Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly
di: Woisetschläger, Herbert, et al.
Pubblicazione: (2023)

DNA sequence alignment: An assignment for OpenMP, MPI, and CUDA/OpenCL
di: Gonzalez-Escribano, Arturo, et al.
Pubblicazione: (2024)

Send: Objects, History, and Transactions in a Single-Verb Kernel
di: Goes, Christopher
Pubblicazione: (2026)

cfdSCOPE: A Fluid-Dynamics Proxy App for Teaching Performance Engineering
di: Arzt, Peter, et al.
Pubblicazione: (2025)

Lock-Free Computation of PageRank in Dynamic Graphs
di: Sahu, Subhajit
Pubblicazione: (2024)

Unlocking Python's Cores: Hardware Usage and Energy Implications of Removing the GIL
di: Salazar, José Daniel Montoya
Pubblicazione: (2026)

A Methodology to Assess Power Modeling in Energy-Aware Federated Learning on Heterogeneous Mobile Devices
di: Jallouli, Chaimae, et al.
Pubblicazione: (2026)

Scheduling the Unschedulable: Taming Black-Box LLM Inference at Scale
di: Yuan, Renzhong, et al.
Pubblicazione: (2026)

An Incrementally Expanding Approach for Updating PageRank on Dynamic Graphs
di: Sahu, Subhajit
Pubblicazione: (2024)

TStore: Rethinking AI Model Hub with Tensor-Centric Compression
di: Lan, Tingfeng, et al.
Pubblicazione: (2026)

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference
di: Zhao, Xuanlei, et al.
Pubblicazione: (2024)

Token Arena: A Continuous Benchmark Unifying Energy and Cognition in AI Inference
di: Gao, Yuxuan, et al.
Pubblicazione: (2026)

CoFormer: Collaborating with Heterogeneous Edge Devices for Scalable Transformer Inference
di: Xu, Guanyu, et al.
Pubblicazione: (2025)

PIM-STM: Software Transactional Memory for Processing-In-Memory Systems
di: Lopes, André, et al.
Pubblicazione: (2024)

SGDRC: Software-Defined Dynamic Resource Control for Concurrent DNN Inference on NVIDIA GPUs
di: Zhang, Yongkang, et al.
Pubblicazione: (2024)

Stream parallel skeleton optimization
di: Aldinucci, Marco, et al.
Pubblicazione: (2024)

StreamFlow: cross-breeding cloud with HPC
di: Colonnelli, Iacopo, et al.
Pubblicazione: (2020)

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey
di: Lewis, Noah, et al.
Pubblicazione: (2024)

KVDirect: Distributed Disaggregated LLM Inference
di: Chen, Shiyang, et al.
Pubblicazione: (2024)

Multi-DNN Inference of Sparse Models on Edge SoCs
di: Luo, Jiawei, et al.
Pubblicazione: (2026)

Glinthawk: A Two-Tiered Architecture for Offline LLM Inference
di: Hamadanian, Pouya, et al.
Pubblicazione: (2025)

GVE-Louvain: Fast Louvain Algorithm for Community Detection in Shared Memory Setting
di: Sahu, Subhajit
Pubblicazione: (2023)

GVE-Leiden: Fast Leiden Algorithm for Community Detection in Shared Memory Setting
di: Sahu, Subhajit
Pubblicazione: (2023)

Libra: Unleashing GPU Heterogeneity for High-Performance Sparse Matrix Multiplication
di: Shi, Jinliang, et al.
Pubblicazione: (2025)

IPA: Inference Pipeline Adaptation to Achieve High Accuracy and Cost-Efficiency
di: Ghafouri, Saeid, et al.
Pubblicazione: (2023)

The Energy-Throughput Trade-off in Lossless-Compressed Source Code Storage
di: Ferragina, Paolo, et al.
Pubblicazione: (2026)