Saved in:
| Main Authors: | Ruan, Charlie F., Qin, Yucheng, Parthasarathy, Akaash R., Zhou, Xun, Lai, Ruihang, Jin, Hongyi, Dong, Yixin, Hou, Bohan, Yu, Meng-Shiun, Zhai, Yiyan, Agarwal, Sudeep, Cao, Hangrui, Feng, Siyuan, Chen, Tianqi |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.15803 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
by: Dong, Yixin, et al.
Published: (2024)
by: Dong, Yixin, et al.
Published: (2024)
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
by: Ye, Zihao, et al.
Published: (2025)
by: Ye, Zihao, et al.
Published: (2025)
Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debugging
by: Feng, Siyuan, et al.
Published: (2024)
by: Feng, Siyuan, et al.
Published: (2024)
PithTrain: A Compact and Agent-Native MoE Training System
by: Lai, Ruihang, et al.
Published: (2026)
by: Lai, Ruihang, et al.
Published: (2026)
A System for Microserving of LLMs
by: Jin, Hongyi, et al.
Published: (2024)
by: Jin, Hongyi, et al.
Published: (2024)
FlashInfer-Bench: Building the Virtuous Cycle for AI-driven LLM Systems
by: Xing, Shanli, et al.
Published: (2026)
by: Xing, Shanli, et al.
Published: (2026)
Axe: A Simple Unified Layout Abstraction for Machine Learning Compilers
by: Hou, Bohan, et al.
Published: (2026)
by: Hou, Bohan, et al.
Published: (2026)
Local deployment of large-scale music AI models on commodity hardware
by: Zhou, Xun, et al.
Published: (2024)
by: Zhou, Xun, et al.
Published: (2024)
Anatomizing Deep Learning Inference in Web Browsers
by: Wang, Qipeng, et al.
Published: (2024)
by: Wang, Qipeng, et al.
Published: (2024)
BrowserArena: Evaluating LLM Agents on Real-World Web Navigation Tasks
by: Anupam, Sagnik, et al.
Published: (2025)
by: Anupam, Sagnik, et al.
Published: (2025)
Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
by: Maczan, Jędrzej
Published: (2026)
by: Maczan, Jędrzej
Published: (2026)
Biotic Browser: Applying StreamingLLM as a Persistent Web Browsing Co-Pilot
by: Dunnell, Kevin F., et al.
Published: (2024)
by: Dunnell, Kevin F., et al.
Published: (2024)
Client-Side Zero-Shot LLM Inference for Comprehensive In-Browser URL Analysis
by: Cohen, Avihay
Published: (2025)
by: Cohen, Avihay
Published: (2025)
RTP-LLM: High-Performance Alibaba LLM Inference Engine
by: Tan, Boyu, et al.
Published: (2026)
by: Tan, Boyu, et al.
Published: (2026)
EvolKV: Evolutionary KV Cache Compression for LLM Inference
by: Yu, Bohan, et al.
Published: (2025)
by: Yu, Bohan, et al.
Published: (2025)
Causal Inference for Human-Language Model Collaboration
by: Zhang, Bohan, et al.
Published: (2024)
by: Zhang, Bohan, et al.
Published: (2024)
In-Browser LLM-Guided Fuzzing for Real-Time Prompt Injection Testing in Agentic AI Browsers
by: Cohen, Avihay
Published: (2025)
by: Cohen, Avihay
Published: (2025)
ExaCraft: Dynamic Learning Context Adaptation for Personalized Educational Examples
by: Chatterjee, Akaash, et al.
Published: (2025)
by: Chatterjee, Akaash, et al.
Published: (2025)
A First Look at Bugs in LLM Inference Engines
by: Liu, Mugeng, et al.
Published: (2025)
by: Liu, Mugeng, et al.
Published: (2025)
Browser Fingerprinting Using WebAssembly
by: Guri, Mordechai, et al.
Published: (2025)
by: Guri, Mordechai, et al.
Published: (2025)
SCOOT: SLO-Oriented Performance Tuning for LLM Inference Engines
by: Cheng, Ke, et al.
Published: (2024)
by: Cheng, Ke, et al.
Published: (2024)
The BrowserGym Ecosystem for Web Agent Research
by: De Chezelles, Thibault Le Sellier, et al.
Published: (2024)
by: De Chezelles, Thibault Le Sellier, et al.
Published: (2024)
WAAA! Web Adversaries Against Agentic Browsers
by: Datta, Sohom, et al.
Published: (2026)
by: Datta, Sohom, et al.
Published: (2026)
User Profiles: The Achilles' Heel of Web Browsers
by: Somé, Dolière Francis, et al.
Published: (2025)
by: Somé, Dolière Francis, et al.
Published: (2025)
XGrammar-2: Efficient Dynamic Structured Generation Engine for Agentic LLMs
by: Li, Linzhang, et al.
Published: (2026)
by: Li, Linzhang, et al.
Published: (2026)
Research on Multi-hop Inference Optimization of LLM Based on MQUAKE Framework
by: Liang, Zucheng, et al.
Published: (2025)
by: Liang, Zucheng, et al.
Published: (2025)
Blackbox Dataset Inference for LLM
by: Zhou, Ruikai, et al.
Published: (2025)
by: Zhou, Ruikai, et al.
Published: (2025)
TIDE: Temporal Incremental Draft Engine for Self-Improving LLM Inference
by: Park, Jiyoung, et al.
Published: (2026)
by: Park, Jiyoung, et al.
Published: (2026)
Orion: Characterizing and Programming Apple's Neural Engine for LLM Training and Inference
by: Kumaresan, Ramchand
Published: (2026)
by: Kumaresan, Ramchand
Published: (2026)
SiPipe: Bridging the CPU-GPU Utilization Gap for Efficient Pipeline-Parallel LLM Inference
by: He, Yongchao, et al.
Published: (2025)
by: He, Yongchao, et al.
Published: (2025)
SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?
by: Shi, Yucheng, et al.
Published: (2025)
by: Shi, Yucheng, et al.
Published: (2025)
Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
by: Fu, Tianyu, et al.
Published: (2024)
by: Fu, Tianyu, et al.
Published: (2024)
SparQ Attention: Bandwidth-Efficient LLM Inference
by: Ribar, Luka, et al.
Published: (2023)
by: Ribar, Luka, et al.
Published: (2023)
Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
by: Lugoloobi, William, et al.
Published: (2026)
by: Lugoloobi, William, et al.
Published: (2026)
How Web Browsers Shape Users' Understanding of Networks.
by: Sheeran, Louise, et al.
Published: (2002)
by: Sheeran, Louise, et al.
Published: (2002)
SYMPHONY: Improving Memory Management for LLM Inference Workloads
by: Agarwal, Saurabh, et al.
Published: (2024)
by: Agarwal, Saurabh, et al.
Published: (2024)
SIMPLE: Disaggregating Sampling from GPU Inference into a Decision Plane for Faster Distributed LLM Serving
by: Zhao, Bohan, et al.
Published: (2025)
by: Zhao, Bohan, et al.
Published: (2025)
WebANNS: Fast and Efficient Approximate Nearest Neighbor Search in Web Browsers
by: Liu, Mugeng, et al.
Published: (2025)
by: Liu, Mugeng, et al.
Published: (2025)
BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions
by: Yu, Tao, et al.
Published: (2025)
by: Yu, Tao, et al.
Published: (2025)
Rapid and Accurate Changepoint Detection of Power System Forced Oscillations
by: Dosiek, Luke, et al.
Published: (2025)
by: Dosiek, Luke, et al.
Published: (2025)
Similar Items
-
XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
by: Dong, Yixin, et al.
Published: (2024) -
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
by: Ye, Zihao, et al.
Published: (2025) -
Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debugging
by: Feng, Siyuan, et al.
Published: (2024) -
PithTrain: A Compact and Agent-Native MoE Training System
by: Lai, Ruihang, et al.
Published: (2026) -
A System for Microserving of LLMs
by: Jin, Hongyi, et al.
Published: (2024)