Cover Image

GoEX: Perspectives and Designs Towards a Runtime for Autonomous LLM Applications

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Patil, Shishir G., Zhang, Tianjun, Fang, Vivian, C., Noppapon, Huang, Roy, Hao, Aaron, Casado, Martin, Gonzalez, Joseph E., Popa, Raluca Ada, Stoica, Ion
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MPC-Minimized Secure LLM Inference
by: Rathee, Deevashwer, et al.
Published: (2024)

MemGPT: Towards LLMs as Operating Systems
by: Packer, Charles, et al.
Published: (2023)

MiniScope: A Least Privilege Framework for Authorizing Tool Calling Agents
by: Zhu, Jinhao, et al.
Published: (2025)

LLoCO: Learning Long Contexts Offline
by: Tan, Sijun, et al.
Published: (2024)

RAFT: Adapting Language Model to Domain Specific RAG
by: Zhang, Tianjun, et al.
Published: (2024)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
by: Tan, Sijun, et al.
Published: (2024)

Semantic-Aware Parsing for Security Logs
by: Piet, Julien, et al.
Published: (2025)

Budget-aware Test-time Scaling via Discriminative Verification
by: Montgomery, Kyle, et al.
Published: (2025)

Some Present-Day Problems of Romanian Library Science
by: Stoica, Ion
Published: (1973)

The Central University Library, Bucharest. Over Seventy-five Years in the History of a Collection
by: Stoica, Ion
Published: (1972)

K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
by: Cao, Shiyi, et al.
Published: (2026)

Specifications: The missing link to making the development of LLM systems an engineering discipline
by: Stoica, Ion, et al.
Published: (2024)

Managing Bandwidth: The Key to Cloud-Assisted Autonomous Driving
by: Krentsel, Alexander, et al.
Published: (2024)

Towards Efficient and Practical GPU Multitasking in the Era of LLM
by: Xing, Jiarong, et al.
Published: (2025)

Opal: Private Memory for Personal AI
by: Kaviani, Darya, et al.
Published: (2026)

Membrane: A Cryptographic Access Control System for Data Lakes
by: Kumar, Sam, et al.
Published: (2025)

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
by: Fu, Yichao, et al.
Published: (2024)

Revisiting Cache Freshness for Emerging Real-Time Applications
by: Mao, Ziming, et al.
Published: (2024)

A Framework for Evaluating Emerging Cyberattack Capabilities of AI
by: Rodriguez, Mikel, et al.
Published: (2025)

Autellix: An Efficient Serving Engine for LLM Agents as General Programs
by: Luo, Michael, et al.
Published: (2025)

A Statistical Framework for Ranking LLM-Based Chatbots
by: Ameli, Siavash, et al.
Published: (2024)

TURBO: Utility-Aware Bandwidth Allocation for Cloud-Augmented Autonomous Control
by: Schafhalter, Peter, et al.
Published: (2025)

Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test
by: Zhu, Xiaoyuan, et al.
Published: (2025)

Pie: Pooling CPU Memory for LLM Inference
by: Xu, Yi, et al.
Published: (2024)

Hidden Thoughts Are Not Secret: Reasoning Trace Exposure in LLMs
by: Lu, Yu-An, et al.
Published: (2026)

Onyx: Cost-Efficient Disk-Oblivious ANN Search
by: Rathee, Deevashwer, et al.
Published: (2026)

Proof of Sampling: A Nash Equilibrium-Based Verification Protocol for Decentralized Systems
by: Zhang, Yue, et al.
Published: (2024)

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference
by: Jiang, Xuanlin, et al.
Published: (2024)

Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems
by: Chen, Lingjiao, et al.
Published: (2024)

Copilot Arena: A Platform for Code LLM Evaluation in the Wild
by: Chi, Wayne, et al.
Published: (2025)

LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!
by: Li, Dacheng, et al.
Published: (2025)

M$^2$RNN: Non-Linear RNNs with Matrix-Valued States for Scalable Language Modeling
by: Mishra, Mayank, et al.
Published: (2026)

Efficient LLM Scheduling by Learning to Rank
by: Fu, Yichao, et al.
Published: (2024)

GradShield: Alignment Preserving Finetuning
by: Hu, Zhanhao, et al.
Published: (2026)

Post-Training Sparse Attention with Double Sparsity
by: Yang, Shuo, et al.
Published: (2024)

Web Agents Should Adopt the Plan-Then-Execute Paradigm
by: Piet, Julien, et al.
Published: (2026)

Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection
by: Park, Jongseok, et al.
Published: (2026)

RouteLLM: Learning to Route LLMs with Preference Data
by: Ong, Isaac, et al.
Published: (2024)

RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics
by: Sela, Gur-Eyal, et al.
Published: (2025)

Foundry: Template-Based CUDA Graph Context Materialization for Fast LLM Serving Cold Start
by: Liu, Xueshen, et al.
Published: (2026)