:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Zou, Longwei, Wang, Qingyang, Zhao, Han, Kong, Jiangang, Yang, Yi, Deng, Yangdong
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	https://arxiv.org/abs/2404.06709
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

InstCache: A Predictive Cache for LLM Serving
by: Zou, Longwei, et al.
Published: (2024)

A Multi-Level Framework for Accelerating Training Transformer Models
by: Zou, Longwei, et al.
Published: (2024)

Detecting AI-Generated Essays in Writing Assessment: Responsible Use and Generalizability Across LLMs
by: Hao, Jiangang
Published: (2026)

Scaling LLM Inference with Optimized Sample Compute Allocation
by: Zhang, Kexun, et al.
Published: (2024)

Quasi-stratified Order Semantics of Concurrency
by: Koutny, Maciej, et al.
Published: (2024)

Probabilistic Concurrent Reasoning in Outcome Logic: Independence, Conditioning, and Invariants
by: Zilberstein, Noam, et al.
Published: (2024)

HyLRA: Hybrid Layer Reuse Attention for Efficient Long-Context Inference
by: Ai, Xuan, et al.
Published: (2026)

Slang Context-based Inference Enhancement via Greedy Search-Guided Chain-of-Thought Prompting
by: Cao, Jinghan, et al.
Published: (2026)

Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification
by: Li, Qingyang
Published: (2026)

LIONs: An Empirically Optimized Approach to Align Language Models
by: Yu, Xiao, et al.
Published: (2024)

Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
by: Rodionov, Gleb, et al.
Published: (2025)

Acting Flatterers via LLMs Sycophancy: Combating Clickbait with LLMs Opposing-Stance Reasoning
by: Zhang, Chaowei, et al.
Published: (2026)

Prompt Cache: Modular Attention Reuse for Low-Latency Inference
by: Gim, In, et al.
Published: (2023)

Latent Thought Models with Variational Bayes Inference-Time Computation
by: Kong, Deqian, et al.
Published: (2025)

EmoVerse: Exploring Multimodal Large Language Models for Sentiment and Emotion Understanding
by: Li, Ao, et al.
Published: (2024)

LiteStage: Latency-aware Layer Skipping for Multi-stage Reasoning
by: Kang, Beomseok, et al.
Published: (2025)

Not All Layers of LLMs Are Necessary During Inference
by: Fan, Siqi, et al.
Published: (2024)

Test Security in Remote Testing Age: Perspectives from Process Data Analytics and AI
by: Hao, Jiangang, et al.
Published: (2024)

Latency and Token-Aware Test-Time Compute
by: Huang, Jenny Y., et al.
Published: (2025)

Predictive Pipelined Decoding: A Compute-Latency Trade-off for Exact LLM Decoding
by: Yang, Seongjun, et al.
Published: (2023)

Expanding Computation Spaces of LLMs at Inference Time
by: Jang, Yoonna, et al.
Published: (2025)

Inference Computation Scaling for Feature Augmentation in Recommendation Systems
by: Liu, Weihao, et al.
Published: (2025)

MemoryFormer: Minimize Transformer Computation by Removing Fully-Connected Layers
by: Ding, Ning, et al.
Published: (2024)

Consecutive Batch Model Editing with HooK Layers
by: Li, Shuaiyi, et al.
Published: (2024)

AI-generated Essays: Characteristics and Implications on Automated Scoring and Academic Integrity
by: Zhong, Yang, et al.
Published: (2024)

TSO: Self-Training with Scaled Preference Optimization
by: Chen, Kaihui, et al.
Published: (2024)

Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
by: Husom, Erik Johannes, et al.
Published: (2025)

KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing
by: Yang, Yifei, et al.
Published: (2024)

Inference Compute-Optimal Video Vision Language Models
by: Wang, Peiqi, et al.
Published: (2025)

Inference Time Optimization with Confidence Dynamics
by: Wang, Yu, et al.
Published: (2026)

Investigating the Synergistic Effects of Dropout and Residual Connections on Language Model Training
by: Li, Qingyang, et al.
Published: (2024)

MoBiLE: Efficient Mixture-of-Experts Inference on Consumer GPU with Mixture of Big Little Experts
by: Zhao, Yushu, et al.
Published: (2025)

GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework
by: Zou, Xuecheng, et al.
Published: (2025)

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization
by: Zhang, Yi, et al.
Published: (2024)

CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation
by: Xu, Xi, et al.
Published: (2024)

Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency
by: Li, Ruixiao, et al.
Published: (2025)

A Forward Simulation-Based Hierarchy of Linearizable Concurrent Objects
by: Wang, Chao, et al.
Published: (2026)

Optimizing Speech-Input Length for Speaker-Independent Depression Classification
by: Rutowski, Tomasz, et al.
Published: (2024)

DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies
by: Yang, Ning, et al.
Published: (2025)

A Benchmark Dataset and a Framework for Urdu Multimodal Named Entity Recognition
by: Ahmad, Hussain, et al.
Published: (2025)