Cover Image

Block Transformer: Global-to-Local Language Modeling for Fast Inference

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ho, Namgyu, Bae, Sangmin, Kim, Taehyeon, Jo, Hyunjik, Kim, Yireun, Schuster, Tal, Fisch, Adam, Thorne, James, Yun, Se-Young
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
by: Bae, Sangmin, et al.
Published: (2024)

Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models
by: Kim, Yujin, et al.
Published: (2023)

Revisiting Early-Learning Regularization When Federated Learning Meets Noisy Labels
by: Kim, Taehyeon, et al.
Published: (2024)

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation
by: Bae, Sangmin, et al.
Published: (2025)

Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters
by: Yi, Euiin, et al.
Published: (2024)

Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy Instructions
by: Kim, Taehyeon, et al.
Published: (2023)

Multi-Drafter Speculative Decoding with Alignment Feedback
by: Kim, Taehyeon, et al.
Published: (2026)

Self-Training Elicits Concise Reasoning in Large Language Models
by: Munkhbat, Tergel, et al.
Published: (2025)

Guiding Reasoning in Small Language Models with LLM Assistance
by: Kim, Yujin, et al.
Published: (2025)

Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition
by: Kim, Sungnyun, et al.
Published: (2024)

Fine-tuned In-Context Learning Transformers are Excellent Tabular Data Classifiers
by: Breejen, Felix den, et al.
Published: (2024)

VACoDe: Visual Augmented Contrastive Decoding
by: Kim, Sihyeon, et al.
Published: (2024)

MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition
by: Kim, Sungnyun, et al.
Published: (2025)

Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation
by: Kim, Sungnyun, et al.
Published: (2025)

Accelerating Large Language Model Inference via Early-Exiting Algorithms
by: Bae, Sangmin
Published: (2025)

Temporal Alignment Guidance: On-Manifold Sampling in Diffusion Models
by: Park, Youngrok, et al.
Published: (2025)

MERIT Feedback Elicits Better Bargaining in LLM Negotiators
by: Oh, Jihwan, et al.
Published: (2026)

Conformal Language Modeling
by: Quach, Victor, et al.
Published: (2023)

Hypernetwork-Driven Model Fusion for Federated Domain Generalization
by: Bartholet, Marc, et al.
Published: (2024)

Design-based Causal Inference for Incomplete Block Designs
by: Koo, Taehyeon, et al.
Published: (2024)

Automated Filtering of Human Feedback Data for Aligning Text-to-Image Diffusion Models
by: Yang, Yongjin, et al.
Published: (2024)

KLASS: KL-Guided Fast Inference in Masked Diffusion Models
by: Kim, Seo Hyun, et al.
Published: (2025)

RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classification
by: Kim, June-Woo, et al.
Published: (2024)

Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification
by: Bae, Sangmin, et al.
Published: (2023)

Stable Language Model Pre-training by Reducing Embedding Variability
by: Chung, Woojin, et al.
Published: (2024)

Conformal Risk Control
by: Angelopoulos, Anastasios N., et al.
Published: (2022)

Accurate Sublayer Pruning for Large Language Models by Exploiting Latency and Tunability Information
by: Park, Seungcheol, et al.
Published: (2025)

Epistemology of Language Models: Do Language Models Have Holistic Knowledge?
by: Kim, Minsu, et al.
Published: (2024)

Fast Inference via Hierarchical Speculative Decoding
by: Mohri, Clara, et al.
Published: (2025)

Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortion
by: Ballé, Jona, et al.
Published: (2024)

Adversarial Bandits against Arbitrary Strategies
by: Kim, Jung-hun, et al.
Published: (2022)

Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance
by: Kim, Sunkyoung, et al.
Published: (2023)

Beyond Single-User Dialogue: Assessing Multi-User Dialogue State Tracking Capabilities of Large Language Models
by: Song, Sangmin, et al.
Published: (2025)

Revisiting Instance-Optimal Cluster Recovery in the Labeled Stochastic Block Model
by: Ariu, Kaito, et al.
Published: (2023)

AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasoners
by: Koh, Woosung, et al.
Published: (2025)

DistiLLM: Towards Streamlined Distillation for Large Language Models
by: Ko, Jongwoo, et al.
Published: (2024)

From Evidence to Belief: A Bayesian Epistemology Approach to Language Models
by: Kim, Minsu, et al.
Published: (2025)

FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning
by: Kim, Seongyoon, et al.
Published: (2024)

Ponderomotive barriers in rotating mirror devices using static fields
by: Rubin, Tal, et al.
Published: (2025)

Semantic Layering in Room Segmentation via LLMs
by: Kim, Taehyeon, et al.
Published: (2024)