Image de couverture de livre

Incremental Sentence Processing Mechanisms in Autoregressive Transformer Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Hanna, Michael, Mueller, Aaron
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Disjoint Processing Mechanisms of Hierarchical and Linear Grammars in Large Language Models
par: Sankaranarayanan, Aruna, et autres
Publié: (2025)

SONAR-LLM: Autoregressive Transformer that Thinks in Sentence Embeddings and Speaks in Tokens
par: Dragunov, Nikita, et autres
Publié: (2025)

Modeling Bilingual Sentence Processing: Evaluating RNN and Transformer Architectures for Cross-Language Structural Priming
par: Zhang, Demi, et autres
Publié: (2024)

Incremental Comprehension of Garden-Path Sentences by Large Language Models: Semantic Interpretation, Syntactic Re-Analysis, and Attention
par: Li, Andrew, et autres
Publié: (2024)

Dual Alignment Between Language Model Layers and Human Sentence Processing
par: Kuribayashi, Tatsuki, et autres
Publié: (2026)

Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU
par: Kahardipraja, Patrick, et autres
Publié: (2021)

Characterizing the Role of Similarity in the Property Inferences of Language Models
par: Rodriguez, Juan Diego, et autres
Publié: (2024)

Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models
par: He, Liyang, et autres
Publié: (2025)

Comparing Human and Language Models Sentence Processing Difficulties on Complex Structures
par: Amouyal, Samuel Joseph, et autres
Publié: (2025)

Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages
par: Brinkmann, Jannik, et autres
Publié: (2025)

Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU
par: Madureira, Brielen, et autres
Publié: (2020)

Sentence Curve Language Models
par: Heo, DongNyeong, et autres
Publié: (2026)

Think in Sentences: Explicit Sentence Boundaries Enhance Language Model's Capabilities
par: Liu, Zhichen, et autres
Publié: (2026)

Hierarchical Autoregressive Transformers: Combining Byte- and Word-Level Processing for Robust, Adaptable Language Models
par: Neitemeier, Pit, et autres
Publié: (2025)

Diverging Transformer Predictions for Human Sentence Processing: A Comprehensive Analysis of Agreement Attraction Effects
par: von der Malsburg, Titus, et autres
Publié: (2026)

Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networks
par: Mueller, Aaron
Publié: (2024)

Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows
par: Zhang, Ruixiang, et autres
Publié: (2025)

On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models
par: Wijesiriwardene, Thilini, et autres
Publié: (2023)

Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars
par: Yoshida, Ryo, et autres
Publié: (2021)

Large Concept Models: Language Modeling in a Sentence Representation Space
par: LCM team, et autres
Publié: (2024)

Causal Autoregressive Diffusion Language Model
par: Ruan, Junhao, et autres
Publié: (2026)

Reversal Invariance in Autoregressive Language Models
par: Sahasrabudhe, Mihir
Publié: (2025)

Neurocomputational Mechanisms of Syntactic Transfer in Bilingual Sentence Production
par: Uluslu, Ahmet Yavuz, et autres
Publié: (2026)

Leveraging Large Language Models for Comparative Literature Summarization with Reflective Incremental Mechanisms
par: Garcia, Fernando Gabriela, et autres
Publié: (2024)

Simple Techniques for Enhancing Sentence Embeddings in Generative Language Models
par: Zhang, Bowen, et autres
Publié: (2024)

Tiny Transformers Excel at Sentence Compression
par: Belcak, Peter, et autres
Publié: (2024)

Measuring Mechanistic Independence: Can Bias Be Removed Without Erasing Demographics?
par: Shan, Zhengyang, et autres
Publié: (2025)

Comateformer: Combined Attention Transformer for Semantic Sentence Matching
par: Li, Bo, et autres
Publié: (2024)

Generating Completions for Broca's Aphasic Sentences Using Large Language Models
par: van Vaals, Sijbren, et autres
Publié: (2024)

Multi-label Sequential Sentence Classification via Large Language Model
par: Lan, Mengfei, et autres
Publié: (2024)

SentGuard: Sentence-Level Streaming Guardrails for Large Language Models
par: Yu, Jiaqi, et autres
Publié: (2026)

Revisiting Knowledge Distillation for Autoregressive Language Models
par: Zhong, Qihuang, et autres
Publié: (2024)

Autoregressive Large Language Models are Computationally Universal
par: Schuurmans, Dale, et autres
Publié: (2024)

Top-b: Entropic Regulation of Relative Probability Bands in Autoregressive Language Processes
par: Halder, Deepon, et autres
Publié: (2026)

Process Reward Models for Sentence-Level Verification of LVLM Radiology Reports
par: Thomas, Alois, et autres
Publié: (2025)

Combining Discrete Wavelet and Cosine Transforms for Efficient Sentence Embedding
par: Salama, Rana, et autres
Publié: (2025)

Reconsidering Sentence-Level Sign Language Translation
par: Tanzer, Garrett, et autres
Publié: (2024)

Probability Distributions Computed by Autoregressive Transformers
par: Yang, Andy, et autres
Publié: (2025)

Sign Language Translation with Sentence Embedding Supervision
par: Hamidullah, Yasser, et autres
Publié: (2025)

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
par: Lee, Hanna, et autres
Publié: (2026)