Image de couverture de livre

Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Michaelov, James A., Arnett, Catherine, Bergen, Benjamin K.
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On the Acquisition of Shared Grammatical Representations in Bilingual Language Models
par: Arnett, Catherine, et autres
Publié: (2025)

Disaggregation Reveals Hidden Training Dynamics: The Case of Agreement Attraction
par: Michaelov, James A., et autres
Publié: (2025)

Emergent inabilities? Inverse scaling over the course of pretraining
par: Michaelov, James A., et autres
Publié: (2023)

Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale
par: Michaelov, James A., et autres
Publié: (2025)

Why do language models perform worse for morphologically complex languages?
par: Arnett, Catherine, et autres
Publié: (2024)

Goldfish: Monolingual Language Models for 350 Languages
par: Chang, Tyler A., et autres
Publié: (2024)

A Bit of a Problem: Measurement Disparities in Dataset Sizes Across Languages
par: Arnett, Catherine, et autres
Publié: (2024)

Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events
par: Michaelov, James A., et autres
Publié: (2025)

N-gram-like Language Models Predict Reading Time Best
par: Michaelov, James A., et autres
Publié: (2026)

How Open Must Language Models be to Enable Reliable Scientific Inference?
par: Michaelov, James A., et autres
Publié: (2026)

Explaining and Mitigating Crosslingual Tokenizer Inequities
par: Arnett, Catherine, et autres
Publié: (2025)

Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models
par: Chang, Tyler A., et autres
Publié: (2025)

Do Large Language Models Exhibit Spontaneous Rational Deception?
par: Taylor, Samuel M., et autres
Publié: (2025)

Large Language Models Pass the Turing Test
par: Jones, Cameron R., et autres
Publié: (2025)

Characterizing Learning Curves During Language Model Pre-Training: Learning, Forgetting, and Stability
par: Chang, Tyler A., et autres
Publié: (2023)

BPE Stays on SCRIPT: Structured Encoding for Robust Multilingual Pretokenization
par: Land, Sander, et autres
Publié: (2025)

Evaluating Morphological Alignment of Tokenizers in 70 Languages
par: Arnett, Catherine, et autres
Publié: (2025)

Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models
par: Jones, Cameron R., et autres
Publié: (2024)

Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs
par: Trott, Sean, et autres
Publié: (2026)

Computational Sentence-level Metrics Predicting Human Sentence Comprehension
par: Sun, Kun, et autres
Publié: (2024)

EVOKE: Emotion Vocabulary Of Korean and English
par: Jung, Yoonwon, et autres
Publié: (2026)

Does GPT-4 pass the Turing test?
par: Jones, Cameron R., et autres
Publié: (2023)

Intra-Layer Recurrence in Transformers for Language Modeling
par: Nguyen, Anthony, et autres
Publié: (2025)

Weight Tying Biases Token Embeddings Towards the Output Space
par: Lopardo, Antonio, et autres
Publié: (2026)

Autoregressive + Chain of Thought = Recurrent: Recurrence's Role in Language Models' Computability and a Revisit of Recurrent Transformer
par: Zhang, Xiang, et autres
Publié: (2024)

Different Tokenization Schemes Lead to Comparable Performance in Spanish Number Agreement
par: Arnett, Catherine, et autres
Publié: (2024)

BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training
par: Chizhov, Pavel, et autres
Publié: (2024)

Diverging Transformer Predictions for Human Sentence Processing: A Comprehensive Analysis of Agreement Attraction Effects
par: von der Malsburg, Titus, et autres
Publié: (2026)

Will Large Language Models Transform Clinical Prediction?
par: Yildiz, Yusuf, et autres
Publié: (2025)

Dissecting the Ullman Variations with a SCALPEL: Why do LLMs fail at Trivial Alterations to the False Belief Task?
par: Pi, Zhiqiang, et autres
Publié: (2024)

Toxicity of the Commons: Curating Open-Source Pre-Training Data
par: Arnett, Catherine, et autres
Publié: (2024)

GPT-4 is judged more human than humans in displaced and inverted Turing tests
par: Rathi, Ishika, et autres
Publié: (2024)

A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
par: Cao, Zhihan, et autres
Publié: (2024)

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
par: Botev, Aleksandar, et autres
Publié: (2024)

Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study
par: Faria, Fatema Tuj Johora, et autres
Publié: (2024)

Can Large Language Models Match the Conclusions of Systematic Reviews?
par: Polzak, Christopher, et autres
Publié: (2025)

Lower Bounds on the Expressivity of Recurrent Neural Language Models
par: Svete, Anej, et autres
Publié: (2024)

Leveraging Large Language Models for Predictive Analysis of Human Misery
par: Seal, Bishanka, et autres
Publié: (2025)

Re-defining Humor Data Objects for AI Humor Research
par: Arnett, Anna, et autres
Publié: (2026)

Comprehensiveness Metrics for Automatic Evaluation of Factual Recall in Text Generation
par: Dejl, Adam, et autres
Publié: (2025)