Cover Image

The SMeL Test: A simple benchmark for media literacy in language models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ahdritz, Gustaf, Kleiman, Anat
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Modeling Real-Time Interactive Conversations as Timed Diarized Transcripts
by: Tanzer, Garrett, et al.
Published: (2024)

Distinguishing the Knowable from the Unknowable with Language Models
by: Ahdritz, Gustaf, et al.
Published: (2024)

Anchor function: a type of benchmark functions for studying language models
by: Zhang, Zhongwang, et al.
Published: (2024)

DevBench: A multimodal developmental benchmark for language learning
by: Tan, Alvin Wei Ming, et al.
Published: (2024)

A dataset and benchmark for hospital course summarization with adapted large language models
by: Aali, Asad, et al.
Published: (2024)

BabySLM: language-acquisition-friendly benchmark of self-supervised spoken language models
by: Lavechin, Marvin, et al.
Published: (2023)

Provable Uncertainty Decomposition via Higher-Order Calibration
by: Ahdritz, Gustaf, et al.
Published: (2024)

Perturbation: A simple and efficient adversarial tracer for representation learning in language models
by: Rozner, Joshua, et al.
Published: (2026)

A mean teacher algorithm for unlearning of language models
by: Klochkov, Yegor
Published: (2025)

Aligning language models with human preferences
by: Korbak, Tomasz
Published: (2024)

Evaluating language models as risk scores
by: Cruz, André F., et al.
Published: (2024)

Bridging vision language model (VLM) evaluation gaps with a framework for scalable and cost-effective benchmark generation
by: Rädsch, Tim, et al.
Published: (2025)

Amortizing intractable inference in large language models
by: Hu, Edward J., et al.
Published: (2023)

Visualizing token importance for black-box language models
by: Rauba, Paulius, et al.
Published: (2025)

Perturbed examples reveal invariances shared by language models
by: Rawal, Ruchit, et al.
Published: (2023)

Do language models plan ahead for future tokens?
by: Wu, Wilson, et al.
Published: (2024)

The language of time: a language model perspective on time-series foundation models
by: Xie, Yi, et al.
Published: (2025)

Prompt reinforcing for long-term planning of large language models
by: Lin, Hsien-Chin, et al.
Published: (2025)

Machine-generated text detection prevents language model collapse
by: Drayson, George, et al.
Published: (2025)

Zero-shot generation of synthetic neurosurgical data with large language models
by: Barr, Austin A., et al.
Published: (2025)

Repetitions are not all alike: distinct mechanisms sustain repetition in language models
by: Mahaut, Matéo, et al.
Published: (2025)

How do language models learn facts? Dynamics, curricula and hallucinations
by: Zucchet, Nicolas, et al.
Published: (2025)

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
by: Raposo, David, et al.
Published: (2024)

Only relative ranks matter in weight-clustered large language models
by: Aizpurua, Borja, et al.
Published: (2026)

Simple linear attention language models balance the recall-throughput tradeoff
by: Arora, Simran, et al.
Published: (2024)

Just read twice: closing the recall gap for recurrent language models
by: Arora, Simran, et al.
Published: (2024)

A comparative study of zero-shot inference with large language models and supervised modeling in breast cancer pathology classification
by: Sushil, Madhumita, et al.
Published: (2024)

Representation in large language models
by: Yetman, Cameron
Published: (2025)

B-score: Detecting biases in large language models using response history
by: Vo, An, et al.
Published: (2025)

Leveraging large language models for structured information extraction from pathology reports
by: Balasubramanian, Jeya Balaji, et al.
Published: (2025)

ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography
by: Ahrens, Lara, et al.
Published: (2025)

Question answering system of bridge design specification based on large language model
by: Zhang, Leye, et al.
Published: (2024)

Linear representations in language models can change dramatically over a conversation
by: Lampinen, Andrew Kyle, et al.
Published: (2026)

DataComp-LM: In search of the next generation of training sets for language models
by: Li, Jeffrey, et al.
Published: (2024)

The representation landscape of few-shot learning and fine-tuning in large language models
by: Doimo, Diego, et al.
Published: (2024)

BEARCUBS: A benchmark for computer-using web agents
by: Song, Yixiao, et al.
Published: (2025)

Bridging Online Behavior and Clinical Insight: A Longitudinal LLM-based Study of Suicidality on YouTube Reveals Novel Digital Markers
by: Sobol, Ilanit, et al.
Published: (2025)

Auditing language models for hidden objectives
by: Marks, Samuel, et al.
Published: (2025)

Alignment faking in large language models
by: Greenblatt, Ryan, et al.
Published: (2024)

Lightweight reranking for language model generations
by: Jain, Siddhartha, et al.
Published: (2023)