Image de couverture de livre

CausalGym: Benchmarking causal interpretability methods on linguistic tasks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Arora, Aryaman, Jurafsky, Dan, Potts, Christopher
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence I.2.7
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mechanistic evaluation of Transformers and state space models
par: Arora, Aryaman, et autres
Publié: (2025)

Bayesian scaling laws for in-context learning
par: Arora, Aryaman, et autres
Publié: (2024)

AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoders
par: Wu, Zhengxuan, et autres
Publié: (2025)

Language Model Circuits Are Sparse in the Neuron Basis
par: Arora, Aryaman, et autres
Publié: (2026)

ADAG: Automatically Describing Attribution Graphs
par: Arora, Aryaman, et autres
Publié: (2026)

RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs
par: Saji, Alan, et autres
Publié: (2025)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
par: Peters, Sydney, et autres
Publié: (2025)

MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models
par: Xu, Jingwei, et autres
Publié: (2024)

Presumed Cultural Identity: How Names Shape LLM Responses
par: Pawar, Siddhesh, et autres
Publié: (2025)

Large-scale cloze evaluation reveals that token prediction tasks are neither lexically nor semantically aligned
par: Jacobs, Cassandra L., et autres
Publié: (2024)

Adaptive Focus Memory for Language Models
par: Cruz, Christopher
Publié: (2025)

Is this Idea Novel? An Automated Benchmark for Judgment of Research Ideas
par: Schopf, Tim, et autres
Publié: (2026)

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
par: Kautsar, Muhammad Dehan Al, et autres
Publié: (2026)

PARAPHRASUS : A Comprehensive Benchmark for Evaluating Paraphrase Detection Models
par: Michail, Andrianos, et autres
Publié: (2024)

EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models
par: Paech, Samuel J.
Publié: (2023)

UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning
par: Ovcharov, Volodymyr
Publié: (2026)

Benchmarking the Performance of Pre-trained LLMs across Urdu NLP Tasks
par: Tahir, Munief Hassan, et autres
Publié: (2024)

PrivacyBench: A Conversational Benchmark for Evaluating Privacy in Personalized AI
par: Mukhopadhyay, Srija, et autres
Publié: (2025)

PSST: A Benchmark for Evaluation-driven Text Public-Speaking Style Transfer
par: Sun, Huashan, et autres
Publié: (2023)

LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation
par: Yuan, Weikang, et autres
Publié: (2025)

EduAdapt: A Question Answer Benchmark Dataset for Evaluating Grade-Level Adaptability in LLMs
par: Naeem, Numaan, et autres
Publié: (2025)

Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish
par: Er, Yakup Abrek, et autres
Publié: (2025)

DeEscalWild: A Real-World Benchmark for Automated De-Escalation Training with SLMs
par: Hasan, Md Hasebul, et autres
Publié: (2026)

No Dataset Needed for Downstream Knowledge Benchmarking: Response Dispersion Inversely Correlates with Accuracy on Domain-specific QA
par: Simione II, Robert L
Publié: (2024)

Separating Constraint Compliance from Semantic Accuracy: A Novel Benchmark for Evaluating Instruction-Following Under Compression
par: Baxi, Rahul
Publié: (2025)

FIN-bench-v2: A Unified and Robust Benchmark Suite for Evaluating Finnish Large Language Models
par: Kytöniemi, Joona, et autres
Publié: (2025)

UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Models
par: Chen, Chen, et autres
Publié: (2025)

Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on Large Language Models
par: Kurtic, Eldar, et autres
Publié: (2024)

Evaluating the Efficacy of Hybrid Deep Learning Models in Distinguishing AI-Generated Text
par: Oketunji, Abiodun Finbarrs
Publié: (2023)

Learning the meanings of function words from grounded language using a visual question answering model
par: Portelance, Eva, et autres
Publié: (2023)

RMGAP: Benchmarking the Generalization of Reward Models across Diverse Preferences
par: Zhou, Yangyang, et autres
Publié: (2026)

Low-Resource Court Judgment Summarization for Common Law Systems
par: Liu, Shuaiqi, et autres
Publié: (2024)

Can AI Read Between The Lines? Benchmarking LLMs On Financial Nuance
par: Kubica, Dominick, et autres
Publié: (2025)

UrduBench: An Urdu Reasoning Benchmark using Contextually Ensembled Translations with Human-in-the-Loop
par: Shafique, Muhammad Ali, et autres
Publié: (2026)

From Benchmarking to Reasoning: A Dual-Aspect, Large-Scale Evaluation of LLMs on Vietnamese Legal Text
par: Le, Van-Truong
Publié: (2026)

Automated MCQA Benchmarking at Scale: Evaluating Reasoning Traces as Retrieval Sources for Domain Adaptation of Small Language Models
par: Gokdemir, Ozan, et autres
Publié: (2025)

Large Language Model (LLM) Bias Index -- LLMBI
par: Oketunji, Abiodun Finbarrs, et autres
Publié: (2023)

Evaluating the efficacy of LLM Safety Solutions : The Palit Benchmark Dataset
par: Palit, Sayon, et autres
Publié: (2025)

From Guessing to Asking: An Approach to Resolving the Persona Knowledge Gap in LLMs during Multi-Turn Conversations
par: Baskar, Sarvesh, et autres
Publié: (2025)

Bi-Attention HateXplain : Taking into account the sequential aspect of data during explainability in a multi-task context
par: Mondjo, Ghislain Dorian Tchuente
Publié: (2026)