Cover Image

Optimizing Language Models for Human Preferences is a Causal Inference Problem

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Victoria, Ben-Michael, Eli, Morency, Louis-Philippe
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Methodology
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Omitted Variable Bias in Language Models Under Distribution Shift
by: Lin, Victoria, et al.
Published: (2026)

Isolated Causal Effects of Natural Language
by: Lin, Victoria, et al.
Published: (2024)

Proximal Causal Inference With Text Data
by: Chen, Jacob M., et al.
Published: (2024)

A Design-based Solution for Causal Inference with Text: Can a Language Model Be Too Large?
by: Tierney, Graham, et al.
Published: (2025)

CARL-GT: Evaluating Causal Reasoning Capabilities of Large Language Models
by: Tu, Ruibo, et al.
Published: (2024)

Causal Inference on Outcomes Learned from Text
by: Modarressi, Iman, et al.
Published: (2025)

Causal Graph Discovery with Retrieval-Augmented Generation based Large Language Models
by: Zhang, Yuzhe, et al.
Published: (2024)

MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
by: Wang, Tianze, et al.
Published: (2025)

MuPlon: Multi-Path Causal Optimization for Claim Verification through Controlling Confounding
by: Guo, Hanghui, et al.
Published: (2025)

End-To-End Causal Effect Estimation from Unstructured Natural Language Data
by: Dhawan, Nikita, et al.
Published: (2024)

Enhancing Causal Reasoning in Large Language Models: A Causal Attribution Model for Precision Fine-Tuning
by: Cai, Hengrui, et al.
Published: (2023)

Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Models
by: Egami, Naoki, et al.
Published: (2023)

CLEAR: Can Language Models Really Understand Causal Graphs?
by: Chen, Sirui, et al.
Published: (2024)

Language Models as Causal Effect Generators
by: Bynum, Lucius E. J., et al.
Published: (2024)

The Illusion of Intervention: Your LLM-Simulated Experiment is an Observational Study
by: Lin, Victoria, et al.
Published: (2026)

Social Caption: Evaluating Social Understanding in Multimodal Models
by: Thumu, Bhaavanaa, et al.
Published: (2026)

LIDS: LLM Summary Inference Under the Layered Lens
by: Park, Dylan, et al.
Published: (2026)

Robust Detection of Watermarks for Large Language Models Under Human Edits
by: Li, Xiang, et al.
Published: (2024)

Causal Representation Learning from Multimodal Clinical Records under Non-Random Modality Missingness
by: Liang, Zihan, et al.
Published: (2025)

Industrial-Grade Smart Troubleshooting through Causal Technical Language Processing: a Proof of Concept
by: Trilla, Alexandre, et al.
Published: (2024)

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
by: Kıcıman, Emre, et al.
Published: (2023)

TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model
by: Wang, Yue, et al.
Published: (2024)

Social Genome: Grounded Social Reasoning Abilities of Multimodal Models
by: Mathur, Leena, et al.
Published: (2025)

Optimal Estimation of Watermark Proportions in Hybrid AI-Human Texts
by: Li, Xiang, et al.
Published: (2025)

Hierarchical Causal Models
by: Weinstein, Eli N., et al.
Published: (2024)

Text Rationalization for Robust Causal Effect Estimation
by: Zhang, Lijinghua, et al.
Published: (2025)

A Causal Lens for Evaluating Faithfulness Metrics
by: Zaman, Kerem, et al.
Published: (2025)

RCT Rejection Sampling for Causal Estimation Evaluation
by: Keith, Katherine A., et al.
Published: (2023)

Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions
by: Mathur, Leena, et al.
Published: (2024)

ALCM: Autonomous LLM-Augmented Causal Discovery Framework
by: Khatibi, Elahe, et al.
Published: (2024)

Bayesian Inference for PDE-based Inverse Problems using the Optimization of a Discrete Loss
by: Amoudruz, Lucas, et al.
Published: (2025)

IoT-LM: Large Multisensory Language Models for the Internet of Things
by: Mo, Shentong, et al.
Published: (2024)

Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
by: Kern, Christoph, et al.
Published: (2023)

Evaluating Interventional Reasoning Capabilities of Large Language Models
by: Kasetty, Tejas, et al.
Published: (2024)

Debiasing Watermarks for Large Language Models via Maximal Coupling
by: Xie, Yangxinyu, et al.
Published: (2024)

Towards Representation Learning for Weighting Problems in Design-Based Causal Inference
by: Clivio, Oscar, et al.
Published: (2024)

Causal Inference Isn't Special: Why It's Just Another Prediction Problem
by: Fernández-Loría, Carlos
Published: (2025)

Random Text, Zipf's Law, Critical Length,and Implications for Large Language Models
by: Berman, Vladimir
Published: (2025)

Causal Inference for Human-Language Model Collaboration
by: Zhang, Bohan, et al.
Published: (2024)

Probabilistic Modelling is Sufficient for Causal Inference
by: Mlodozeniec, Bruno, et al.
Published: (2025)