Imagen de Portada

Teaching Models to Understand (but not Generate) High-risk Data

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Ryan, Finlayson, Matthew, Soldaini, Luca, Swayamdipta, Swabha, Jia, Robin
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Logits of API-Protected LLMs Leak Proprietary Information
por: Finlayson, Matthew, et al.
Publicado: (2024)

Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge
por: Cui, Xinyue, et al.
Publicado: (2025)

Understanding Dataset Difficulty with $\mathcal{V}$-Usable Information
por: Ethayarajh, Kawin, et al.
Publicado: (2021)

How Reliable is Language Model Micro-Benchmarking?
por: Yauney, Gregory, et al.
Publicado: (2025)

Better Language Model Inversion by Compactly Representing Next-Token Distributions
por: Nazir, Murtaza, et al.
Publicado: (2025)

Annotating FrameNet via Structure-Conditioned Language Generation
por: Cui, Xinyue, et al.
Publicado: (2024)

Compare without Despair: Reliable Preference Evaluation with Generation Separability
por: Ghosh, Sayan, et al.
Publicado: (2024)

Every Language Model Has a Forgery-Resistant Signature
por: Finlayson, Matthew, et al.
Publicado: (2025)

FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
por: Weller, Orion, et al.
Publicado: (2024)

Why Fine-Tuning Encourages Hallucinations and How to Fix It
por: Kaplan, Guy, et al.
Publicado: (2026)

From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models
por: Welleck, Sean, et al.
Publicado: (2024)

Evaluating Evaluation Metrics -- The Mirage of Hallucination Detection
por: Kulkarni, Atharva, et al.
Publicado: (2025)

Side-by-side Comparison Amplifies Dialect Bias in Language Models
por: Kondapally, Kritee, et al.
Publicado: (2026)

Self-Directed Synthetic Dialogues and Revisions Technical Report
por: Lambert, Nathan, et al.
Publicado: (2024)

Disentangling Geometry, Performance, and Training in Language Models
por: Kulkarni, Atharva, et al.
Publicado: (2026)

Post-training an LLM for RAG? Train on Self-Generated Demonstrations
por: Finlayson, Matthew, et al.
Publicado: (2025)

Evaluation Under Imperfect Benchmarks and Ratings: A Case Study in Text Simplification
por: Liu, Joseph, et al.
Publicado: (2025)

Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?
por: Khurana, Urja, et al.
Publicado: (2024)

Olmix: A Framework for Data Mixing Throughout LM Development
por: Chen, Mayee F., et al.
Publicado: (2026)

What's In My Big Data?
por: Elazar, Yanai, et al.
Publicado: (2023)

DataDecide: How to Predict Best Pretraining Data with Small Experiments
por: Magnusson, Ian, et al.
Publicado: (2025)

Improving Language Model Personas via Rationalization with Psychological Scaffolds
por: Joshi, Brihi, et al.
Publicado: (2025)

Proving membership in LLM pretraining data via data watermarks
por: Wei, Johnny Tian-Zheng, et al.
Publicado: (2024)

Verify with Caution: The Pitfalls of Relying on Imperfect Factuality Metrics
por: Godbole, Ameya, et al.
Publicado: (2025)

BenchBrowser: Retrieving Evidence for Evaluating Benchmark Validity
por: Diddee, Harshita, et al.
Publicado: (2026)

How Can Large Language Models Understand Spatial-Temporal Data?
por: Liu, Lei, et al.
Publicado: (2024)

Pre-trained Large Language Models Use Fourier Features to Compute Addition
por: Zhou, Tianyi, et al.
Publicado: (2024)

Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability
por: Sundaram, Shobhita, et al.
Publicado: (2026)

Harnessing Event Sensory Data for Error Pattern Prediction in Vehicles: A Language Model Approach
por: Math, Hugo, et al.
Publicado: (2024)

Generative Explanations for Program Synthesizers
por: Nazari, Amirmohammad, et al.
Publicado: (2024)

Teaching Your Models to Understand Code via Focal Preference Alignment
por: Wu, Jie, et al.
Publicado: (2025)

Function Induction and Task Generalization: An Interpretability Study with Off-by-One Addition
por: Ye, Qinyuan, et al.
Publicado: (2025)

Generalizing Reward Modeling for Out-of-Distribution Preference Learning
por: Jia, Chen
Publicado: (2024)

Promote, Suppress, Iterate: How Language Models Answer One-to-Many Factual Queries
por: Yan, Tianyi Lorena, et al.
Publicado: (2025)

Hubble: a Model Suite to Advance the Study of LLM Memorization
por: Wei, Johnny Tian-Zheng, et al.
Publicado: (2025)

Teaching Large Language Models Number-Focused Headline Generation With Key Element Rationales
por: Qian, Zhen, et al.
Publicado: (2025)

Believing without Seeing: Quality Scores for Contextualizing Vision-Language Model Explanations
por: He, Keyu, et al.
Publicado: (2025)

Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrs
por: Ghosh, Sayan, et al.
Publicado: (2025)

The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models
por: Bhaskar, Adithya, et al.
Publicado: (2024)

NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge
por: Howard, Phillip, et al.
Publicado: (2023)