Copertina

Position: The Most Expensive Part of an LLM should be its Training Data

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kandpal, Nikhil, Raffel, Colin
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence Computers and Society Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Best Practices for Open Datasets for LLM Training
di: Baack, Stefan, et al.
Pubblicazione: (2025)

AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive
di: Guo, Taicheng, et al.
Pubblicazione: (2026)

Impacts of Racial Bias in Historical Training Data for News AI
di: Bhargava, Rahul, et al.
Pubblicazione: (2025)

ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization
di: Yadav, Prateek, et al.
Pubblicazione: (2023)

Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
di: Pan, Bowen, et al.
Pubblicazione: (2024)

Correlated Errors in Large Language Models
di: Kim, Elliot, et al.
Pubblicazione: (2025)

Unmasking and Improving Data Credibility: A Study with Datasets for Training Harmless Language Models
di: Zhu, Zhaowei, et al.
Pubblicazione: (2023)

Peeking Behind Closed Doors: Risks of LLM Evaluation by Private Data Curators
di: Bansal, Hritik, et al.
Pubblicazione: (2025)

Efficient Model Development through Fine-tuning Transfer
di: Lin, Pin-Jie, et al.
Pubblicazione: (2025)

Use Sparse Autoencoders to Discover Unknown Concepts, Not to Act on Known Concepts
di: Peng, Kenny, et al.
Pubblicazione: (2025)

On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?
di: Geng, Mingmeng, et al.
Pubblicazione: (2025)

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
di: Schaeffer, Rylan, et al.
Pubblicazione: (2025)

Computational Measurement of Political Positions: A Review of Text-Based Ideal Point Estimation Algorithms
di: Parschan, Patrick, et al.
Pubblicazione: (2025)

A Multi-LLM Debiasing Framework
di: Owens, Deonna M., et al.
Pubblicazione: (2024)

LLM-Assisted Content Conditional Debiasing for Fair Text Embedding
di: Deng, Wenlong, et al.
Pubblicazione: (2024)

Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
di: Dong, Zhichen, et al.
Pubblicazione: (2024)

AI-University: An LLM-based platform for instructional alignment to scientific classrooms
di: Shojaei, Mostafa Faghih, et al.
Pubblicazione: (2025)

Policies Permitting LLM Use for Polishing Peer Reviews Are Currently Not Enforceable
di: Saha, Rounak, et al.
Pubblicazione: (2026)

AI-Augmented Predictions: LLM Assistants Improve Human Forecasting Accuracy
di: Schoenegger, Philipp, et al.
Pubblicazione: (2024)

Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators
di: Do, Heejin, et al.
Pubblicazione: (2026)

LLMCO2: Advancing Accurate Carbon Footprint Prediction for LLM Inferences
di: Fu, Zhenxiao, et al.
Pubblicazione: (2024)

An In-Depth Investigation of Data Collection in LLM App Ecosystems
di: Wu, Yuhao, et al.
Pubblicazione: (2024)

Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation
di: Wang, Jiawei, et al.
Pubblicazione: (2024)

Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracy
di: Schoenegger, Philipp, et al.
Pubblicazione: (2024)

Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text
di: Islam, Tunazzina
Pubblicazione: (2026)

Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook
di: Lee, Jaehyeok, et al.
Pubblicazione: (2026)

From Data to Behavior: Predicting Unintended Model Behaviors Before Training
di: Wang, Mengru, et al.
Pubblicazione: (2026)

Leveraging Social Determinants of Health in Alzheimer's Research Using LLM-Augmented Literature Mining and Knowledge Graphs
di: Shang, Tianqi, et al.
Pubblicazione: (2024)

COMPL-AI Framework: A Technical Interpretation and LLM Benchmarking Suite for the EU Artificial Intelligence Act
di: Guldimann, Philipp, et al.
Pubblicazione: (2024)

Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracing
di: Kim, JongWoo, et al.
Pubblicazione: (2024)

ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs
di: Heakl, Ahmed, et al.
Pubblicazione: (2024)

Scaling Data-Constrained Language Models
di: Muennighoff, Niklas, et al.
Pubblicazione: (2023)

Sentiment Analysis of Cyberbullying Data in Social Media
di: Susmitha, Arvapalli Sai, et al.
Pubblicazione: (2024)

Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model
di: Lifelo, Zita, et al.
Pubblicazione: (2024)

Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
di: Husom, Erik Johannes, et al.
Pubblicazione: (2025)

DualAlign: Generating Clinically Grounded Synthetic Data
di: Li, Rumeng, et al.
Pubblicazione: (2025)

Literature Meets Data: A Synergistic Approach to Hypothesis Generation
di: Liu, Haokun, et al.
Pubblicazione: (2024)

Towards Robust Evaluation of Unlearning in LLMs via Data Transformations
di: Joshi, Abhinav, et al.
Pubblicazione: (2024)

Integrating LSTM and BERT for Long-Sequence Data Analysis in Intelligent Tutoring Systems
di: Li, Zhaoxing, et al.
Pubblicazione: (2024)

Implementing a Nordic-Baltic Federated Health Data Network: a case report
di: Chomutare, Taridzo, et al.
Pubblicazione: (2024)