Cover Image

Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Miranda, Brando, Lee, Alycia, Sundar, Sudharsan, Casasola, Allison, Schaeffer, Rylan, Obbad, Elyas, Koyejo, Sanmi
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Artificial Intelligence Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Causes Polysemanticity? An Alternative Origin Story of Mixed Selectivity from Incidental Causes
by: Lecomte, Victor, et al.
Published: (2023)

ZIP-FIT: Embedding-Free Data Selection via Compression-Based Alignment
by: Obbad, Elyas, et al.
Published: (2024)

Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs
by: Gulati, Aryan, et al.
Published: (2025)

Quantifying the Importance of Data Alignment in Downstream Model Performance
by: Chawla, Krrish, et al.
Published: (2025)

Lean-ing on Quality: How High-Quality Data Beats Diverse Multilingual Data in AutoFormalization
by: Chan, Willy, et al.
Published: (2025)

Tournament Informed Adversarial Quality Diversity
by: Anne, Timothée, et al.
Published: (2026)

Variable Metric Evolution Strategies for High-dimensional Multi-Objective Optimization
by: Glasmachers, Tobias
Published: (2024)

Towards Exploratory Quality Diversity Landscape Analysis
by: Mosphilis, Kyriacos, et al.
Published: (2024)

Generative Design through Quality-Diversity Data Synthesis and Language Models
by: Gaier, Adam, et al.
Published: (2024)

Quality Diversity Genetic Programming for Learning Scheduling Heuristics
by: Xu, Meng, et al.
Published: (2025)

Quality-Diversity Algorithms Can Provably Be Helpful for Optimization
by: Qian, Chao, et al.
Published: (2024)

Exploring the Performance-Reproducibility Trade-off in Quality-Diversity
by: Flageat, Manon, et al.
Published: (2024)

QED: using Quality-Environment-Diversity to evolve resilient robot swarms
by: Bossens, David M., et al.
Published: (2020)

Discrete Gene Crossover Accelerates Solution Discovery in Quality-Diversity Algorithms
by: Hutchinson, Joshua, et al.
Published: (2026)

Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversity
by: Faldor, Maxence, et al.
Published: (2024)

Generating Diverse Challenging Terrains for Legged Robots Using Quality-Diversity Algorithm
by: Esquerre-Pourtère, Arthur, et al.
Published: (2025)

Extract-QD Framework: A Generic Approach for Quality-Diversity in Noisy, Stochastic or Uncertain Domains
by: Flageat, Manon, et al.
Published: (2025)

Overcoming Deceptiveness in Fitness Optimization with Unsupervised Quality-Diversity
by: Coiffard, Lisa, et al.
Published: (2025)

Exploring Definitions of Quality and Diversity in Sonic Measurement Spaces
by: Jónsson, Björn Þór, et al.
Published: (2025)

Quality with Just Enough Diversity in Evolutionary Policy Search
by: Templier, Paul, et al.
Published: (2024)

Motif Diversity in Human Liver ChIP-seq Data Using MAP-Elites
by: Medina, Alejandro, et al.
Published: (2026)

Soft Quality-Diversity Optimization
by: Hedayatian, Saeed, et al.
Published: (2025)

Quality-Diversity with Limited Resources
by: Wang, Ren-Jian, et al.
Published: (2024)

Dynamic Quality-Diversity Search
by: Gallotta, Roberto, et al.
Published: (2024)

Data-Informed Model Complexity Metric for Optimizing Symbolic Regression Models
by: Haut, Nathan, et al.
Published: (2025)

Diversity-Preserving Exploitation of Crossover
by: Lengler, Johannes, et al.
Published: (2025)

Floorplanning of VLSI by Mixed-Variable Optimization
by: Sun, Jian, et al.
Published: (2024)

Energy Aware Development of Neuromorphic Implantables: From Metrics to Action
by: Roque, Enrique Barba, et al.
Published: (2025)

Evolutionary Robust Clustering Over Time for Temporal Data
by: Zhao, Qi, et al.
Published: (2021)

Evaluating the Robustness of Chinchilla Compute-Optimal Scaling
by: Schaeffer, Rylan, et al.
Published: (2025)

Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimization
by: Ding, Li, et al.
Published: (2023)

Evolutionary Multi-Objective Diversity Optimization
by: Do, Anh Viet, et al.
Published: (2024)

Exploratory Landscape Analysis for Mixed-Variable Problems
by: Prager, Raphael Patrick, et al.
Published: (2024)

Uncertainty-Aware Offline Data-Driven Multi-Objective Optimization
by: Lyu, Huanbo, et al.
Published: (2025)

Squintability and Other Metrics for Assessing Projection Pursuit Indexes, and Guiding Optimization Choices
by: Zhang, H. Sherry, et al.
Published: (2024)

Estimation-of-Distribution Algorithms for Multi-Valued Decision Variables
by: Jedidia, Firas Ben, et al.
Published: (2023)

Challenges of Interaction in Optimizing Mixed Categorical-Continuous Variables
by: Akimoto, Youhei, et al.
Published: (2025)

Data-Efficient Interactive Multi-Objective Optimization Using ParEGO
by: Heidari, Arash, et al.
Published: (2024)

DHEvo: Data-Algorithm Based Heuristic Evolution for Generalizable MILP Solving
by: Zhang, Zhihao, et al.
Published: (2025)

Speed-based Filtration and DBSCAN of Event-based Camera Data with Neuromorphic Computing
by: Rizzo, Charles P., et al.
Published: (2024)