Cover Image

GIO: Gradient Information Optimization for Training Dataset Selection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Everaert, Dante, Potts, Christopher
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AmazonQAC: A Large-Scale, Naturalistic Query Autocomplete Dataset
by: Everaert, Dante, et al.
Published: (2024)

Retrieval Augmented Spelling Correction for E-Commerce Applications
by: Guo, Xuan, et al.
Published: (2024)

Training Data Selection with Gradient Orthogonality for Efficient Domain Adaptation
by: Zhang, Xiyang, et al.
Published: (2026)

Entropy-Gated Selective Policy Optimization:Token-Level Gradient Allocation for Hybrid Training of Large Language Models
by: Hu, Yuelin, et al.
Published: (2026)

Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together
by: Soylu, Dilara, et al.
Published: (2024)

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
by: Li, Kevin, et al.
Published: (2024)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
by: Ma, Yuhan, et al.
Published: (2024)

Backward-Friendly Optimization: Training Large Language Models with Approximate Gradients under Memory Constraints
by: Yang, Jing, et al.
Published: (2025)

FlashOptim: Optimizers for Memory-Efficient Training
by: Ortiz, Jose Javier Gonzalez, et al.
Published: (2026)

MSEval: A Dataset for Material Selection in Conceptual Design to Evaluate Algorithmic Models
by: Jain, Yash Patawari, et al.
Published: (2024)

LPLgrad: Optimizing Active Learning Through Gradient Norm Sample Selection and Auxiliary Model Training
by: Gul, Shreen, et al.
Published: (2024)

Gradient-Congruity Guided Federated Sparse Training
by: Tian, Chris Xing, et al.
Published: (2024)

Gradient-Free Training of Quantized Neural Networks
by: Cohen, Noa, et al.
Published: (2024)

Training Greedy Policy for Proposal Batch Selection in Expensive Multi-Objective Combinatorial Optimization
by: Lee, Deokjae, et al.
Published: (2024)

Bayesian Inference of Training Dataset Membership
by: Huang, Yongchao
Published: (2025)

Integrated Gradient Correlation: a Dataset-wise Attribution Method
by: Lelièvre, Pierre, et al.
Published: (2024)

Certification for Differentially Private Prediction in Gradient-Based Training
by: Wicker, Matthew, et al.
Published: (2024)

Gradient Multi-Normalization for Stateless and Scalable LLM Training
by: Scetbon, Meyer, et al.
Published: (2025)

Why Gradients Rapidly Increase Near the End of Training
by: Defazio, Aaron
Published: (2025)

Gradient Extrapolation-Based Policy Optimization
by: Swapnil, Ismam Nur, et al.
Published: (2026)

SPICE: Submodular Penalized Information-Conflict Selection for Efficient Large Language Model Training
by: Chang, Powei, et al.
Published: (2026)

Gradient Inversion Transcript: Leveraging Robust Generative Priors to Reconstruct Training Data from Gradient Leakage
by: Chen, Xinping, et al.
Published: (2025)

Imitation Learning Datasets: A Toolkit For Creating Datasets, Training Agents and Benchmarking
by: Gavenski, Nathan, et al.
Published: (2024)

IEFS-GMB: Gradient Memory Bank-Guided Feature Selection Based on Information Entropy for EEG Classification of Neurological Disorders
by: Zhang, Liang, et al.
Published: (2025)

Post-Training with Policy Gradients: Optimality and the Base Model Barrier
by: Mousavi-Hosseini, Alireza, et al.
Published: (2026)

Uncovering Gradient Inversion Risks in Practical Language Model Training
by: Feng, Xinguo, et al.
Published: (2025)

Imbalanced Gradients in RL Post-Training of Multi-Task LLMs
by: Wu, Runzhe, et al.
Published: (2025)

Beyond Gradient Averaging in Parallel Optimization: Improved Robustness through Gradient Agreement Filtering
by: Chaubard, Francois, et al.
Published: (2024)

DataS^3: Dataset Subset Selection for Specialization
by: Hulkund, Neha, et al.
Published: (2025)

Sequential Policy Gradient for Adaptive Hyperparameter Optimization
by: Li, Zheng, et al.
Published: (2025)

AFBS:Buffer Gradient Selection in Semi-asynchronous Federated Learning
by: Lu, Chaoyi, et al.
Published: (2025)

Addressing divergent representations from causal interventions on neural networks
by: Grant, Satchel, et al.
Published: (2025)

Mitigating Gradient Overlap in Deep Residual Networks with Gradient Normalization for Improved Non-Convex Optimization
by: Yun, Juyoung
Published: (2024)

Understanding Gradient Boosting Classifier: Training, Prediction, and the Role of $γ_j$
by: Chen, Hung-Hsuan
Published: (2024)

Gradient Weight-normalized Low-rank Projection for Efficient LLM Training
by: Huang, Jia-Hong, et al.
Published: (2024)

Training Large Language Models to Reason via EM Policy Gradient
by: Xu, Tianbing
Published: (2025)

Gradients: When Markets Meet Fine-tuning -- A Distributed Approach to Model Optimisation
by: Subia-Waud, Christopher
Published: (2025)

XGrad: Boosting Gradient-Based Optimizers With Weight Prediction
by: Guan, Lei, et al.
Published: (2023)

Hierarchical Dataset Selection for High-Quality Data Sharing
by: Zhou, Xiaona, et al.
Published: (2025)

Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients
by: Flügel, Katharina, et al.
Published: (2024)