Cover Image

OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shu, Yao, Fang, Jiongfeng, He, Ying Tiffany, Yu, Fei Richard
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ReDit: Reward Dithering for Improved LLM Policy Optimization
by: Wei, Chenxing, et al.
Published: (2025)

Refining Adaptive Zeroth-Order Optimization at Ease
by: Shu, Yao, et al.
Published: (2025)

ADMIRE-BayesOpt: Accelerated Data MIxture RE-weighting for Language Models with Bayesian Optimization
by: Chen, Shengzhuang, et al.
Published: (2025)

ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedback
by: Zhai, Bohan, et al.
Published: (2025)

SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization
by: Meindl, Jamison, et al.
Published: (2025)

OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modeling
by: Lu, Hongliang, et al.
Published: (2025)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
by: Kim, Dongyoon, et al.
Published: (2025)

OptProver: Bridging Olympiad and Optimization through Continual Training in Formal Theorem Proving
by: Li, Chenyi, et al.
Published: (2026)

ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization
by: Meindl, Jamison, et al.
Published: (2025)

M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling
by: Sun, Xudong, et al.
Published: (2024)

LFPO: Likelihood-Free Policy Optimization for Masked Diffusion Models
by: Wei, Chenxing, et al.
Published: (2026)

OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation
by: Yang, Haochen, et al.
Published: (2026)

Words & Weights: Streamlining Multi-Turn Interactions via Co-Adaptation
by: Wei, Chenxing, et al.
Published: (2026)

FLOSS: Federated Learning with Opt-Out and Straggler Support
by: Goetze, David J, et al.
Published: (2025)

Self-Refining Diffusion Samplers: Enabling Parallelization via Parareal Iterations
by: Selvam, Nikil Roashan, et al.
Published: (2024)

Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
by: Pfeiffer, Felix, et al.
Published: (2024)

TempOpt -- Unsupervised Alarm Relation Learning for Telecommunication Networks
by: Sampath, Sathiyanaryanan, et al.
Published: (2025)

Dynamic Universal Approximation Theory: Foundations for Parallelism in Neural Networks
by: Wang, Wei, et al.
Published: (2024)

Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
by: Shu, Yao, et al.
Published: (2024)

Understanding the Challenges in Iterative Generative Optimization with LLMs
by: Nie, Allen, et al.
Published: (2026)

PP-TIL: Personalized Planning for Autonomous Driving with Instance-based Transfer Imitation Learning
by: Lin, Fangze, et al.
Published: (2024)

DMax: Aggressive Parallel Decoding for dLLMs
by: Chen, Zigeng, et al.
Published: (2026)

GeckOpt: LLM System Efficiency via Intent-Based Tool Selection
by: Fore, Michael, et al.
Published: (2024)

Second Order Bounds for Contextual Bandits with Function Approximation
by: Pacchiano, Aldo
Published: (2024)

Generalized Parallel Scaling with Interdependent Generations
by: Dong, Harry, et al.
Published: (2025)

Primitive Agentic First-Order Optimization
by: Sala, R.
Published: (2024)

Dimer-Enhanced Optimization: A First-Order Approach to Escaping Saddle Points in Neural Network Training
by: Hu, Yue, et al.
Published: (2025)

Efficient Exploration for Iterative Nash Preference Optimization
by: Nan, Tianlong, et al.
Published: (2026)

On the Mathematical Impossibility of Safe Universal Approximators
by: Yao, Jasper
Published: (2025)

IIB-LPO: Latent Policy Optimization via Iterative Information Bottleneck
by: Deng, Huilin, et al.
Published: (2026)

OptScale: Probabilistic Optimality for Inference-time Scaling
by: Wang, Youkang, et al.
Published: (2025)

Universal Approximation with Softmax Attention
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

Towards Secure and Efficient Data Scheduling for Vehicular Social Networks
by: Xia, Youhua, et al.
Published: (2024)

JAM: Keypoint-Guided Joint Prediction after Classification-Aware Marginal Proposal for Multi-Agent Interaction
by: Lin, Fangze, et al.
Published: (2025)

Accelerate Model Parallel Training by Using Efficient Graph Traversal Order in Device Placement
by: Wang, Tianze, et al.
Published: (2022)

Flexora: Flexible Low Rank Adaptation for Large Language Models
by: Wei, Chenxing, et al.
Published: (2024)

A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning
by: Wu, Chenlin, et al.
Published: (2024)

Second-Order Convergence in Private Stochastic Non-Convex Optimization
by: Tao, Youming, et al.
Published: (2025)

Approximated Likelihood Ratio: A Forward-Only and Parallel Framework for Boosting Neural Network Training
by: Zhang, Zeliang, et al.
Published: (2024)

MoNTA: Accelerating Mixture-of-Experts Training with Network-Traffc-Aware Parallel Optimization
by: Guo, Jingming, et al.
Published: (2024)