Cover Image

Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Hongye, Wang, Bingxing, Xiao, Minheng, Qin, Honglin, Wu, Zhizhong, Tan, Lianghao
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reducing Bias in Deep Learning Optimization: The RSGDM Approach
by: Qin, Honglin, et al.
Published: (2024)

Root Cause Attribution of Delivery Risks via Causal Discovery with Reinforcement Learning
by: Xiao, Minheng
Published: (2024)

Multiple Greedy Quasi-Newton Methods for Saddle Point Problems
by: Xiao, Minheng, et al.
Published: (2024)

Robust Weight Initialization for Tanh Neural Networks with Fixed Point Analysis
by: Lee, Hyunwoo, et al.
Published: (2024)

SNAP: Stopping Catastrophic Forgetting in Hebbian Learning with Sigmoidal Neuronal Adaptive Plasticity
by: Xu, Tianyi, et al.
Published: (2024)

Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
by: Xiao, Minheng, et al.
Published: (2024)

Stock Type Prediction Model Based on Hierarchical Graph Neural Network
by: Yao, Jianhua, et al.
Published: (2024)

Top K Enhanced Reinforcement Learning Attacks on Heterogeneous Graph Node Classification
by: Gao, Honglin, et al.
Published: (2024)

Dynamic Hypergraph-Enhanced Prediction of Sequential Medical Visits
by: Yang, Wangying, et al.
Published: (2024)

FedGRec: Dynamic Spatio-Temporal Federated Graph Learning for Secure and Efficient Cross-Border Recommendations
by: Tan, Zhizhong, et al.
Published: (2025)

Global Minimizers of Sigmoid Contrastive Loss
by: Bangachev, Kiril, et al.
Published: (2025)

Learning Cross-Atlas Consistent Brain Disorder Representations via Disentangled Multi-Atlas Functional Connectivity Learning
by: Chen, Minheng, et al.
Published: (2026)

Frictional Q-Learning
by: Kim, Hyunwoo, et al.
Published: (2025)

AnyGraph: Graph Foundation Model in the Wild
by: Xia, Lianghao, et al.
Published: (2024)

Achieving the Tightest Relaxation of Sigmoids for Formal Verification
by: Chevalier, Samuel, et al.
Published: (2024)

An Efficient Recommendation Model Based on Knowledge Graph Attention-Assisted Network (KGATAX)
by: Wu, Zhizhong
Published: (2024)

Thinking Preference Optimization
by: Yang, Wang, et al.
Published: (2025)

Contrastive Learning for Multi Label ECG Classification with Jaccard Score Based Sigmoid Loss
by: Takahashi, Junichiro, et al.
Published: (2026)

Reinforcement Learning Fine-Tuning Enhances Activation Intensity and Diversity in the Internal Circuitry of LLMs
by: Zhang, Honglin, et al.
Published: (2025)

Automated Design of Linear Bounding Functions for Sigmoidal Nonlinearities in Neural Networks
by: König, Matthias, et al.
Published: (2024)

Deep Reinforcement Learning with Task-Adaptive Retrieval via Hypernetwork
by: Jin, Yonggang, et al.
Published: (2023)

Adaptive Image Registration: A Hybrid Approach Integrating Deep Learning and Optimization Functions for Enhanced Precision
by: De Araujo, Gabriel, et al.
Published: (2023)

Multiobjective Hydropower Reservoir Operation Optimization with Transformer-Based Deep Reinforcement Learning
by: Wu, Rixin, et al.
Published: (2023)

A Triple-Inertial Accelerated Alternating Optimization Method for Deep Learning Training
by: Yan, Chengcheng, et al.
Published: (2025)

AceGRPO: Adaptive Curriculum Enhanced Group Relative Policy Optimization for Autonomous Machine Learning Engineering
by: Cai, Yuzhu, et al.
Published: (2026)

Beyond Gaussian Initializations: Signal Preserving Weight Initialization for Odd-Sigmoid Activations
by: Lee, Hyunwoo, et al.
Published: (2025)

Research on Autonomous Robots Navigation based on Reinforcement Learning
by: Wang, Zixiang, et al.
Published: (2024)

GraphEdit: Large Language Models for Graph Structure Learning
by: Guo, Zirui, et al.
Published: (2024)

Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMs
by: Chen, Jack, et al.
Published: (2025)

Meta-Learning Adaptive Loss Functions
by: Raymond, Christian, et al.
Published: (2023)

BET: Explaining Deep Reinforcement Learning through The Error-Prone Decisions
by: Liu, Xiao, et al.
Published: (2024)

EasyST: A Simple Framework for Spatio-Temporal Prediction
by: Tang, Jiabin, et al.
Published: (2024)

HeteroBA: A Structure-Manipulating Backdoor Attack on Heterogeneous Graphs
by: Gao, Honglin, et al.
Published: (2025)

Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds
by: Choi, Andrew, et al.
Published: (2026)

A Geometrically-Grounded Drive for MDL-Based Optimization in Deep Learning
by: Lei, Ming, et al.
Published: (2026)

Heterogeneity-aware Personalized Federated Learning via Adaptive Dual-Agent Reinforcement Learning
by: Chen, Xi, et al.
Published: (2025)

Robust Deep Reinforcement Learning with Adaptive Adversarial Perturbations in Action Space
by: Liu, Qianmei, et al.
Published: (2024)

BiSSL: Enhancing the Alignment Between Self-Supervised Pretraining and Downstream Fine-Tuning via Bilevel Optimization
by: Zakarias, Gustav Wagner, et al.
Published: (2024)

Adaptive Data Exploitation in Deep Reinforcement Learning
by: Yuan, Mingqi, et al.
Published: (2025)

Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks
by: Nofshin, Eura, et al.
Published: (2024)