SG-Blend: Learning an Interpolation Between Improved Swish and GELU for Robust Neural Representations
Fuente:
arXiv
Saved in:
| Main Authors: | Sarkar, Gaurav, Gala, Jay, Tripathi, Subarna |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
PALADIN : Robust Neural Fingerprinting for Text-to-Image Diffusion Models
by: L, Murthy, et al.
Published: (2025)
by: L, Murthy, et al.
Published: (2025)
$λ$-GELU: Learning Gating Hardness for Controlled ReLU-ization in Deep Networks
by: Pérez-Corral, Cristian, et al.
Published: (2026)
by: Pérez-Corral, Cristian, et al.
Published: (2026)
An Adversarial Example for Direct Logit Attribution: Memory Management in GELU-4L
by: Janiak, Jett, et al.
Published: (2023)
by: Janiak, Jett, et al.
Published: (2023)
Blending Imitation and Reinforcement Learning for Robust Policy Improvement
by: Liu, Xuefeng, et al.
Published: (2023)
by: Liu, Xuefeng, et al.
Published: (2023)
Randomness and Interpolation Improve Gradient Descent
by: Li, Jiawen, et al.
Published: (2025)
by: Li, Jiawen, et al.
Published: (2025)
Beyond Interpolation: Extrapolative Reasoning with Reinforcement Learning and Graph Neural Networks
by: Grillo, Niccolò, et al.
Published: (2025)
by: Grillo, Niccolò, et al.
Published: (2025)
BlendRL: A Framework for Merging Symbolic and Neural Policy Learning
by: Shindo, Hikaru, et al.
Published: (2024)
by: Shindo, Hikaru, et al.
Published: (2024)
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
by: Arriola, Marianne, et al.
Published: (2025)
by: Arriola, Marianne, et al.
Published: (2025)
On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment
by: Sarkar, Krisanu
Published: (2026)
by: Sarkar, Krisanu
Published: (2026)
Robust Multimodal Representation Learning in Healthcare
by: Zhu, Xiaoguang, et al.
Published: (2026)
by: Zhu, Xiaoguang, et al.
Published: (2026)
Understanding and Improving Adversarial Robustness of Neural Probabilistic Circuits
by: Chen, Weixin, et al.
Published: (2025)
by: Chen, Weixin, et al.
Published: (2025)
Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation
by: Baek, In-Chang, et al.
Published: (2026)
by: Baek, In-Chang, et al.
Published: (2026)
VideoSAGE: Video Summarization with Graph Representation Learning
by: Chaves, Jose M. Rojas, et al.
Published: (2024)
by: Chaves, Jose M. Rojas, et al.
Published: (2024)
Graph Neural Networks for Learning Equivariant Representations of Neural Networks
by: Kofinas, Miltiadis, et al.
Published: (2024)
by: Kofinas, Miltiadis, et al.
Published: (2024)
Studying the Interplay Between the Actor and Critic Representations in Reinforcement Learning
by: Garcin, Samuel, et al.
Published: (2025)
by: Garcin, Samuel, et al.
Published: (2025)
Eau De $Q$-Network: Adaptive Distillation of Neural Networks in Deep Reinforcement Learning
by: Vincent, Théo, et al.
Published: (2025)
by: Vincent, Théo, et al.
Published: (2025)
Compare different SG-Schemes based on large least square problems
by: Acharya, Ramkrishna
Published: (2025)
by: Acharya, Ramkrishna
Published: (2025)
Bridging the Performance Gap Between Target-Free and Target-Based Reinforcement Learning
by: Vincent, Théo, et al.
Published: (2025)
by: Vincent, Théo, et al.
Published: (2025)
Autoencoding Conditional Neural Processes for Representation Learning
by: Prokhorov, Victor, et al.
Published: (2023)
by: Prokhorov, Victor, et al.
Published: (2023)
SG-XDEAT: Sparsity-Guided Cross-Dimensional and Cross-Encoding Attention with Target-Aware Conditioning in Tabular Learning
by: Cheng, Chih-Chuan, et al.
Published: (2025)
by: Cheng, Chih-Chuan, et al.
Published: (2025)
Learning Divergence Fields for Shift-Robust Graph Representations
by: Wu, Qitian, et al.
Published: (2024)
by: Wu, Qitian, et al.
Published: (2024)
Learning Latent Dynamic Robust Representations for World Models
by: Sun, Ruixiang, et al.
Published: (2024)
by: Sun, Ruixiang, et al.
Published: (2024)
REPEAT: Improving Uncertainty Estimation in Representation Learning Explainability
by: Wickstrøm, Kristoffer K., et al.
Published: (2024)
by: Wickstrøm, Kristoffer K., et al.
Published: (2024)
Unity by Diversity: Improved Representation Learning in Multimodal VAEs
by: Sutter, Thomas M., et al.
Published: (2024)
by: Sutter, Thomas M., et al.
Published: (2024)
BRIDGE: Predicting Human Task Completion Time From Model Performance
by: Liu, Fengyuan, et al.
Published: (2026)
by: Liu, Fengyuan, et al.
Published: (2026)
Noisy-Pair Robust Representation Alignment for Positive-Unlabeled Learning
by: Zhao, Hengwei, et al.
Published: (2025)
by: Zhao, Hengwei, et al.
Published: (2025)
Adaptive Variance-Penalized Continual Learning with Fisher Regularization
by: Sarkar, Krisanu
Published: (2025)
by: Sarkar, Krisanu
Published: (2025)
Set-based Meta-Interpolation for Few-Task Meta-Learning
by: Lee, Seanie, et al.
Published: (2022)
by: Lee, Seanie, et al.
Published: (2022)
Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks
by: Jafari, Akbar Anbar, et al.
Published: (2026)
by: Jafari, Akbar Anbar, et al.
Published: (2026)
Weight Space Representation Learning via Neural Field Adaptation
by: Yang, Zhuoqian, et al.
Published: (2025)
by: Yang, Zhuoqian, et al.
Published: (2025)
FreSh: Frequency Shifting for Accelerated Neural Representation Learning
by: Kania, Adam, et al.
Published: (2024)
by: Kania, Adam, et al.
Published: (2024)
Approximate Subgraph Matching with Neural Graph Representations and Reinforcement Learning
by: Li, Kaiyang, et al.
Published: (2026)
by: Li, Kaiyang, et al.
Published: (2026)
Manifold Approximation leads to Robust Kernel Alignment
by: Islam, Mohammad Tariqul, et al.
Published: (2025)
by: Islam, Mohammad Tariqul, et al.
Published: (2025)
Permutation-Invariant Representation Learning for Robust and Privacy-Preserving Feature Selection
by: Liu, Rui, et al.
Published: (2025)
by: Liu, Rui, et al.
Published: (2025)
Fast and Robust Contextual Node Representation Learning over Dynamic Graphs
by: Guo, Xingzhi, et al.
Published: (2024)
by: Guo, Xingzhi, et al.
Published: (2024)
Towards Robust Trajectory Representations: Isolating Environmental Confounders with Causal Learning
by: Luo, Kang, et al.
Published: (2024)
by: Luo, Kang, et al.
Published: (2024)
Curricula for Learning Robust Policies with Factored State Representations in Changing Environments
by: Panayiotou, Panayiotis, et al.
Published: (2024)
by: Panayiotou, Panayiotis, et al.
Published: (2024)
Representation Learning of Auxiliary Concepts for Improved Student Modeling and Exercise Recommendation
by: Badran, Yahya, et al.
Published: (2025)
by: Badran, Yahya, et al.
Published: (2025)
Improving Representation Learning of Complex Critical Care Data with ICU-BERT
by: Santos, Ricardo, et al.
Published: (2025)
by: Santos, Ricardo, et al.
Published: (2025)
Exploiting Latent Linearity in LLMs Improves Explainable Molecular Representation Learning
by: Li, Zhuoran, et al.
Published: (2024)
by: Li, Zhuoran, et al.
Published: (2024)
Similar Items
-
PALADIN : Robust Neural Fingerprinting for Text-to-Image Diffusion Models
by: L, Murthy, et al.
Published: (2025) -
$λ$-GELU: Learning Gating Hardness for Controlled ReLU-ization in Deep Networks
by: Pérez-Corral, Cristian, et al.
Published: (2026) -
An Adversarial Example for Direct Logit Attribution: Memory Management in GELU-4L
by: Janiak, Jett, et al.
Published: (2023) -
Blending Imitation and Reinforcement Learning for Robust Policy Improvement
by: Liu, Xuefeng, et al.
Published: (2023) -
Randomness and Interpolation Improve Gradient Descent
by: Li, Jiawen, et al.
Published: (2025)