Cover Image

Deriving the Scaled-Dot-Function via Maximum Likelihood Estimation and Maximum Entropy Approach

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Ma, Jiyong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Maximum Entropy On-Policy Actor-Critic via Entropy Advantage Estimation
by: Choe, Jean Seong Bjorn, et al.
Published: (2024)

"Noisier" Noise Contrastive Eestimation is (Almost) Maximum Likelihood
by: Yu, Peiyu, et al.
Published: (2024)

Preference Elicitation for Multi-objective Combinatorial Optimization with Active Learning and Maximum Likelihood Estimation
by: Defresne, Marianne, et al.
Published: (2025)

Implicit Maximum Likelihood Estimation for Real-time Generative Model Predictive Control
by: Lee, Grayson, et al.
Published: (2026)

ELEMENT: Episodic and Lifelong Exploration via Maximum Entropy
by: Li, Hongming, et al.
Published: (2024)

IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation
by: Rana, Krishan, et al.
Published: (2025)

FLAC: Maximum Entropy RL via Kinetic Energy Regularized Bridge Matching
by: Lv, Lei, et al.
Published: (2026)

Maximum Entropy Exploration Without the Rollouts
by: Adamczyk, Jacob, et al.
Published: (2026)

Quotient Normalized Maximum Likelihood Criterion for Learning Bayesian Network Structures
by: Silander, Tomi, et al.
Published: (2024)

When Maximum Entropy Misleads Policy Optimization
by: Zhang, Ruipeng, et al.
Published: (2025)

Maximum Entropy Reinforcement Learning with Diffusion Policy
by: Dong, Xiaoyi, et al.
Published: (2025)

Mind Your Entropy: From Maximum Entropy to Trajectory Entropy-Constrained RL
by: Zhan, Guojian, et al.
Published: (2025)

Learning to Embed Distributions via Maximum Kernel Entropy
by: Kachaiev, Oleksii, et al.
Published: (2024)

Boosting Maximum Entropy Reinforcement Learning via One-Step Flow Matching
by: Li, Zeqiao, et al.
Published: (2026)

Reward-Punishment Reinforcement Learning with Maximum Entropy
by: Wang, Jiexin, et al.
Published: (2024)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning
by: Sanokowski, Sebastian, et al.
Published: (2025)

Why the Maximum Second Derivative of Activations Matters for Adversarial Robustness
by: Yu, Yunrui, et al.
Published: (2026)

Maximum Entropy Inverse Reinforcement Learning of Diffusion Models with Energy-Based Models
by: Yoon, Sangwoong, et al.
Published: (2024)

When Demonstrations Meet Generative World Models: A Maximum Likelihood Framework for Offline Inverse Reinforcement Learning
by: Zeng, Siliang, et al.
Published: (2023)

Bias Detection via Maximum Subgroup Discrepancy
by: Němeček, Jiří, et al.
Published: (2025)

FastDSAC: Unlocking the Potential of Maximum Entropy RL in High-Dimensional Humanoid Control
by: Xue, Jun, et al.
Published: (2026)

Maximum Entropy Behavior Exploration for Sim2Real Zero-Shot Reinforcement Learning
by: Hu, Jiajun, et al.
Published: (2026)

MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation
by: Fu, Yuxiang, et al.
Published: (2025)

Multimodal Functional Maximum Correlation for Emotion Recognition
by: Zheng, Deyang, et al.
Published: (2025)

Mitigating the Likelihood Paradox in Flow-based OOD Detection via Entropy Manipulation
by: Kim, Donghwan, et al.
Published: (2026)

Online Drift Detection with Maximum Concept Discrepancy
by: Wan, Ke, et al.
Published: (2024)

Generalized Attention Flow: Feature Attribution for Transformer Models via Maximum Flow
by: Azarkhalili, Behrooz, et al.
Published: (2025)

Maximum Risk Minimization with Random Forests
by: Freni, Francesco, et al.
Published: (2025)

A Clustering Method with Graph Maximum Decoding Information
by: Xu, Xinrun, et al.
Published: (2024)

Preference as Reward, Maximum Preference Optimization with Importance Sampling
by: Jiang, Zaifan, et al.
Published: (2023)

Probably Approximately Correct Maximum A Posteriori Inference
by: Shorvon, Matthew, et al.
Published: (2026)

Maximum diffusion reinforcement learning
by: Berrueta, Thomas A., et al.
Published: (2023)

Learning Dynamic Representations via An Optimally-Weighted Maximum Mean Discrepancy Optimization Framework for Continual Learning
by: Huang, KaiHui, et al.
Published: (2025)

Bounding Evidence and Estimating Log-Likelihood in VAE
by: Struski, Łukasz, et al.
Published: (2022)

Sensor Design for Accuracy-Bounded Estimation via Maximum-Entropy Likelihood Synthesis
by: Bhattacharya, Raktim
Published: (2026)

An Unsupervised Learning Framework Combined with Heuristics for the Maximum Minimal Cut Problem
by: Liu, Huaiyuan, et al.
Published: (2024)

TAB-Fields: A Maximum Entropy Framework for Mission-Aware Adversarial Planning
by: Puthumanaillam, Gokul, et al.
Published: (2024)

Maximum Redundancy Pruning: A Principle-Driven Layerwise Sparsity Allocation for LLMs
by: Gao, Chang, et al.
Published: (2025)

VFA: Relieving Vector Operations in Flash Attention with Global Maximum Pre-computation
by: Sun, Yupeng, et al.
Published: (2026)