Cover Image

From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kofinas, Miltiadis, Papa, Samuele, Gavves, Efstratios
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Latent Field Discovery In Interacting Dynamical Systems With Neural Fields
by: Kofinas, Miltiadis, et al.
Published: (2023)

Roto-translated Local Coordinate Frames For Interacting Dynamical Systems
by: Kofinas, Miltiadis, et al.
Published: (2021)

Graph Neural Networks for Learning Equivariant Representations of Neural Networks
by: Kofinas, Miltiadis, et al.
Published: (2024)

Grounding Continuous Representations in Geometry: Equivariant Neural Fields
by: Wessels, David R, et al.
Published: (2024)

Amortized Equation Discovery in Hybrid Dynamical Systems
by: Liu, Yongtuo, et al.
Published: (2024)

Space-Time Continuous PDE Forecasting using Equivariant Neural Fields
by: Knigge, David M., et al.
Published: (2024)

Rethinking the shape convention of an MLP
by: Chen, Meng-Hsi, et al.
Published: (2025)

KAN or MLP: A Fairer Comparison
by: Yu, Runpeng, et al.
Published: (2024)

Mechanistic Neural Networks for Scientific Machine Learning
by: Pervez, Adeel, et al.
Published: (2024)

KAN v.s. MLP for Offline Reinforcement Learning
by: Guo, Haihong, et al.
Published: (2024)

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions
by: Neo, Clement, et al.
Published: (2024)

(GG) MoE vs. MLP on Tabular Data
by: Chernov, Andrei
Published: (2025)

How to Train Neural Field Representations: A Comprehensive Study and Benchmark
by: Papa, Samuele, et al.
Published: (2023)

JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention
by: Tian, Yuandong, et al.
Published: (2023)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
by: Zhu, Hourun, et al.
Published: (2025)

GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation
by: Li, Wenhao, et al.
Published: (2022)

Learning to Select MCP Algorithms: From Traditional ML to Dual-Channel GAT-MLP
by: Li, Xiang, et al.
Published: (2025)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
by: Lu, Weigang, et al.
Published: (2024)

HyperMLP: An Integrated Perspective for Sequence Modeling
by: Lu, Jiecheng, et al.
Published: (2026)

A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis
by: Zhong, Shuhan, et al.
Published: (2023)

Aggregation-aware MLP: An Unsupervised Approach for Graph Message-passing
by: Xie, Xuanting, et al.
Published: (2025)

MLP-SRGAN: A Single-Dimension Super Resolution GAN using MLP-Mixer
by: Mitha, Samir, et al.
Published: (2023)

XLinear: Frequency-Enhanced MLP with CrossFilter for Robust Long-Range Forecasting
by: Ao, Xiang
Published: (2026)

TSKANMixer: Kolmogorov-Arnold Networks with MLP-Mixer Model for Time Series Forecasting
by: Hong, Young-Chae, et al.
Published: (2025)

Superposition as Lossy Compression: Measure with Sparse Autoencoders and Connect to Adversarial Vulnerability
by: Bereska, Leonard, et al.
Published: (2025)

SimMLP: Training MLPs on Graphs without Supervision
by: Wang, Zehong, et al.
Published: (2024)

Unlocking the Power of Patch: Patch-Based MLP for Long-Term Time Series Forecasting
by: Tang, Peiwang, et al.
Published: (2024)

FedMLP: Federated Multi-Label Medical Image Classification under Task Heterogeneity
by: Sun, Zhaobin, et al.
Published: (2024)

KAN versus MLP on Irregular or Noisy Functions
by: Zeng, Chen, et al.
Published: (2024)

Incorporating Exponential Smoothing into MLP: A Simple but Effective Sequence Model
by: Chu, Jiqun, et al.
Published: (2024)

Toeplitz MLP Mixers are Low Complexity, Information-Rich Sequence Models
by: Badger, Benjamin L., et al.
Published: (2026)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
by: Wu, Lirong, et al.
Published: (2024)

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework
by: Li, Junxian, et al.
Published: (2024)

ITS-Mina: A Harris Hawks Optimization-Based All-MLP Framework with Iterative Refinement and External Attention for Multivariate Time Series Forecasting
by: Zamanvaziri, Pourya, et al.
Published: (2026)

M3-Net: A Cost-Effective Graph-Free MLP-Based Model for Traffic Prediction
by: Jin, Guangyin, et al.
Published: (2025)

Avocado Price Prediction Using a Hybrid Deep Learning Model: TCN-MLP-Attention Architecture
by: Zhang, Linwei, et al.
Published: (2025)

Language Agents Meet Causality -- Bridging LLMs and Causal World Models
by: Gkountouras, John, et al.
Published: (2024)

Cross-Gate MLP with Protein Complex Invariant Embedding is A One-Shot Antibody Designer
by: Tan, Cheng, et al.
Published: (2023)

DynamicGate MLP Conditional Computation via Learned Structural Dropout and Input Dependent Gating for Functional Plasticity
by: Choi, Yong Il
Published: (2026)

A Multimodal Fusion Model Leveraging MLP Mixer and Handcrafted Features-based Deep Learning Networks for Facial Palsy Detection
by: Oo, Heng Yim Nicole, et al.
Published: (2025)