Cover Image

Graph Convolutions Enrich the Self-Attention in Transformers!

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Choi, Jeongwhan, Wi, Hyowon, Kim, Jayoung, Shin, Yehjin, Lee, Kookjin, Trask, Nathaniel, Park, Noseong
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attention
by: Shin, Yehjin, et al.
Published: (2023)

Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain
by: Wi, Hyowon, et al.
Published: (2025)

TV-Rec: Time-Variant Convolutional Filter for Sequential Recommendation
by: Shin, Yehjin, et al.
Published: (2025)

Continuous-time Autoencoders for Regular and Irregular Time Series Imputation
by: Wi, Hyowon, et al.
Published: (2023)

PANDA: Expanded Width-Aware Message Passing Beyond Rewiring
by: Choi, Jeongwhan, et al.
Published: (2024)

RDGCL: Reaction-Diffusion Graph Contrastive Learning for Recommendation
by: Choi, Jeongwhan, et al.
Published: (2023)

SCONE: A Novel Stochastic Sampling to Generate Contrastive Views and Hard Negative Samples for Recommendation
by: Lee, Chaejeong, et al.
Published: (2024)

Graph Signal Processing Meets Mamba2: Adaptive Filter Bank via Delta Modulation
by: Shin, Yehjin, et al.
Published: (2026)

PIORF: Physics-Informed Ollivier-Ricci Flow for Long-Range Interactions in Mesh Graph Neural Networks
by: Yu, Youn-Yeol, et al.
Published: (2025)

Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNs
by: Choi, Jeongwhan, et al.
Published: (2025)

Can TabPFN Compete with GNNs for Node Classification via Graph Tabularization?
by: Choi, Jeongwhan, et al.
Published: (2025)

Possibility for Proactive Anomaly Detection
by: Jeon, Jinsung, et al.
Published: (2025)

Neural Functions for Learning Periodic Signal
by: Cho, Woojin, et al.
Published: (2025)

Efficiently Parameterized Neural Metriplectic Systems
by: Gruber, Anthony, et al.
Published: (2024)

SVD-AE: Simple Autoencoders for Collaborative Filtering
by: Hong, Seoyoung, et al.
Published: (2024)

Bridging Dynamic Factor Models and Neural Controlled Differential Equations for Nowcasting GDP
by: Lim, Seonkyu, et al.
Published: (2024)

Learning Flexible Body Collision Dynamics with Hierarchical Contact Mesh Transformer
by: Yu, Youn-Yeol, et al.
Published: (2023)

Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priors
by: Choi, Jeongwhan, et al.
Published: (2026)

MaD-Scientist: AI-based Scientist solving Convection-Diffusion-Reaction Equations Using Massive PINN-Based Prior Data
by: Kang, Mingu, et al.
Published: (2024)

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity
by: Choi, Kanghyun, et al.
Published: (2024)

How Many Experts Are Enough? Towards Optimal Semantic Specialization for Mixture-of-Experts
by: Park, Sumin, et al.
Published: (2025)

Towards Unified and Adaptive Cross-Domain Collaborative Filtering via Graph Signal Processing
by: Lee, Jeongeun, et al.
Published: (2024)

Learning Low Rank Neural Representations of Hyperbolic Wave Dynamics from Data
by: Cho, Woojin, et al.
Published: (2025)

FastLRNR and Sparse Physics Informed Backpropagation
by: Cho, Woojin, et al.
Published: (2024)

SPI-GAN: Denoising Diffusion GANs with Straight-Path Interpolations
by: Jeon, Jinsung, et al.
Published: (2022)

HINTS: Extraction of Human Insights from Time-Series Without External Sources
by: Jhin, Sheo Yon, et al.
Published: (2025)

Are Self-Attentions Effective for Time Series Forecasting?
by: Kim, Dongbin, et al.
Published: (2024)

Learning to Approximate Adaptive Kernel Convolution on Graphs
by: Sim, Jaeyoon, et al.
Published: (2024)

Attention-based Iterative Decomposition for Tensor Product Representation
by: Park, Taewon, et al.
Published: (2024)

YZS-model: A Predictive Model for Organic Drug Solubility Based on Graph Convolutional Networks and Transformer-Attention
by: Wang, Chenxu, et al.
Published: (2024)

Hyperbolic Heterogeneous Graph Transformer
by: Park, Jongmin, et al.
Published: (2026)

Ordinal Behavior Classification of Student Online Course Interactions
by: Trask, Thomas
Published: (2024)

Multi-View Node Pruning for Accurate Graph Representation
by: Kim, Hanjin, et al.
Published: (2025)

FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer
by: Hwang, Dongyeong, et al.
Published: (2024)

A Simplifying and Learnable Graph Convolutional Attention Network for Unsupervised Knowledge Graphs Alignment
by: Cai, Weishan, et al.
Published: (2024)

Longer Attention Span: Increasing Transformer Context Length with Sparse Graph Processing Techniques
by: Tomczak, Nathaniel, et al.
Published: (2025)

IConv: Focusing on Local Variation with Channel Independent Convolution for Multivariate Time Series Forecasting
by: Lee, Gawon, et al.
Published: (2025)

Multi-Hyperbolic Space-based Heterogeneous Graph Attention Network
by: Park, Jongmin, et al.
Published: (2024)

Grouped Differential Attention
by: Lim, Junghwan, et al.
Published: (2025)

A meshfree exterior calculus for generalizable and data-efficient learning of physics from point clouds
by: Shaffer, Benjamin D., et al.
Published: (2026)