:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Ku, Eugene
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2312.11730
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning
by: Ku, Eugene
Published: (2024)

Regularizing Attention Scores with Bootstrapping
by: Chung, Neo Christopher, et al.
Published: (2026)

Stronger Normalization-Free Transformers
by: Chen, Mingzhi, et al.
Published: (2025)

Graph-Based Financial Fraud Detection with Calibrated Risk Scoring and Structural Regularization
by: Nie, Yunfei, et al.
Published: (2026)

Efficient Attention via Pre-Scoring: Prioritizing Informative Keys in Transformers
by: Li, Zhexiang, et al.
Published: (2025)

Graph External Attention Enhanced Transformer
by: Liang, Jianqing, et al.
Published: (2024)

Spatially Regularized Graph Attention Autoencoder Framework for Detecting Rainfall Extremes
by: Agarwal, Mihir, et al.
Published: (2024)

Towards Mechanistic Interpretability of Graph Transformers via Attention Graphs
by: El, Batu, et al.
Published: (2025)

Graph Convolutions Enrich the Self-Attention in Transformers!
by: Choi, Jeongwhan, et al.
Published: (2023)

When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
by: Sanyal, Sunny, et al.
Published: (2024)

Score Regularized Policy Optimization through Diffusion Behavior
by: Chen, Huayu, et al.
Published: (2023)

Cluster-wise Graph Transformer with Dual-granularity Kernelized Attention
by: Huang, Siyuan, et al.
Published: (2024)

SFi-Former: Sparse Flow Induced Attention for Graph Transformer
by: Li, Zhonghao, et al.
Published: (2025)

Multi-Label Learning with Stronger Consistency Guarantees
by: Mao, Anqi, et al.
Published: (2024)

AttentionDrop: A Novel Regularization Method for Transformer Models
by: Baig, Mirza Samad Ahmed, et al.
Published: (2025)

Graph Regularized PCA
by: Briola, Antonio, et al.
Published: (2026)

Stronger Random Baselines for In-Context Learning
by: Yauney, Gregory, et al.
Published: (2024)

AnchorGT: Efficient and Flexible Attention Architecture for Scalable Graph Transformers
by: Zhu, Wenhao, et al.
Published: (2024)

A2SF: Accumulative Attention Scoring with Forgetting Factor for Token Pruning in Transformer Decoder
by: Jo, Hyun-rae, et al.
Published: (2024)

VecFormer: Towards Efficient and Generalizable Graph Transformer with Graph Token Attention
by: Zhou, Jingbo, et al.
Published: (2026)

Likelihood-guided Regularization in Attention Based Models
by: Salem, Mohamed, et al.
Published: (2025)

Quaternion Self-Attention with Shared Scores
by: Yamauchi, Shogo, et al.
Published: (2026)

Hybrid Focal and Full-Range Attention Based Graph Transformers
by: Zhu, Minhong, et al.
Published: (2023)

Optimal Denoising in Score-Based Generative Models: The Role of Data Regularity
by: Beyler, Eliot, et al.
Published: (2025)

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
by: Luo, Yi, et al.
Published: (2026)

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
by: De Schouwer, Jonas, et al.
Published: (2026)

SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attention
by: Sun, Yundong, et al.
Published: (2024)

Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance
by: Gentiloni-Silveri, Marta, et al.
Published: (2025)

SALSA: Soup-based Alignment Learning for Stronger Adaptation in RLHF
by: Chegini, Atoosa, et al.
Published: (2024)

PACT: Peak-Aware Cross-Attention Graph Transformers for Efficient Storm-Surge Emulation
by: Liu, Zesheng, et al.
Published: (2026)

Time-aware Heterogeneous Graph Transformer with Adaptive Attention Merging for Health Event Prediction
by: Li, Shibo, et al.
Published: (2024)

Graph Contrastive Learning with Low-Rank Regularization and Low-Rank Attention for Noisy Node Classification
by: Wang, Yancheng, et al.
Published: (2024)

Spacetime $E(n)$-Transformer: Equivariant Attention for Spatio-temporal Graphs
by: Charles, Sergio G.
Published: (2024)

Attention Dispersion in Dynamic Graph Transformers: Diagnosis and a Transferable Fix
by: Zhang, Jinhao, et al.
Published: (2026)

Cardinality-Preserving Attention Channels for Graph Transformers in Molecular Property Prediction
by: Gupta, Abhijit
Published: (2026)

Scaling Graph Transformers: A Comparative Study of Sparse and Dense Attention
by: Dimitrov, Leon
Published: (2025)

Exploring the Global-to-Local Attention Scheme in Graph Transformers: An Empirical Study
by: Wu, Gang, et al.
Published: (2025)

Emergence of Episodic Memory in Transformers: Characterizing Changes in Temporal Structure of Attention Scores During Training
by: Mistry, Deven Mahesh, et al.
Published: (2025)

Learning Regularization for Graph Inverse Problems
by: Eliasof, Moshe, et al.
Published: (2024)

LLMBoost: Make Large Language Models Stronger with Boosting
by: Chen, Zehao, et al.
Published: (2025)