Copertina

Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Yingyi, Tao, Qinghua, Tonin, Francesco, Suykens, Johan A. K.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Learning in Feature Spaces via Coupled Covariances: Asymmetric Kernel SVD and Nyström method
di: Tao, Qinghua, et al.
Pubblicazione: (2024)

Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformers
di: Chen, Pengtao, et al.
Pubblicazione: (2025)

Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Light
di: Hassani, Ali, et al.
Pubblicazione: (2025)

SLA2: Sparse-Linear Attention with Learnable Routing and QAT
di: Zhang, Jintao, et al.
Pubblicazione: (2026)

Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis
di: Teo, Rachel S. Y., et al.
Pubblicazione: (2024)

Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations
di: Kumar, Manoj, et al.
Pubblicazione: (2024)

BLADE: Block-Sparse Attention Meets Step Distillation for Efficient Video Generation
di: Gu, Youping, et al.
Pubblicazione: (2025)

BSA: Ball Sparse Attention for Large-scale Geometries
di: Brita, Catalin E., et al.
Pubblicazione: (2025)

A Reproduction Study: The Kernel PCA Interpretation of Self-Attention Fails Under Scrutiny
di: Sarıtaş, Karahan, et al.
Pubblicazione: (2025)

SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference
di: Zhang, Jintao, et al.
Pubblicazione: (2025)

VideoNSA: Native Sparse Attention Scales Video Understanding
di: Song, Enxin, et al.
Pubblicazione: (2025)

PSA: Pyramid Sparse Attention for Efficient Video Understanding and Generation
di: Li, Xiaolong, et al.
Pubblicazione: (2025)

Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation
di: Li, Xingyang, et al.
Pubblicazione: (2025)

COT Flow: Learning Optimal-Transport Image Sampling and Editing by Contrastive Pairs
di: Zu, Xinrui, et al.
Pubblicazione: (2024)

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
di: Zhang, Jintao, et al.
Pubblicazione: (2025)

Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization
di: Ghosh, Avrajit, et al.
Pubblicazione: (2024)

Deep Variational Bayesian Modeling of Haze Degradation Process
di: Im, Eun Woo, et al.
Pubblicazione: (2024)

Deblur Gaussian Splatting SLAM
di: Girlanda, Francesco, et al.
Pubblicazione: (2025)

Few-Shot Class Incremental Learning with Attention-Aware Self-Adaptive Prompt
di: Liu, Chenxi, et al.
Pubblicazione: (2024)

Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level
di: Hassani, Ali, et al.
Pubblicazione: (2024)

Navigating Efficiency in MobileViT through Gaussian Process on Global Architecture Factors
di: Meng, Ke, et al.
Pubblicazione: (2024)

Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance
di: Ahn, Donghoon, et al.
Pubblicazione: (2024)

Human Activity Recognition from Wearable Sensor Data Using Self-Attention
di: Mahmud, Saif, et al.
Pubblicazione: (2020)

Gaussian Process Emulators for Few-Shot Segmentation in Cardiac MRI
di: Viti, Bruno, et al.
Pubblicazione: (2024)

Fairness-aware Vision Transformer via Debiased Self-Attention
di: Qiang, Yao, et al.
Pubblicazione: (2023)

TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models
di: Jin, Xin, et al.
Pubblicazione: (2026)

KernelDNA: Dynamic Kernel Sharing via Decoupled Naive Adapters
di: Huang, Haiduo, et al.
Pubblicazione: (2025)

SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussians
di: Schoneveld, Liam, et al.
Pubblicazione: (2025)

Domain Adaptation and Multi-view Attention for Learnable Landmark Tracking with Sparse Data
di: Chase Jr, Timothy, et al.
Pubblicazione: (2025)

Angular Constraint Embedding via SpherePair Loss for Constrained Clustering
di: Zhang, Shaojie, et al.
Pubblicazione: (2025)

MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian Splatting
di: Chang, Hanzhi, et al.
Pubblicazione: (2025)

Do Sparse Subnetworks Exhibit Cognitively Aligned Attention? Effects of Pruning on Saliency Map Fidelity, Sparsity, and Concept Coherence
di: Suwal, Sanish, et al.
Pubblicazione: (2025)

Membership Inference Attacks against Large Vision-Language Models
di: Li, Zhan, et al.
Pubblicazione: (2024)

Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental Learning
di: Bhat, Prashant, et al.
Pubblicazione: (2024)

Divided Attention: Unsupervised Multi-Object Discovery with Contextually Separated Slots
di: Lao, Dong, et al.
Pubblicazione: (2023)

InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models
di: Tao, Hongyuan, et al.
Pubblicazione: (2025)

AugGS: Self-augmented Gaussians with Structural Masks for Sparse-view 3D Reconstruction
di: Du, Bi'an, et al.
Pubblicazione: (2024)

Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting
di: Wang, Yixin, et al.
Pubblicazione: (2026)

Variational Bayes Gaussian Splatting
di: Van de Maele, Toon, et al.
Pubblicazione: (2024)

LiteAttention: A Temporal Sparse Attention for Diffusion Transformers
di: Shmilovich, Dor, et al.
Pubblicazione: (2025)