Cover Image

PADRe: A Unifying Polynomial Attention Drop-in Replacement for Efficient Vision Transformer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Letourneau, Pierre-David, Singh, Manish Kumar, Cheng, Hsin-Pai, Han, Shizhong, Shi, Yunxiao, Jones, Dalton, Langston, Matthew Harper, Cai, Hong, Porikli, Fatih
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Efficient Framework for Global Non-Convex Polynomial Optimization over the Hypercube
by: Letourneau, Pierre-David, et al.
Published: (2023)

An Efficient Framework for Global Non-Convex Polynomial Optimization with Algebraic Constraints
by: Harris, Mitchell Tong, et al.
Published: (2023)

DeCoTR: Enhancing Depth Completion with 2D and 3D Attentions
by: Shi, Yunxiao, et al.
Published: (2024)

CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformers
by: Li, Zhuojin, et al.
Published: (2026)

ToSA: Token Selective Attention for Efficient Vision Transformers
by: Singh, Manish Kumar, et al.
Published: (2024)

FALO: Fast and Accurate LiDAR 3D Object Detection on Resource-Constrained Devices
by: Han, Shizhong, et al.
Published: (2025)

DySS: Dynamic Queries and State-Space Learning for Efficient 3D Object Detection from Multi-Camera Videos
by: Yasarla, Rajeev, et al.
Published: (2025)

FutureDepth: Learning to Predict the Future Improves Video Depth Estimation
by: Yasarla, Rajeev, et al.
Published: (2024)

RoCA: Robust Cross-Domain End-to-End Autonomous Driving
by: Yasarla, Rajeev, et al.
Published: (2025)

BePo: Dual Representation for 3D Occupancy Prediction
by: Shi, Yunxiao, et al.
Published: (2025)

ODG: Occupancy Prediction Using Dual Gaussians
by: Shi, Yunxiao, et al.
Published: (2025)

H3O: Hyper-Efficient 3D Occupancy Prediction with Heterogeneous Supervision
by: Shi, Yunxiao, et al.
Published: (2025)

MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimation
by: Yasarla, Rajeev, et al.
Published: (2023)

MAPLE: Latent Multi-Agent Play for End-to-End Autonomous Driving
by: Yasarla, Rajeev, et al.
Published: (2026)

Generative Scenario Rollouts for End-to-End Autonomous Driving
by: Yasarla, Rajeev, et al.
Published: (2026)

QUOKA: Query-Oriented KV Selection For Efficient LLM Prefill
by: Jones, Dalton, et al.
Published: (2026)

CAOTE: KV Cache Selection for LLMs via Attention Output Error-Based Token Eviction
by: Goel, Raghavv, et al.
Published: (2025)

Attention Guided Alignment in Efficient Vision-Language Models
by: Mahajan, Shweta, et al.
Published: (2025)

Improving Optical Flow and Stereo Depth Estimation by Leveraging Uncertainty-Based Learning Difficulties
by: Jeong, Jisoo, et al.
Published: (2025)

HAViT: Historical Attention Vision Transformer
by: Banik, Swarnendu, et al.
Published: (2026)

A Non-Abelian Generalization of the Alexander Polynomial from Quantum $\mathfrak{sl}_3$
by: Harper, Matthew
Published: (2020)

Planar Gaussian Splatting
by: Zanjani, Farhad G., et al.
Published: (2024)

Neural Mesh Fusion: Unsupervised 3D Planar Surface Understanding
by: Zanjani, Farhad G., et al.
Published: (2024)

Distilling Multi-modal Large Language Models for Autonomous Driving
by: Hegde, Deepti, et al.
Published: (2025)

UniPlan: Vision-Language Task Planning for Mobile Manipulation with Unified PDDL Formulation
by: Ye, Haoming, et al.
Published: (2026)

SPECTRE: An FFT-Based Efficient Drop-In Replacement to Self-Attention for Long Contexts
by: Fein-Ashley, Jacob, et al.
Published: (2025)

Learning Optical Flow Field via Neural Ordinary Differential Equation
by: Mirvakhabova, Leyla, et al.
Published: (2025)

TinyDrop: Tiny Model Guided Token Dropping for Vision Transformers
by: Wang, Guoxin, et al.
Published: (2025)

SciFlow: Empowering Lightweight Optical Flow Models with Self-Cleaning Iterations
by: Lin, Jamie Menjay, et al.
Published: (2024)

OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation
by: Jeong, Jisoo, et al.
Published: (2024)

Double-P: Hierarchical Top-P Sparse Attention for Long-Context LLMs
by: Ni, Wentao, et al.
Published: (2026)

Detecting Causality with the Links--Gould Polynomial
by: Chernov, Vladimir, et al.
Published: (2026)

Hidden Bias in the Machine: Stereotypes in Text-to-Image Models
by: Porikli, Sedat, et al.
Published: (2025)

CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation
by: Lee, Jungsoo, et al.
Published: (2025)

HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generation
by: Mercier, Antoine, et al.
Published: (2024)

Resolving the Identity Crisis in Text-to-Image Generation
by: Borse, Shubhankar, et al.
Published: (2025)

Segmentation-Free Guidance for Text-to-Image Diffusion Models
by: Azarian, Kambiz, et al.
Published: (2024)

Zero-Shot Adaptation of Parameter-Efficient Fine-Tuning in Diffusion Models
by: Farhadzadeh, Farzad, et al.
Published: (2025)

DDIL: Diversity Enhancing Diffusion Distillation With Imitation Learning
by: Garrepalli, Risheek, et al.
Published: (2024)

LoRA-X: Bridging Foundation Models with Training-Free Cross-Model Adaptation
by: Farhadzadeh, Farzad, et al.
Published: (2025)