Copertina

Fine-grained Attention in Hierarchical Transformers for Tabular Time-series

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Azorin, Raphael, Houidi, Zied Ben, Gallo, Massimo, Finamore, Alessandro, Michiardi, Pietro
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning I.2.6
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Just In Time Transformers
di: Benali, Ahmed Ala Eddine, et al.
Pubblicazione: (2024)

Chunked TabPFN: Exact Training-Free In-Context Learning for Long-Context Tabular Data
di: Sergazinov, Renat, et al.
Pubblicazione: (2025)

Fusing Rewards and Preferences in Reinforcement Learning
di: Khorasani, Sadegh, et al.
Pubblicazione: (2025)

TensorLens: End-to-End Transformer Analysis via High-Order Attention Tensors
di: Atad, Ido Andrew, et al.
Pubblicazione: (2026)

Hierarchical Reinforcement Learning with Targeted Causal Interventions
di: Khorasani, Sadegh, et al.
Pubblicazione: (2025)

ArrowFlow: Hierarchical Machine Learning in the Space of Permutations
di: Yilmaz, Ozgur
Pubblicazione: (2026)

Boosting gets full Attention for Relational Learning
di: Guillame-Bert, Mathieu, et al.
Pubblicazione: (2024)

Real-Time Pulsatile Flow Prediction for Realistic, Diverse Intracranial Aneurysm Morphologies using a Graph Transformer and Steady-Flow Data Augmentation
di: Sheng, Yiying, et al.
Pubblicazione: (2026)

Transformers Boost the Performance of Decision Trees on Tabular Data across Sample Sizes
di: Jayawardhana, Mayuka, et al.
Pubblicazione: (2025)

RXNRECer Enables Fine-grained Enzymatic Function Annotation through Active Learning and Protein Language Models
di: Shi, Zhenkun, et al.
Pubblicazione: (2026)

Versatile Ordering Network: An Attention-based Neural Network for Ordering Across Scales and Quality Metrics
di: Yu, Zehua, et al.
Pubblicazione: (2024)

Understanding the Limits of Deep Tabular Methods with Temporal Shift
di: Cai, Hao-Run, et al.
Pubblicazione: (2025)

TimeCatcher: A Variational Framework for Volatility-Aware Forecasting of Non-Stationary Time Series
di: Chen, Zhiyu, et al.
Pubblicazione: (2026)

MotherNet: Fast Training and Inference via Hyper-Network Transformers
di: Müller, Andreas, et al.
Pubblicazione: (2023)

HAPEns: Hardware-Aware Post-Hoc Ensembling for Tabular Data
di: Maier, Jannis, et al.
Pubblicazione: (2026)

Feature-aware Modulation for Learning from Temporal Tabular Data
di: Cai, Hao-Run, et al.
Pubblicazione: (2025)

Adaptive$^2$: Adaptive Domain Mining for Fine-grained Domain Adaptation Modeling
di: Sun, Wenxuan, et al.
Pubblicazione: (2024)

AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark
di: Katakam, Raj Kiran Gupta
Pubblicazione: (2026)

Deep Memory Search: A Metaheuristic Approach for Optimizing Heuristic Search
di: Hedar, Abdel-Rahman, et al.
Pubblicazione: (2024)

Attention in SRAM on Tenstorrent Grayskull
di: Thüning, Moritz
Pubblicazione: (2024)

Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers
di: Gray, Gavia, et al.
Pubblicazione: (2024)

Tabby: A Language Model Architecture for Tabular and Structured Data Synthesis
di: Cromp, Sonia, et al.
Pubblicazione: (2025)

Recurrent Memory-Augmented Transformers with Chunked Attention for Long-Context Language Modeling
di: Kashyap, Ankit
Pubblicazione: (2025)

Synergy over Discrepancy: A Partition-Based Approach to Multi-Domain LLM Fine-Tuning
di: Ye, Hua, et al.
Pubblicazione: (2025)

Inference-Time Machine Unlearning via Gated Activation Redirection
di: Turani, Vinícius Conte, et al.
Pubblicazione: (2026)

KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
di: Mi, Zhendong, et al.
Pubblicazione: (2025)

NoRIN: Backbone-Adaptive Reversible Normalization for Time-Series Forecasting
di: Zhang, Shun, et al.
Pubblicazione: (2026)

Symbol-Temporal Consistency Self-supervised Learning for Robust Time Series Classification
di: Garcia, Kevin, et al.
Pubblicazione: (2025)

Why LoRA Resists Label Noise: A Theoretical Framework for Noise-Robust Parameter-Efficient Fine-Tuning
di: Steele, Brady
Pubblicazione: (2026)

xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories
di: Kraus, Maurice, et al.
Pubblicazione: (2024)

Revisiting LRP: Positional Attribution as the Missing Ingredient for Transformer Explainability
di: Bakish, Yarden, et al.
Pubblicazione: (2025)

Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data
di: Helli, Kai, et al.
Pubblicazione: (2024)

Sensorformer: Cross-patch attention with global-patch compression is effective for high-dimensional multivariate time series forecasting
di: Qin, Liyang, et al.
Pubblicazione: (2025)

Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition
di: Bouchabou, Damien, et al.
Pubblicazione: (2024)

Variance Is Not Importance: Structural Analysis of Transformer Compressibility Across Model Scales
di: Salfati, Samuel
Pubblicazione: (2026)

QuAnTS: Question Answering on Time Series
di: Divo, Felix, et al.
Pubblicazione: (2025)

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models
di: Moghadasi, Mahdi Naser, et al.
Pubblicazione: (2026)

COMET: Codebook-based Online-adaptive Multi-scale Embedding for Time-series Anomaly Detection
di: Park, Jinwoo, et al.
Pubblicazione: (2026)

AI and Machine Learning Approaches for Predicting Nanoparticles Toxicity The Critical Role of Physiochemical Properties
di: Yousaf, Iqra
Pubblicazione: (2024)

Prior-Aligned Data Cleaning for Tabular Foundation Models
di: Berti-Equille, Laure
Pubblicazione: (2026)