Imagen de Portada

Fine-grained Attention in Hierarchical Transformers for Tabular Time-series

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Azorin, Raphael, Houidi, Zied Ben, Gallo, Massimo, Finamore, Alessandro, Michiardi, Pietro
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning I.2.6
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Just In Time Transformers
por: Benali, Ahmed Ala Eddine, et al.
Publicado: (2024)

Chunked TabPFN: Exact Training-Free In-Context Learning for Long-Context Tabular Data
por: Sergazinov, Renat, et al.
Publicado: (2025)

Fusing Rewards and Preferences in Reinforcement Learning
por: Khorasani, Sadegh, et al.
Publicado: (2025)

TensorLens: End-to-End Transformer Analysis via High-Order Attention Tensors
por: Atad, Ido Andrew, et al.
Publicado: (2026)

Hierarchical Reinforcement Learning with Targeted Causal Interventions
por: Khorasani, Sadegh, et al.
Publicado: (2025)

ArrowFlow: Hierarchical Machine Learning in the Space of Permutations
por: Yilmaz, Ozgur
Publicado: (2026)

Boosting gets full Attention for Relational Learning
por: Guillame-Bert, Mathieu, et al.
Publicado: (2024)

Real-Time Pulsatile Flow Prediction for Realistic, Diverse Intracranial Aneurysm Morphologies using a Graph Transformer and Steady-Flow Data Augmentation
por: Sheng, Yiying, et al.
Publicado: (2026)

Transformers Boost the Performance of Decision Trees on Tabular Data across Sample Sizes
por: Jayawardhana, Mayuka, et al.
Publicado: (2025)

RXNRECer Enables Fine-grained Enzymatic Function Annotation through Active Learning and Protein Language Models
por: Shi, Zhenkun, et al.
Publicado: (2026)

Versatile Ordering Network: An Attention-based Neural Network for Ordering Across Scales and Quality Metrics
por: Yu, Zehua, et al.
Publicado: (2024)

Understanding the Limits of Deep Tabular Methods with Temporal Shift
por: Cai, Hao-Run, et al.
Publicado: (2025)

TimeCatcher: A Variational Framework for Volatility-Aware Forecasting of Non-Stationary Time Series
por: Chen, Zhiyu, et al.
Publicado: (2026)

MotherNet: Fast Training and Inference via Hyper-Network Transformers
por: Müller, Andreas, et al.
Publicado: (2023)

HAPEns: Hardware-Aware Post-Hoc Ensembling for Tabular Data
por: Maier, Jannis, et al.
Publicado: (2026)

Feature-aware Modulation for Learning from Temporal Tabular Data
por: Cai, Hao-Run, et al.
Publicado: (2025)

Adaptive$^2$: Adaptive Domain Mining for Fine-grained Domain Adaptation Modeling
por: Sun, Wenxuan, et al.
Publicado: (2024)

AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark
por: Katakam, Raj Kiran Gupta
Publicado: (2026)

Deep Memory Search: A Metaheuristic Approach for Optimizing Heuristic Search
por: Hedar, Abdel-Rahman, et al.
Publicado: (2024)

Attention in SRAM on Tenstorrent Grayskull
por: Thüning, Moritz
Publicado: (2024)

Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers
por: Gray, Gavia, et al.
Publicado: (2024)

Tabby: A Language Model Architecture for Tabular and Structured Data Synthesis
por: Cromp, Sonia, et al.
Publicado: (2025)

Recurrent Memory-Augmented Transformers with Chunked Attention for Long-Context Language Modeling
por: Kashyap, Ankit
Publicado: (2025)

Synergy over Discrepancy: A Partition-Based Approach to Multi-Domain LLM Fine-Tuning
por: Ye, Hua, et al.
Publicado: (2025)

Inference-Time Machine Unlearning via Gated Activation Redirection
por: Turani, Vinícius Conte, et al.
Publicado: (2026)

KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
por: Mi, Zhendong, et al.
Publicado: (2025)

NoRIN: Backbone-Adaptive Reversible Normalization for Time-Series Forecasting
por: Zhang, Shun, et al.
Publicado: (2026)

Symbol-Temporal Consistency Self-supervised Learning for Robust Time Series Classification
por: Garcia, Kevin, et al.
Publicado: (2025)

Why LoRA Resists Label Noise: A Theoretical Framework for Noise-Robust Parameter-Efficient Fine-Tuning
por: Steele, Brady
Publicado: (2026)

xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories
por: Kraus, Maurice, et al.
Publicado: (2024)

Revisiting LRP: Positional Attribution as the Missing Ingredient for Transformer Explainability
por: Bakish, Yarden, et al.
Publicado: (2025)

Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data
por: Helli, Kai, et al.
Publicado: (2024)

Sensorformer: Cross-patch attention with global-patch compression is effective for high-dimensional multivariate time series forecasting
por: Qin, Liyang, et al.
Publicado: (2025)

Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition
por: Bouchabou, Damien, et al.
Publicado: (2024)

Variance Is Not Importance: Structural Analysis of Transformer Compressibility Across Model Scales
por: Salfati, Samuel
Publicado: (2026)

QuAnTS: Question Answering on Time Series
por: Divo, Felix, et al.
Publicado: (2025)

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models
por: Moghadasi, Mahdi Naser, et al.
Publicado: (2026)

COMET: Codebook-based Online-adaptive Multi-scale Embedding for Time-series Anomaly Detection
por: Park, Jinwoo, et al.
Publicado: (2026)

AI and Machine Learning Approaches for Predicting Nanoparticles Toxicity The Critical Role of Physiochemical Properties
por: Yousaf, Iqra
Publicado: (2024)

Prior-Aligned Data Cleaning for Tabular Foundation Models
por: Berti-Equille, Laure
Publicado: (2026)