Image de couverture de livre

Prediction of Herd Life in Dairy Cows Using Multi-Head Attention Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Saki, Mahdi, Lipman, Justin
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A Data-Driven Review of Remote Sensing-Based Data Fusion in Precision Agriculture from Foundational to Transformer-Based Techniques
par: Saki, Mahdi, et autres
Publié: (2024)

Memorization Capacity of Multi-Head Attention in Transformers
par: Mahdavi, Sadegh, et autres
Publié: (2023)

A Novel Hybrid Approach Using an Attention-Based Transformer + GRU Model for Predicting Cryptocurrency Prices
par: Mahdi, Esam, et autres
Publié: (2025)

Improving Transformers with Dynamically Composable Multi-Head Attention
par: Xiao, Da, et autres
Publié: (2024)

Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformers
par: Musat, Tiberiu
Publié: (2024)

Adaptive Head Budgeting for Efficient Multi-Head Attention
par: Faye, Bilal, et autres
Publié: (2026)

Multi-Head Attention as a Source of Catastrophic Forgetting in MoE Transformers
par: Chen, Anrui, et autres
Publié: (2026)

The Effect of Attention Head Count on Transformer Approximation
par: Yu, Penghao, et autres
Publié: (2025)

Epileptic Seizure Prediction Using Patient-Adaptive Transformer Networks
par: Mahdi, Mohamed, et autres
Publié: (2026)

Multi-Head Low-Rank Attention
par: Liu, Songtao, et autres
Publié: (2026)

Self-Tuning Sparse Attention: Multi-Fidelity Hyperparameter Optimization for Transformer Acceleration
par: Dev, Arundhathi, et autres
Publié: (2026)

Linear Predictability of Attention Heads in Large Language Models
par: Shaikh, Khalid, et autres
Publié: (2026)

Attention Head Entropy of LLMs Predicts Answer Correctness
par: Ostmeier, Sophie, et autres
Publié: (2026)

Herding LLaMaS: Using LLMs as an OS Module
par: Kamath, Aditya K, et autres
Publié: (2024)

Global and Local Topology-Aware Attention with Persistent Homology and Euler Biases for Time-Series Forecasting
par: Faghihi, Usef, et autres
Publié: (2026)

HGC-Herd: Efficient Heterogeneous Graph Condensation via Representative Node Herding
par: Ou, Fuyan, et autres
Publié: (2025)

MoH: Multi-Head Attention as Mixture-of-Head Attention
par: Jin, Peng, et autres
Publié: (2024)

How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression
par: Chen, Xingwu, et autres
Publié: (2024)

Multi-Channel Swin Transformer Framework for Bearing Remaining Useful Life Prediction
par: Mohajerzarrinkelk, Ali, et autres
Publié: (2025)

Interleaved Head Attention
par: Duvvuri, Sai Surya, et autres
Publié: (2026)

Boosting House Price Estimations with Multi-Head Gated Attention
par: Sellam, Zakaria Abdellah, et autres
Publié: (2024)

ECG Signal Denoising Using Multi-scale Patch Embedding and Transformers
par: Zhu, Ding, et autres
Publié: (2024)

Predicting BVD Re-emergence in Irish Cattle From Highly Imbalanced Herd-Level Data Using Machine Learning Algorithms
par: Mimnagh, Niamh, et autres
Publié: (2025)

A Novel Hybrid Approach for Tornado Prediction in the United States: Kalman-Convolutional BiLSTM with Multi-Head Attention
par: Zhou, Jiawei
Publié: (2024)

Beyond Parallelism: Synergistic Computational Graph Effects in Multi-Head Attention
par: Borde, Haitz Sáez de Ocáriz
Publié: (2025)

The Anxiety of Influence: Bloom Filters in Transformer Attention Heads
par: Balogh, Peter
Publié: (2026)

Geometric Analysis of Token Selection in Multi-Head Attention
par: Mudarisov, Timur, et autres
Publié: (2026)

Superiority of Multi-Head Attention in In-Context Linear Regression
par: Cui, Yingqian, et autres
Publié: (2024)

A Multi-Head Attention Soft Random Forest for Interpretable Patient No-Show Prediction
par: Amalina, Ninda Nurseha, et autres
Publié: (2025)

Quantum Graph Attention Network: A Novel Quantum Multi-Head Attention Mechanism for Graph Learning
par: Ning, An, et autres
Publié: (2025)

A Hybrid CNN-Transformer Model for Heart Disease Prediction Using Life History Data
par: Hao, Ran, et autres
Publié: (2025)

Exploring the Design Space of Transition Matching
par: Singer, Uriel, et autres
Publié: (2025)

STPOTR: Simultaneous Human Trajectory and Pose Prediction Using a Non-Autoregressive Transformer for Robot Following Ahead
par: Mahdavian, Mohammad, et autres
Publié: (2022)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
par: Csordás, Róbert, et autres
Publié: (2023)

A Multi-Head Attention Approach for SLA Compliance Monitoring in Data Centers
par: Thapliyal, Omanshu
Publié: (2026)

A Capacity-Based Rationale for Multi-Head Attention
par: Adler, Micah
Publié: (2025)

The Strong Lottery Ticket Hypothesis for Multi-Head Attention Mechanisms
par: Otsuka, Hikari, et autres
Publié: (2025)

Ensembling Pruned Attention Heads For Uncertainty-Aware Efficient Transformers
par: Gabetni, Firas, et autres
Publié: (2025)

RecurFormer: Not All Transformer Heads Need Self-Attention
par: Yan, Ruiqing, et autres
Publié: (2024)

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
par: Chen, Yilong, et autres
Publié: (2024)