Cover Image

Unified CNNs and transformers underlying learning mechanism reveals multi-head attention modus vivendi

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Koresh, Ella, Gross, Ronit D., Meir, Yuval, Tzach, Yarden, Halevi, Tal, Kanter, Ido
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Low-latency vision transformers via large-scale multi-head attention
by: Gross, Ronit D., et al.
Published: (2025)

Tiny language models
by: Gross, Ronit D., et al.
Published: (2025)

Self-attention vector output similarities reveal how machines pay attention
by: Halevi, Tal, et al.
Published: (2025)

Advanced deep architecture pruning using single filter performance
by: Tzach, Yarden, et al.
Published: (2025)

Learning Mechanism Underlying NLP Pre-Training and Fine-Tuning
by: Tzach, Yarden, et al.
Published: (2025)

Towards a universal mechanism for successful deep learning
by: Meir, Yuval, et al.
Published: (2023)

Single-Nodal Spontaneous Symmetry Breaking in NLP Models
by: Rosner, Shalom, et al.
Published: (2026)

Role of Delay in Brain Dynamics
by: Meir, Yuval, et al.
Published: (2024)

Translation Entropy: A Statistical Framework for Evaluating Translation Systems
by: Gross, Ronit D., et al.
Published: (2025)

Da educação: do jogo sociocultural e a inter-relação envolvendo modus vivendi e modus essendi
by: Luiz Carlos Mariano da Rosa
Published: (2011)

Shrinkage under Random Projections, and Cubic Formula Lower Bounds for $\mathsf{AC}^0$
by: Filmus, Yuval, et al.
Published: (2020)

Provably learning a multi-head attention layer
by: Chen, Sitan, et al.
Published: (2024)

An efficient object tracking based on multi‐head cross‐attention transformer
by: Jiahai Dai, et al.
Published: (2024)

Contracting Endomorphisms of Valued Fields
by: Dor, Yuval, et al.
Published: (2023)

De la resistencia a la caridad. Hacia el Ideal, un boletín católico femenino para el modus vivendi en Sonora (1939-1940)
by: Elizabeth Cejudo Ramos
Published: (2023)

Ultrahigh-Q chiral resonances empowered by multi-head attention deep learning
by: Zhang, Cong, et al.
Published: (2025)

Federated learning based multi‐head attention framework for medical image classification
by: Naima Firdaus, et al.
Published: (2024)

Strategyproof Facility Location for Five Agents on a Circle using PCD
by: Farjoun, Ido, et al.
Published: (2025)

Sentiment analysis with adaptive multi-head attention in Transformer
by: Meng, Fanfei, et al.
Published: (2023)

Perpetual Fully-Online Approximate Fairness
by: Kahana, Ido, et al.
Published: (2026)

Easy attention: A simple attention mechanism for temporal predictions with transformers
by: Sanchis-Agudo, Marcial, et al.
Published: (2023)

Distinct mechanisms underlying in-context learning in transformers
by: Gibson, Cole, et al.
Published: (2026)

RF plugging of multi-mirror machines
by: Miller, Tal, et al.
Published: (2023)

Hybrid Deep Learning Model for epileptic seizure classification by using 1D-CNN with multi-head attention mechanism
by: Guhdar, Mohammed, et al.
Published: (2025)

Cross‐modal embedding integrator for disease‐gene/protein association prediction using a multi‐head attention mechanism
by: Munyoung Chang, et al.
Published: (2024)

DEDUCE: Multi-head attention decoupled contrastive learning to discover cancer subtypes based on multi-omics data
by: Pan, Liangrui, et al.
Published: (2023)

Strong Polarization for Shortened and Punctured Polar Codes
by: Shuval, Boaz, et al.
Published: (2024)

Constant Weight Polar Codes through Periodic Markov Processes
by: Shuval, Boaz, et al.
Published: (2025)

Stronger Polarization for the Deletion Channel
by: Arava, Dar, et al.
Published: (2023)

Universal Polarization for Processes with Memory
by: Shuval, Boaz, et al.
Published: (2018)

IncepFormerNet: A multi-scale multi-head attention network for SSVEP classification
by: Huang, Yan, et al.
Published: (2025)

Optimization of bi-directional gated loop cell based on multi-head attention mechanism for SSD health state classification model
by: Wen, Zhizhao, et al.
Published: (2025)

Plugging of multi-mirror machines by a traveling rotating magnetic field
by: Miller, Tal, et al.
Published: (2026)

Joint auto-encoders: a flexible multi-task learning framework
by: Epstein, Baruch, et al.
Published: (2017)

Competing Under Oath: Can Honesty Pledges Reduce Cheating in Competitive Environments?
by: Ronit Montal‐Rosenberg, et al.
Published: (2025)

CNN-TFT explained by SHAP with multi-head attention weights for time series forecasting
by: Stefenon, Stefano F., et al.
Published: (2025)

Balanced segmentation of CNNs for multi-TPU inference
by: Villarrubia, Jorge, et al.
Published: (2025)

Supervised Hebbian Learning
by: Alemanno, Francesco, et al.
Published: (2022)

Models of Abelian varieties over valued fields, using model theory
by: Halevi, Yatir
Published: (2023)

Joint multi-dimensional dynamic attention and transformer for general image restoration
by: Zhang, Huan, et al.
Published: (2024)