Higher-Order Modular Attention: Fusing Pairwise and Triadic Interactions for Protein Sequences

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Amiraslani, Shirin, Gao, Xin
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

EcoTransformer: Attention without Multiplication
par: Gao, Xin, et autres
Publié: (2025)

Beyond Pairwise Correlations: Higher-Order Redundancies in Self-Supervised Representation Learning
par: Zollikofer, David, et autres
Publié: (2024)

Minimax Rates for Learning Pairwise Interactions in Attention-Style Models
par: Zucker, Shai, et autres
Publié: (2025)

Causal Discovery on Higher-Order Interactions
par: Zanga, Alessio, et autres
Publié: (2025)

Higher-Order Transformers With Kronecker-Structured Attention
par: Omranpour, Soroush, et autres
Publié: (2024)

Tree-like Pairwise Interaction Networks
par: Richman, Ronald, et autres
Publié: (2025)

Automated Discovery of Pairwise Interactions from Unstructured Data
par: Zuheng, et autres
Publié: (2024)

Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors
par: Jang, Jun-Gi, et autres
Publié: (2025)

PSC-CPI: Multi-Scale Protein Sequence-Structure Contrasting for Efficient and Generalizable Compound-Protein Interaction Prediction
par: Wu, Lirong, et autres
Publié: (2024)

Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systems
par: Ju, Xin, et autres
Publié: (2026)

Training-Free Generation of Protein Sequences from Small Family Alignments via Stochastic Attention
par: Varner, Jeffrey D.
Publié: (2026)

Hypergraph Pattern Machine: Compositional Tokenization for Higher-Order Interactions
par: Zhao, Kyrie, et autres
Publié: (2026)

Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solvers
par: Shishehbor, Mehdi, et autres
Publié: (2024)

HoGA: Higher-Order Graph Attention via Diversity-Aware k-Hop Sampling
par: Bailie, Thomas, et autres
Publié: (2024)

Expressive Higher-Order Link Prediction through Hypergraph Symmetry Breaking
par: Zhang, Simon, et autres
Publié: (2024)

On Recovering Higher-order Interactions from Protein Language Models
par: Tsui, Darin, et autres
Publié: (2024)

A General Algorithm for Detecting Higher-Order Interactions via Random Sequential Additions
par: Shamail, Ahmad, et autres
Publié: (2025)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
par: Sharma, Jai, et autres
Publié: (2026)

Dynamic Topic Modeling with a Higher-Order Hypergraphical Representation
par: Gao, Hanjia, et autres
Publié: (2026)

Multi-level Interaction Modeling for Protein Mutational Effect Prediction
par: Mo, Yuanle, et autres
Publié: (2024)

Beyond Pairwise Connections: Extracting High-Order Functional Brain Network Structures under Global Constraints
par: Zhan, Ling, et autres
Publié: (2025)

NOAH: Learning Pairwise Object Category Attentions for Image Classification
par: Li, Chao, et autres
Publié: (2024)

idMotif: An Interactive Motif Identification in Protein Sequences
par: Park, Ji Hwan, et autres
Publié: (2024)

Relaxed Sequence Sampling for Diverse Protein Design
par: Ko, Joohwan, et autres
Publié: (2025)

Dynamic Vine Copulas: Detecting and Quantifying Time-Varying Higher-Order Interactions
par: Safaai, Houman, et autres
Publié: (2026)

The Power of Second Order Methods for Sequence Preconditioning
par: Marsden, Annie, et autres
Publié: (2026)

Learning to Order: Task Sequencing as In-Context Optimization
par: Kobiolka, Jan, et autres
Publié: (2026)

Multimodal Data Curation Through Ranked Retrieval
par: Muthukumar, Pratyush, et autres
Publié: (2026)

A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention
par: Yang, Tao, et autres
Publié: (2025)

HONEM: Learning Embedding for Higher Order Networks
par: Saebi, Mandana, et autres
Publié: (2019)

Extracting Protein-Protein Interactions (PPIs) from Biomedical Literature using Attention-based Relational Context Information
par: Park, Gilchan, et autres
Publié: (2024)

Higher-Order LaSDI: Reduced Order Modeling with Multiple Time Derivatives
par: Stephany, Robert, et autres
Publié: (2025)

Fourier-Mixed Window Attention: Accelerating Informer for Long Sequence Time-Series Forecasting
par: Tran, Nhat Thanh, et autres
Publié: (2023)

Attention-Bayesian Hybrid Approach to Modular Multiple Particle Tracking
par: Mishra, Piyush, et autres
Publié: (2025)

Peptide Sequencing Via Protein Language Models
par: Pham, Thuong Le Hoai, et autres
Publié: (2024)

SFADNet: Spatio-temporal Fused Graph based on Attention Decoupling Network for Traffic Prediction
par: Wu, Mei, et autres
Publié: (2025)

A Triadic Suffix Tokenization Scheme for Numerical Reasoning
par: Chetverina, Olga
Publié: (2026)

Topological Neural Networks: Mitigating the Bottlenecks of Graph Neural Networks via Higher-Order Interactions
par: Giusti, Lorenzo
Publié: (2024)

Surrogate Modeling via Factorization Machine and Ising Model with Enhanced Higher-Order Interaction Learning
par: Wang, Anbang, et autres
Publié: (2025)

Pairwise Markov Chains for Volatility Forecasting
par: Azeraf, Elie
Publié: (2024)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
ui	"standard"
language	"fr"
VUFIND_SESSION	"b0c4f6f4315bcd26fc070b3ab940b239"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790808256.7128 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "b0c4f6f4315bcd26fc070b3ab940b239" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"ui=standard; language=fr; VUFIND_SESSION=b0c4f6f4315bcd26fc070b3ab940b239"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.216.147"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"14999"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2603_11133/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2603_11133/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790808256.6955
REQUEST_TIME	1790808256

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler