Cover Image

Investigating the Effects of Sparse Attention on Cross-Encoders

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Schlatt, Ferdinand, Fröbe, Maik, Hagen, Matthias
Format:	Preprint
Published:	2023
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Lightning IR: Straightforward Fine-tuning and Inference of Transformer-based Language Models for Information Retrieval
by: Schlatt, Ferdinand, et al.
Published: (2024)

Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders
by: Schlatt, Ferdinand, et al.
Published: (2024)

Rank-DistiLLM: Closing the Effectiveness Gap Between Cross-Encoders and LLMs for Passage Re-Ranking
by: Schlatt, Ferdinand, et al.
Published: (2024)

Variations in Relevance Judgments and the Shelf Life of Test Collections
by: Parry, Andrew, et al.
Published: (2025)

Analyzing Adversarial Attacks on Sequence-to-Sequence Relevance Models
by: Parry, Andrew, et al.
Published: (2024)

The Viability of Crowdsourcing for RAG Evaluation
by: Gienapp, Lukas, et al.
Published: (2025)

Counterfactual Query Rewriting to Use Historical Relevance Feedback
by: Keller, Jüri, et al.
Published: (2025)

Systematic Evaluation of Neural Retrieval Models on the Touché 2020 Argument Retrieval Subset of BEIR
by: Thakur, Nandan, et al.
Published: (2024)

Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
by: Keller, Jüri, et al.
Published: (2025)

Multilingual and Domain-Agnostic Tip-of-the-Tongue Query Generation for Simulated Evaluation
by: He, Xuhong, et al.
Published: (2026)

Evaluating Generative Ad Hoc Information Retrieval
by: Gienapp, Lukas, et al.
Published: (2023)

Formalized Information Needs Improve Large-Language-Model Relevance Judgments
by: Keller, Jüri, et al.
Published: (2026)

Overview of the Plagiarism Detection Task at PAN 2025
by: Greiner-Petter, André, et al.
Published: (2025)

Scaling Laws for Cross-Encoder Reranking
by: Seetharaman, Rahul, et al.
Published: (2026)

Reproducing and Comparing Distillation Techniques for Cross-Encoders
by: Morand, Victor, et al.
Published: (2026)

SemBridge: Language Transfer in Sparse Encoders via Multilingual Semantic Bridges
by: Hong, Seongtae, et al.
Published: (2026)

MICE: Minimal Interaction Cross-Encoders for efficient Re-ranking
by: Vast, Mathias, et al.
Published: (2026)

A Thorough Comparison of Cross-Encoders and LLMs for Reranking SPLADE
by: Déjean, Hervé, et al.
Published: (2024)

Distribution-Guided Auto-Encoder for User Multimodal Interest Cross Fusion
by: Zhang, Moyu, et al.
Published: (2025)

Understanding Matching Mechanisms in Cross-Encoders
by: Vast, Mathias, et al.
Published: (2025)

FuXi-$γ$: Efficient Sequential Recommendation with Exponential-Power Temporal Encoder and Diagonal-Sparse Positional Mechanism
by: Yi, Dezhi, et al.
Published: (2025)

Bert4XMR: Cross-Market Recommendation with Bidirectional Encoder Representations from Transformer
by: Hu, Zheng, et al.
Published: (2023)

LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
by: Cancellieri, Matteo, et al.
Published: (2025)

Shallow Cross-Encoders for Low-Latency Retrieval
by: Petrov, Aleksandr V., et al.
Published: (2024)

Investigating the Scalability of Approximate Sparse Retrieval Algorithms to Massive Datasets
by: Bruch, Sebastian, et al.
Published: (2025)

Which Neurons Matter in IR? Applying Integrated Gradients-based Methods to Understand Cross-Encoders
by: Vast, Mathias, et al.
Published: (2024)

Unleashing the Potential of Sparse Attention on Long-term Behaviors for CTR Prediction
by: Lai, Weijiang, et al.
Published: (2026)

Can Cross Encoders Produce Useful Sentence Embeddings?
by: Ananthakrishnan, Haritha, et al.
Published: (2025)

Sensitivity-Aware Retrieval-Augmented Intent Clarification
by: Larooij, Maik
Published: (2026)

Improved Learned Sparse Retrieval with Corpus-Specific Vocabularies
by: Yu, Puxuan, et al.
Published: (2024)

Multimodal Fusion And Sparse Attention-based Alignment Model for Long Sequential Recommendation
by: Fu, Yongrui, et al.
Published: (2025)

Comparative Analysis of Lion and AdamW Optimizers for Cross-Encoder Reranking with MiniLM, GTE, and ModernBERT
by: Kumar, Shahil, et al.
Published: (2025)

Rethinking Recommender Systems: Cluster-based Algorithm Selection
by: Lizenberger, Andreas, et al.
Published: (2024)

Conventional Contrastive Learning Often Falls Short: Improving Dense Retrieval with Cross-Encoder Listwise Distillation and Synthetic Data
by: Tamber, Manveer Singh, et al.
Published: (2025)

Can Query Expansion Improve Generalization of Strong Cross-Encoder Rankers?
by: Li, Minghan, et al.
Published: (2023)

Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
by: Yadav, Nishant, et al.
Published: (2024)

Domain-Aware Cross-Attention for Cross-domain Recommendation
by: Luo, Yuhao, et al.
Published: (2024)

Pathway to Relevance: How Cross-Encoders Implement a Semantic Variant of BM25
by: Lu, Meng, et al.
Published: (2025)

Detecting RAG Advertisements Across Advertising Styles
by: Heineking, Sebastian, et al.
Published: (2026)

STEC: See-Through Transformer-based Encoder for CTR Prediction
by: Dilbaz, Serdarcan, et al.
Published: (2023)