Cover Image

How Much Freedom Does An Effectiveness Metric Really Have?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Moffat, Alistair, Mackenzie, Joel
Format:	Preprint
Published:	2023
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

How much freedom does an effectiveness metric really have?
by: Alistair Moffat, et al.
Published: (2024)

Have We Really Understood Collaborative Information? An Empirical Investigation
by: Zhang, Xiaokun, et al.
Published: (2025)

Are Large Language Models Really Effective for Training-Free Cold-Start Recommendation?
by: Kusano, Genki, et al.
Published: (2025)

The Effects of Demographic Instructions on LLM Personas
by: de Paula, Angel Felipe Magnossão, et al.
Published: (2025)

Revisiting Human-vs-LLM judgments using the TREC Podcast Track
by: Mansour, Watheq, et al.
Published: (2026)

When LLM Judges Inflate Scores: Exploring Overrating in Relevance Assessment
by: Yu, Chuting, et al.
Published: (2026)

How Well Does Generative Recommendation Generalize?
by: Ding, Yijie, et al.
Published: (2026)

Is Less Really More? Fake News Detection with Limited Information
by: Cao, Zhaoyang, et al.
Published: (2025)

KG4RecEval: Does Knowledge Graph Really Matter for Recommender Systems?
by: Zhang, Haonan, et al.
Published: (2024)

How Does Topology Bias Distort Message Passing? A Dirichlet Energy Perspective
by: Ji, Yanbiao, et al.
Published: (2024)

Are We Really Achieving Better Beyond-Accuracy Performance in Next Basket Recommendation?
by: Li, Ming, et al.
Published: (2024)

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?
by: Malitesta, Daniele, et al.
Published: (2024)

Webliographies: Much More that Just a Bibliography.
by: Marino, Nancy Robinson
Published: (1998)

Insider Knowledge: How Much Can RAG Systems Gain from Evaluation Secrets?
by: Dietz, Laura, et al.
Published: (2026)

Is Cosine-Similarity of Embeddings Really About Similarity?
by: Steck, Harald, et al.
Published: (2024)

How Does Message Passing Improve Collaborative Filtering?
by: Ju, Mingxuan, et al.
Published: (2024)

Lower-Left Partial AUC: An Effective and Efficient Optimization Metric for Recommendation
by: Shi, Wentao, et al.
Published: (2024)

Indexing Depth and Retrieval Effectiveness
by: Seely, Barbara J.
Published: (1972)

On the Evaluation Metric for Hashing
by: Jiang, Qing-Yuan, et al.
Published: (2019)

Pointwise Metrics for Clustering Evaluation
by: van Staden, Stephan
Published: (2024)

Do RAG Systems Really Suffer From Positional Bias?
by: Cuconasu, Florin, et al.
Published: (2025)

How Does A Text Preprocessing Pipeline Affect Ontology Matching?
by: Qiang, Zhangcheng, et al.
Published: (2024)

An Offline Metric for the Debiasedness of Click Models
by: Deffayet, Romain, et al.
Published: (2023)

More Clustering Quality Metrics for ABCDE
by: van Staden, Stephan
Published: (2024)

Sustainability Evaluation Metrics for Recommender Systems
by: Felfernig, Alexander, et al.
Published: (2025)

Automated Similarity Metric Generation for Recommendation
by: Qu, Liang, et al.
Published: (2024)

Can Offline Metrics Measure Explanation Goals? A Comparative Survey Analysis of Offline Explanation Metrics in Recommender Systems
by: Zanon, André Levi, et al.
Published: (2023)

Can Instructed Retrieval Models Really Support Exploration?
by: Maheshwari, Piyush, et al.
Published: (2026)

Rethinking the Privacy of Text Embeddings: A Reproducibility Study of "Text Embeddings Reveal (Almost) As Much As Text"
by: Seputis, Dominykas, et al.
Published: (2025)

SSE: A Metric for Evaluating Search System Explainability
by: Chen, Catherine, et al.
Published: (2023)

Rank-Preference Consistency as the Appropriate Metric for Recommender Systems
by: Nguyen, Tung, et al.
Published: (2024)

Does Generative Retrieval Overcome the Limitations of Dense Retrieval?
by: Zhang, Yingchen, et al.
Published: (2025)

Discrete Scale-invariant Metric Learning for Efficient Collaborative Filtering
by: Zhang, Yan, et al.
Published: (2025)

MA-DPR: Manifold-aware Distance Metrics for Dense Passage Retrieval
by: Liu, Yifan, et al.
Published: (2025)

Revealing the Hidden Impact of Top-N Metrics on Optimization in Recommender Systems
by: Wegmeth, Lukas, et al.
Published: (2024)

Retrieval Effectiveness of Enhanced Bibliographic Records.
by: Dillon, Martin, et al.
Published: (1990)

Repeat-bias-aware Optimization of Beyond-accuracy Metrics for Next Basket Recommendation
by: Liu, Yuanna, et al.
Published: (2025)

Do We Really Need Specialization? Evaluating Generalist Text Embeddings for Zero-Shot Recommendation and Search
by: Attimonelli, Matteo, et al.
Published: (2025)

Are AI Agents interacting with Online Ads?
by: Stöckl, Andreas, et al.
Published: (2025)

Bridging Search and Recommendation in Generative Retrieval: Does One Task Help the Other?
by: Penha, Gustavo, et al.
Published: (2024)