Do Composed Image Retrieval Benchmarks Require Multimodal Composition?
Fuente:
arXiv
Saved in:
| Main Authors: | Attimonelli, Matteo, De Bellis, Alessandro, Gema, Aryo Pradipta, Saxena, Rohit, Sekoyan, Monica, Kwan, Wai-Chung, Pomo, Claudio, Suglia, Alessandro, Jannach, Dietmar, Di Noia, Tommaso, Minervini, Pasquale |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Do We Really Need Specialization? Evaluating Generalist Text Embeddings for Zero-Shot Recommendation and Search
by: Attimonelli, Matteo, et al.
Published: (2025)
by: Attimonelli, Matteo, et al.
Published: (2025)
Lost in Time: Clock and Calendar Understanding Challenges in Multimodal LLMs
by: Saxena, Rohit, et al.
Published: (2025)
by: Saxena, Rohit, et al.
Published: (2025)
Fashion Image-to-Image Translation for Complementary Item Retrieval
by: Attimonelli, Matteo, et al.
Published: (2024)
by: Attimonelli, Matteo, et al.
Published: (2024)
VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
by: Saxena, Rohit, et al.
Published: (2026)
by: Saxena, Rohit, et al.
Published: (2026)
Same Answer, Different Representations: Hidden instability in VLMs
by: Wani, Farooq Ahmad, et al.
Published: (2026)
by: Wani, Farooq Ahmad, et al.
Published: (2026)
SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks
by: Kwan, Wai-Chung, et al.
Published: (2026)
by: Kwan, Wai-Chung, et al.
Published: (2026)
Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation
by: Pomo, Claudio, et al.
Published: (2025)
by: Pomo, Claudio, et al.
Published: (2025)
Edinburgh Clinical NLP at SemEval-2024 Task 2: Fine-tune your model unless you have access to GPT-4
by: Gema, Aryo Pradipta, et al.
Published: (2024)
by: Gema, Aryo Pradipta, et al.
Published: (2024)
Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain
by: Gema, Aryo Pradipta, et al.
Published: (2023)
by: Gema, Aryo Pradipta, et al.
Published: (2023)
Edinburgh Clinical NLP at MEDIQA-CORR 2024: Guiding Large Language Models with Hints
by: Gema, Aryo Pradipta, et al.
Published: (2024)
by: Gema, Aryo Pradipta, et al.
Published: (2024)
Self-Training Large Language Models for Tool-Use Without Demonstrations
by: Luo, Ne, et al.
Published: (2025)
by: Luo, Ne, et al.
Published: (2025)
PosterSum: A Multimodal Benchmark for Scientific Poster Summarization
by: Saxena, Rohit, et al.
Published: (2025)
by: Saxena, Rohit, et al.
Published: (2025)
Noiser: Bounded Input Perturbations for Attributing Large Language Models
by: Madani, Mohammad Reza Ghasemi, et al.
Published: (2025)
by: Madani, Mohammad Reza Ghasemi, et al.
Published: (2025)
Analyzing LLM Instruction Optimization for Tabular Fact Verification
by: Du, Xiaotang, et al.
Published: (2026)
by: Du, Xiaotang, et al.
Published: (2026)
PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains
by: Leang, Joshua Ong Jun, et al.
Published: (2025)
by: Leang, Joshua Ong Jun, et al.
Published: (2025)
The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models
by: Hong, Giwon, et al.
Published: (2024)
by: Hong, Giwon, et al.
Published: (2024)
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
by: Gema, Aryo Pradipta, et al.
Published: (2024)
by: Gema, Aryo Pradipta, et al.
Published: (2024)
An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering
by: Murphy, Alexander, et al.
Published: (2025)
by: Murphy, Alexander, et al.
Published: (2025)
FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matching
by: Danese, Danilo, et al.
Published: (2026)
by: Danese, Danilo, et al.
Published: (2026)
Analysing the Residual Stream of Language Models Under Knowledge Conflicts
by: Zhao, Yu, et al.
Published: (2024)
by: Zhao, Yu, et al.
Published: (2024)
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
by: Zhao, Yu, et al.
Published: (2024)
by: Zhao, Yu, et al.
Published: (2024)
Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation
by: Attimonelli, Matteo, et al.
Published: (2024)
by: Attimonelli, Matteo, et al.
Published: (2024)
CoMAT: Chain of Mathematically Annotated Thought Improves Mathematical Reasoning
by: Leang, Joshua Ong Jun, et al.
Published: (2024)
by: Leang, Joshua Ong Jun, et al.
Published: (2024)
Large-scale Benchmarks for Multimodal Recommendation with Ducho
by: Attimonelli, Matteo, et al.
Published: (2024)
by: Attimonelli, Matteo, et al.
Published: (2024)
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs
by: Servedio, Giovanni, et al.
Published: (2025)
by: Servedio, Giovanni, et al.
Published: (2025)
Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Them
by: Rajani, Neel, et al.
Published: (2025)
by: Rajani, Neel, et al.
Published: (2025)
Enhancing Long Document Long Form Summarisation with Self-Planning
by: Du, Xiaotang, et al.
Published: (2025)
by: Du, Xiaotang, et al.
Published: (2025)
Type-Less yet Type-Aware Inductive Link Prediction with Pretrained Language Models
by: De Bellis, Alessandro, et al.
Published: (2025)
by: De Bellis, Alessandro, et al.
Published: (2025)
LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probing
by: Di Palma, Dario, et al.
Published: (2025)
by: Di Palma, Dario, et al.
Published: (2025)
OpenSIR: Open-Ended Self-Improving Reasoner
by: Kwan, Wai-Chung, et al.
Published: (2025)
by: Kwan, Wai-Chung, et al.
Published: (2025)
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models
by: Chiyah-Garcia, Javier, et al.
Published: (2024)
by: Chiyah-Garcia, Javier, et al.
Published: (2024)
GRADA: Graph-based Reranking against Adversarial Documents Attack
by: Zheng, Jingjie, et al.
Published: (2025)
by: Zheng, Jingjie, et al.
Published: (2025)
AgriPath: A Systematic Exploration of Architectural Trade-offs for Crop Disease Classification
by: Mooraj, Hamza, et al.
Published: (2026)
by: Mooraj, Hamza, et al.
Published: (2026)
Learning To See But Forgetting To Follow: Visual Instruction Tuning Makes LLMs More Prone To Jailbreak Attacks
by: Pantazopoulos, Georgios, et al.
Published: (2024)
by: Pantazopoulos, Georgios, et al.
Published: (2024)
Are We Done with MMLU?
by: Gema, Aryo Pradipta, et al.
Published: (2024)
by: Gema, Aryo Pradipta, et al.
Published: (2024)
FOSSIL: Harnessing Feedback on Suboptimal Samples for Data-Efficient Generalisation with Imitation Learning for Embodied Vision-and-Language Tasks
by: McCallum, Sabrina, et al.
Published: (2025)
by: McCallum, Sabrina, et al.
Published: (2025)
Diffusion Recommender Models and the Illusion of Progress: A Concerning Study of Reproducibility and a Conceptual Mismatch
by: Benigni, Michael, et al.
Published: (2025)
by: Benigni, Michael, et al.
Published: (2025)
PIXAR: Auto-Regressive Language Modeling in Pixel Space
by: Tai, Yintao, et al.
Published: (2024)
by: Tai, Yintao, et al.
Published: (2024)
Inverse Scaling in Test-Time Compute
by: Gema, Aryo Pradipta, et al.
Published: (2025)
by: Gema, Aryo Pradipta, et al.
Published: (2025)
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation
by: Nikandrou, Malvina, et al.
Published: (2024)
by: Nikandrou, Malvina, et al.
Published: (2024)
Similar Items
-
Do We Really Need Specialization? Evaluating Generalist Text Embeddings for Zero-Shot Recommendation and Search
by: Attimonelli, Matteo, et al.
Published: (2025) -
Lost in Time: Clock and Calendar Understanding Challenges in Multimodal LLMs
by: Saxena, Rohit, et al.
Published: (2025) -
Fashion Image-to-Image Translation for Complementary Item Retrieval
by: Attimonelli, Matteo, et al.
Published: (2024) -
VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
by: Saxena, Rohit, et al.
Published: (2026) -
Same Answer, Different Representations: Hidden instability in VLMs
by: Wani, Farooq Ahmad, et al.
Published: (2026)