Saved in:
Bibliographic Details
Main Authors: Arnaiz-Rodriguez, Adrian, Errica, Federico
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.15547
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915807584321536
author Arnaiz-Rodriguez, Adrian
Errica, Federico
author_facet Arnaiz-Rodriguez, Adrian
Errica, Federico
contents After a renaissance phase in which researchers revisited the message-passing paradigm through the lens of deep learning, the graph machine learning community shifted its attention towards a deeper and practical understanding of message-passing's benefits and limitations. In this paper, we notice how the fast pace of progress around the topics of oversmoothing and oversquashing, the homophily-heterophily dichotomy, and long-range tasks, came with the consolidation of commonly accepted beliefs and assumptions -- under the form of universal statements -- that are not always true nor easy to distinguish from each other. We argue that this has led to ambiguities around the investigated problems, preventing researchers from focusing on and addressing precise research questions while causing a good amount of misunderstandings. Our contribution is to make such common beliefs explicit and encourage critical thinking around these topics, refuting universal statements via simple yet formally sufficient counterexamples. The end goal is to clarify conceptual differences, helping researchers address more clearly defined and targeted problems.
format Preprint
id arxiv_https___arxiv_org_abs_2505_15547
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Oversmoothing, Oversquashing, Heterophily, Long-Range, and more: Demystifying Common Beliefs in Graph Machine Learning
Arnaiz-Rodriguez, Adrian
Errica, Federico
Machine Learning
Artificial Intelligence
After a renaissance phase in which researchers revisited the message-passing paradigm through the lens of deep learning, the graph machine learning community shifted its attention towards a deeper and practical understanding of message-passing's benefits and limitations. In this paper, we notice how the fast pace of progress around the topics of oversmoothing and oversquashing, the homophily-heterophily dichotomy, and long-range tasks, came with the consolidation of commonly accepted beliefs and assumptions -- under the form of universal statements -- that are not always true nor easy to distinguish from each other. We argue that this has led to ambiguities around the investigated problems, preventing researchers from focusing on and addressing precise research questions while causing a good amount of misunderstandings. Our contribution is to make such common beliefs explicit and encourage critical thinking around these topics, refuting universal statements via simple yet formally sufficient counterexamples. The end goal is to clarify conceptual differences, helping researchers address more clearly defined and targeted problems.
title Oversmoothing, Oversquashing, Heterophily, Long-Range, and more: Demystifying Common Beliefs in Graph Machine Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.15547