A Survey of Quantized Graph Representation Learning: Connecting Graph Structures with Large Language Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lin, Qika, Peng, Zhen, Shi, Kaize, He, Kai, Xu, Yiming, Zhang, Jian, Cambria, Erik, Feng, Mengling
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917213064134656
author Lin, Qika
Peng, Zhen
Shi, Kaize
He, Kai
Xu, Yiming
Zhang, Jian
Cambria, Erik
Feng, Mengling
author_facet Lin, Qika
Peng, Zhen
Shi, Kaize
He, Kai
Xu, Yiming
Zhang, Jian
Cambria, Erik
Feng, Mengling
contents Recent years have witnessed rapid advances in graph representation learning, with the continuous embedding approach emerging as the dominant paradigm. However, such methods encounter issues regarding parameter efficiency, interpretability, and robustness. Thus, Quantized Graph Representation (QGR) learning has recently gained increasing interest, which represents the graph structure with discrete codes instead of conventional continuous embeddings. Given its analogous representation form to natural language, QGR also possesses the capability to seamlessly integrate graph structures with large language models (LLMs). As this emerging paradigm is still in its infancy yet holds significant promise, we undertake this thorough survey to promote its rapid future prosperity. We first present the background of the general quantization methods and their merits. Moreover, we provide an in-depth demonstration of current QGR studies from the perspectives of quantized strategies, training objectives, distinctive designs, knowledge graph quantization, and applications. We further explore the strategies for code dependence learning and integration with LLMs. At last, we give discussions and conclude future directions, aiming to provide a comprehensive picture of QGR and inspire future research.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00681
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey of Quantized Graph Representation Learning: Connecting Graph Structures with Large Language Models
Lin, Qika
Peng, Zhen
Shi, Kaize
He, Kai
Xu, Yiming
Zhang, Jian
Cambria, Erik
Feng, Mengling
Machine Learning
Artificial Intelligence
Computation and Language
Recent years have witnessed rapid advances in graph representation learning, with the continuous embedding approach emerging as the dominant paradigm. However, such methods encounter issues regarding parameter efficiency, interpretability, and robustness. Thus, Quantized Graph Representation (QGR) learning has recently gained increasing interest, which represents the graph structure with discrete codes instead of conventional continuous embeddings. Given its analogous representation form to natural language, QGR also possesses the capability to seamlessly integrate graph structures with large language models (LLMs). As this emerging paradigm is still in its infancy yet holds significant promise, we undertake this thorough survey to promote its rapid future prosperity. We first present the background of the general quantization methods and their merits. Moreover, we provide an in-depth demonstration of current QGR studies from the perspectives of quantized strategies, training objectives, distinctive designs, knowledge graph quantization, and applications. We further explore the strategies for code dependence learning and integration with LLMs. At last, we give discussions and conclude future directions, aiming to provide a comprehensive picture of QGR and inspire future research.
title A Survey of Quantized Graph Representation Learning: Connecting Graph Structures with Large Language Models
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2502.00681