Cover Image

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Quan, Zhao, Tianxiang, Chen, Lingwei, Xu, Junjie, Wang, Suhang
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels
by: Wang, Fali, et al.
Published: (2024)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Rethinking the Role of Temperature in Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
by: Xu, Junjie, et al.
Published: (2024)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Bridging Source and Target Domains via Link Prediction for Unsupervised Domain Adaptation on Graphs
by: Wang, Yilong, et al.
Published: (2025)

InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration
by: Wang, Fali, et al.
Published: (2024)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Proficient Graph Neural Network Design by Accumulating Knowledge on Large Language Models
by: Wang, Jialiang, et al.
Published: (2024)

Large Language Model Meets Graph Neural Network in Knowledge Distillation
by: Hu, Shengxiang, et al.
Published: (2024)

Improve Knowledge Distillation via Label Revision and Data Selection
by: Lan, Weichao, et al.
Published: (2024)

PreGIP: Watermarking the Pretraining of Graph Neural Networks for Deep Intellectual Property Protection
by: Dai, Enyan, et al.
Published: (2024)

Shape-aware Graph Spectral Learning
by: Xu, Junjie, et al.
Published: (2023)

DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomolecules
by: Xu, Junjie, et al.
Published: (2025)

Logical Distillation of Graph Neural Networks
by: Pluska, Alexander, et al.
Published: (2024)

Large Language Models Meet Graph Neural Networks for Text-Numeric Graph Reasoning
by: Song, Haoran, et al.
Published: (2025)

Unlearning Inversion Attacks for Graph Neural Networks
by: Zhang, Jiahao, et al.
Published: (2025)

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
by: Wang, Lingzhi, et al.
Published: (2025)

Knowledge Graphs for Enhancing Large Language Models in Entity Disambiguation
by: Pons, Gerard, et al.
Published: (2025)

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection
by: Liu, Chen, et al.
Published: (2024)

LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework
by: Qiao, Yiran, et al.
Published: (2024)

An Active Diffusion Neural Network for Graphs
by: Jiang, Mengying
Published: (2025)

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
by: Ji, Guangda, et al.
Published: (2020)

A Functional Perspective on Knowledge Distillation in Neural Networks
by: Mason-Williams, Israel, et al.
Published: (2025)

Democratizing Large Language Model-Based Graph Data Augmentation via Latent Knowledge Graphs
by: Feng, Yushi, et al.
Published: (2025)

Delta Knowledge Distillation for Large Language Models
by: Cao, Yihan, et al.
Published: (2025)

PCoreSet: Effective Active Learning through Knowledge Distillation from Vision-Language Models
by: Kang, Seongjae, et al.
Published: (2025)

Disambiguated Node Classification with Graph Neural Networks
by: Zhao, Tianxiang, et al.
Published: (2024)

LCD: Advancing Extreme Low-Bit Clustering for Large Language Models via Knowledge Distillation
by: Liu, Fangxin, et al.
Published: (2025)

A Dual-Space Framework for General Knowledge Distillation of Large Language Models
by: Zhang, Xue, et al.
Published: (2025)

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
by: Zhang, Songming, et al.
Published: (2026)

Efficient Epistemic Uncertainty Estimation for Large Language Models via Knowledge Distillation
by: Park, Seonghyeon, et al.
Published: (2026)

Hierarchical Knowledge Distillation on Text Graph for Data-limited Attribute Inference
by: Li, Quan, et al.
Published: (2024)

Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
by: Izadi, Mohammad, et al.
Published: (2024)

Training-free Graph Neural Networks and the Power of Labels as Features
by: Sato, Ryoma
Published: (2024)

GTCN-G: A Residual Graph-Temporal Fusion Network for Imbalanced Intrusion Detection
by: Xu, Tianxiang, et al.
Published: (2025)

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs
by: Liu, Xiaoze, et al.
Published: (2024)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Enhancing Epidemic Forecasting: Evaluating the Role of Mobility Data and Graph Convolutional Networks
by: Guo, Suhan, et al.
Published: (2025)