Cover Image

A Pre-training Framework for Relational Data with Information-theoretic Principles

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Truong, Quang, Chen, Zhikai, Ju, Mingxuan, Zhao, Tong, Shah, Neil, Tang, Jiliang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphs
by: Liu, Jingzhe, et al.
Published: (2024)

Towards Neural Scaling Laws on Graphs
by: Liu, Jingzhe, et al.
Published: (2024)

Heuristic Methods are Good Teachers to Distill MLPs for Graph Link Prediction
by: Qin, Zongyue, et al.
Published: (2025)

Unveiling Mode Connectivity in Graph Neural Networks
by: Li, Bingheng, et al.
Published: (2025)

Learning on Graphs with Large Language Models(LLMs): A Deep Dive into Model Robustness
by: Guo, Kai, et al.
Published: (2024)

Understanding Generative Recommendation with Semantic IDs from a Model-scaling View
by: Liu, Jingzhe, et al.
Published: (2025)

CRIA: A Cross-View Interaction and Instance-Adapted Pre-training Framework for Generalizable EEG Representations
by: Liu, Puchun, et al.
Published: (2025)

Neural Dynamics-Informed Pre-trained Framework for Personalized Brain Functional Network Construction
by: Jiang, Hongjie, et al.
Published: (2026)

LLaGA: Large Language and Graph Assistant
by: Chen, Runjin, et al.
Published: (2024)

Parallel Structures in Pre-training Data Yield In-Context Learning
by: Chen, Yanda, et al.
Published: (2024)

3D Interaction Geometric Pre-training for Molecular Relational Learning
by: Lee, Namkyeong, et al.
Published: (2024)

Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model
by: Niu, Peisong, et al.
Published: (2025)

The Norm-Separation Delay Law of Grokking: A First-Principles Theory of Delayed Generalization
by: Khanh, Truong Xuan, et al.
Published: (2026)

Cross-domain Random Pre-training with Prototypes for Reinforcement Learning
by: Liu, Xin, et al.
Published: (2023)

A Pre-trained Data Deduplication Model based on Active Learning
by: Shi, Haochen, et al.
Published: (2023)

Pre-training with Synthetic Data Helps Offline Reinforcement Learning
by: Wang, Zecheng, et al.
Published: (2023)

Label-free Node Classification on Graphs with Large Language Models (LLMS)
by: Chen, Zhikai, et al.
Published: (2023)

ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data
by: Chen, Tong, et al.
Published: (2025)

Graph Generative Pre-trained Transformer
by: Chen, Xiaohui, et al.
Published: (2025)

Relational In-Context Learning via Synthetic Pre-training with Structural Prior
by: Wang, Yanbo, et al.
Published: (2026)

Towards Understanding Link Predictor Generalizability Under Distribution Shifts
by: Revolinsky, Jay, et al.
Published: (2024)

Towards Better Benchmark Datasets for Inductive Knowledge Graph Completion
by: Shomer, Harry, et al.
Published: (2024)

Subgraph Generation for Generalizing on Out-of-Distribution Links
by: Revolinsky, Jay, et al.
Published: (2025)

Are Expressive Encoders Necessary for Discrete Graph Generation?
by: Revolinsky, Jay, et al.
Published: (2026)

Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs
by: Chen, Zhikai, et al.
Published: (2023)

FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomics
by: Duan, ChenRui, et al.
Published: (2024)

Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learning
by: Zhu, Jing, et al.
Published: (2024)

GraphGPT: Generative Pre-trained Graph Eulerian Transformer
by: Zhao, Qifang, et al.
Published: (2023)

Mutual Information Guided Backdoor Mitigation for Pre-trained Encoders
by: Han, Tingxu, et al.
Published: (2024)

Pre-training for Recommendation Unlearning
by: Chen, Guoxuan, et al.
Published: (2025)

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes
by: Jiang, Mingxuan, et al.
Published: (2025)

PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training
by: Yi, Rongjie, et al.
Published: (2024)

Bootstrapping OTS-Funcimg Pre-training Model (Botfip) -- A Comprehensive Symbolic Regression Framework
by: Chen, Tianhao, et al.
Published: (2024)

Measuring Pre-training Data Quality without Labels for Time Series Foundation Models
by: Wen, Songkang, et al.
Published: (2024)

An Efficient Replay for Class-Incremental Learning with Pre-trained Models
by: Yin, Weimin, et al.
Published: (2024)

Prompt Tuning with Diffusion for Few-Shot Pre-trained Policy Generalization
by: Hu, Shengchao, et al.
Published: (2024)

Investigating Data Contamination for Pre-training Language Models
by: Jiang, Minhao, et al.
Published: (2024)

RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation
by: Zhang, Yixue, et al.
Published: (2026)

MIPS: a Multimodal Infinite Polymer Sequence Pre-training Framework for Polymer Property Prediction
by: Wang, Jiaxi, et al.
Published: (2025)

DPN: Decoupling Partition and Navigation for Neural Solvers of Min-max Vehicle Routing Problems
by: Zheng, Zhi, et al.
Published: (2024)