SKLSDE Lab, Beihang University, Beijing, China; Zhongguancun Laboratory, Beijing, China; School of Transportation Science and Engineering, Beihang University, Beijing, China; SKLSDE Lab, Beihang University, Beijing, China
language model pretraining;text-attributed heterogeneous graphs;graph neural networks
Pretraining Language Models with Text-Attributed Heterogeneous Graphs