• Home
  • Search
  • Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification
  • Cite Icon5
  • https://doi.org/10.1145/3580508Copy DOI Icon

Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The prevalent heterogeneous Graph Neural Network (GNN) models learn node and graph representations using pre-defined meta-paths or only automatically discovering meta-paths. However, the existing methods suffer from information loss due to neglecting undiscovered meta-structures with richer semantics than meta-paths in heterogeneous graphs. To take advantage of the current rich meta-structures in heterogeneous graphs, we propose a novel approach called HeGTM to automatically extract essential meta-structures (i.e., meta-paths and meta-graphs) from heterogeneous graphs. The discovered meta-structures can capture more prosperous relations between different types of nodes that can help the model to learn representations. Furthermore, we apply the proposed approach for text classification. Specifically, we first design a heterogeneous graph for the text corpus, and then apply HeGTM on the constructed text graph to learn better text representations that contain various semantic relations. In addition, our approach can also be used as a strong meta-structure extractor for other GNN models. In other words, the auto-discovered meta-structures can replace the pre-defined meta-paths. The experimental results on text classification demonstrate the effectiveness of our approach to automatically extracting informative meta-structures from heterogeneous graphs and its usefulness in acting as a meta-structure extractor for boosting other GNN models.

Similar Papers
  • PDF
  • Research Article
  • Citations23

Prediction of emergency department revisits among child and youth mental health outpatients using deep learning techniques

  • Feb 08, 2024
  • BMC Medical Informatics and Decision Making
  • Simran Saggu +8
  • Conference Article
  • Citations34

MANDO: Multi-Level Heterogeneous Graph Embeddings for Fine-Grained Detection of Smart Contract Vulnerabilities

  • Oct 13, 2022
  • Hoang H Nguyen +6
  • Research Article
  • Citations1

Enhancing CYP3A4 Inhibition Prediction Using a Hybrid GNN\u2013ML Model with Data Augmentation

  • Feb 02, 2026
  • Pharmaceuticals
  • Somin Woo +4
  • Conference Article

PropInit: Scalable Inductive Initialization for Heterogeneous Graph Neural Networks

  • Nov 01, 2022
  • Soji Adeshina +7
  • Research Article
  • Citations33

EEG Signal Epilepsy Detection with a Weighted Neighbour Graph Representation and Two-stream Graph-based Framework.

  • Jan 01, 2023
  • IEEE Transactions on Neural Systems and Rehabilitation Engineering
  • Jialin Wang +7
  • Research Article
  • Citations40

HMSG: Heterogeneous graph neural network based on Metapath SubGraph learning

  • Aug 23, 2023
  • Knowledge-Based Systems
  • Mengya Guan +6
  • PDF
  • Research Article
  • Citations13

MBHAN: Motif-Based Heterogeneous Graph Attention Network

  • Jun 10, 2022
  • Applied Sciences
  • Qian Hu +3
  • Research Article
  • Citations11

Explicit Message-Passing Heterogeneous Graph Neural Network

  • Jan 01, 2022
  • IEEE Transactions on Knowledge and Data Engineering
  • Lei Xu +4
  • PDF
  • Research Article
  • Citations41

Attention-aware heterogeneous graph neural network

  • Dec 01, 2021
  • Big Data Mining and Analytics
  • Jintao Zhang +1
  • Conference Article
  • Citations13

Tree Structure-Aware Graph Representation Learning via Integrated Hierarchical Aggregation and Relational Metric Learning

  • Nov 01, 2020
  • Ziyue Qiao +5
  • Research Article
  • Citations1

Abstract 1922: Application of an interpretable graph neural network to predict gene expression signatures associated with tertiary lymphoid structures in histopathological images

  • Jun 15, 2022
  • Cancer Research
  • Ciyue Shen +10
  • PDF
  • Research Article
  • Citations494

A review of graph neural networks: concepts, architectures, techniques, challenges, datasets, applications, and future directions

  • Jan 16, 2024
  • Journal of Big Data
  • Bharti Khemani +3
  • PDF
  • Research Article
  • Citations43

Brain age prediction using the graph neural network based on resting-state functional MRI in Alzheimer's disease.

  • Jun 30, 2023
  • Frontiers in neuroscience
  • Jingjing Gao +4
  • Book Chapter
  • Citations45

Structure-Enhanced Heterogeneous Graph Contrastive Learning

  • Jan 01, 2022
  • Yanqiao Zhu +5
  • Research Article
  • Citations3

Ensemble Graph Attention Networks

  • Jun 12, 2022
  • Transactions on Machine Learning and Artificial Intelligence
  • Nan Wu +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.