• Home
  • Search
  • Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines
  • Cite Icon7
  • https://doi.org/10.14778/3611479.3611483Copy DOI Icon

Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recent advances in Graph Neural Networks (GNNs) have changed the landscape of modern graph analytics. The complexity of GNN training and the scalability challenges have also sparked interest from the systems community, with efforts to build systems that provide higher efficiency and schemes to reduce costs. However, we observe that many such systems basically "reinvent the wheel" of much work done in the database world on scalable graph analytics engines. Further, they often tightly couple the scalability treatments of graph data processing with that of GNN training, resulting in entangled complex problems and systems that often do not scale well on one of those axes. In this paper, we ask a fundamental question: How far can we push existing systems for scalable graph analytics and deep learning (DL) instead of building custom GNN systems? Are compromises inevitable on scalability and/or runtimes? We propose Lotan, the first scalable and optimized data system for full-batch GNN training with decoupled scaling that bridges the hitherto siloed worlds of graph analytics systems and DL systems. Lotan offers a series of technical innovations, including re-imagining GNN training as query plan-like dataflows, execution plan rewriting, optimized data movement between systems, a GNN-centric graph partitioning scheme, and the first known GNN model batching scheme. We prototyped Lotan on top of GraphX and PyTorch. An empirical evaluation using several real-world benchmark GNN workloads reveals a promising nuanced picture: Lotan significantly surpasses the scalability of state-of-the-art custom GNN systems, while often matching or being only slightly behind on time-to-accuracy metrics in some cases. We also show the impact of our system optimizations. Overall, our work shows that the GNN world can indeed benefit from building on top of scalable graph analytics engines. Lotan's new level of scalability can also empower new ML-oriented research on ever-larger graphs and GNNs.

Similar Papers
  • PDF
  • Research Article
  • Citations63

Geometric deep learning for online prediction of cascading failures in power grids

  • Sep 01, 2023
  • Reliability Engineering & System Safety
  • Anna Varbella +2
  • Research Article

Radiopathomic Graph Deep Learning for Multiscale Spatial-Contextual Modeling of Intratumoral Heterogeneity to Predict Breast Cancer Response to Neoadjuvant Therapy.

  • May 01, 2026
  • Radiology. Artificial intelligence
  • Liang-Qin Zhou +9
  • PDF
  • Research Article
  • Citations60

A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability

  • Sep 27, 2024
  • Machine Intelligence Research
  • Enyan Dai +7
  • Research Article

Graph Neural Network Learning on the Pediatric Structural Connectome.

  • Jan 29, 2025
  • Tomography (Ann Arbor, Mich.)
  • Anand Srinivasan +6
  • PDF
  • Research Article
  • Citations2

Rapid and automated alloy design with graph neural network-powered large language model-driven multi-agent AI

  • Nov 01, 2025
  • MRS Bulletin
  • Alireza Ghafarollahi +1
  • Conference Article
  • Citations84

Graph Neural Network (GNN) in Image and Video Understanding Using Deep Learning for Computer Vision Applications

  • Aug 04, 2021
  • P Pradhyumna +2
  • Conference Article
  • Citations5

Vertex-Centric Visual Programming for Graph Neural Networks

  • Jun 09, 2021
  • Yidi Wu +8
  • Research Article
  • Citations27

Improved GNNs for Log D7.4 Prediction by Transferring Knowledge from Low-Fidelity Data

  • Mar 31, 2023
  • Journal of Chemical Information and Modeling
  • Yan-Jing Duan +10
  • Research Article
  • Citations2

AI-Driven molecule generation and bioactivity prediction: A multi-model approach combining VAE, graph and language-based neural networks.

  • Dec 01, 2025
  • Computational biology and chemistry
  • Latefa Oulladji +4
  • Research Article
  • Citations12

A review of challenges and solutions in the design and implementation of deep graph neural networks

  • Oct 18, 2022
  • International Journal of Computers and Applications
  • Aafaq Mohi Ud Din +1
  • Book Chapter
  • Citations1

Introduction to Graph Neural Network

  • Mar 03, 2023
  • Ganga Devi S V S
  • Research Article
  • Citations6

GRAPHITE — Generative Reasoning and Analysis for Predictive Handling in Traffic Efficiency

  • Jan 23, 2024
  • Information Fusion
  • Francesco Piccialli +4
  • Research Article

TernaryGNNs: A High-Throughput, Area-Efficient Ternary Weight GNNs Inference Framework on CPU-FPGA Heterogeneous Platform

  • Dec 22, 2025
  • ACM Transactions on Reconfigurable Technology and Systems
  • Zhuorong Liang +2
  • Research Article

Node Classification in GNNs: Impact of Neighborhood Label Distribution on Homophily and Heterophily.

  • Apr 22, 2026
  • IEEE transactions on neural networks and learning systems
  • Zhili Zhao +4
  • Research Article
  • Citations3

Learning node representations against perturbations

  • Sep 18, 2023
  • Pattern Recognition
  • Xu Chen +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.