• Home
  • Search
  • Encoding and decoding multimodal brain images for disease biomarker discovery
  • https://doi.org/10.32657/10356/173338Copy DOI Icon

Encoding and decoding multimodal brain images for disease biomarker discovery

  • Jan 1, 2023
  • Yi Hao Chan
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Many neurodegenerative diseases (such as Alzheimer’s disease) and neuropsychiatric disorders (such as schizophrenia) are still poorly understood. While incorporating multimodal datasets (structural and functional) would provide a more complete picture of these neurological conditions, existing studies already struggle with two key challenges even when a single data modality is used: data scarcity and high dimensionality. These problems make machine learning models overfit easily on neuroimaging datasets and result in the generation of spurious biomarkers. Coupled with issues such as inter-scanner variability and disease heterogeneity, biomarker discovery remains an onerous task as reproducible biomarkers for these neurological conditions have proven to be elusive. Overcoming these obstacles would give us a better understanding of these diseases and possibly lead to the discovery of new cures. One emerging trend in the area of biomarker discovery is the use of deep learning models. Despite its perceived complexity, one relatively unexplored aspect of deep learning architectures is the flexibility they afford for modelling multimodal datasets, in terms of architectural design and construction of the loss function. In this thesis, we propose several deep learning architectures customised for the idiosyncrasies of brain imaging datasets and demonstrate how they can produce reliable biomarkers. Firstly, the challenges of high dimensionality and data scarcity in brain imaging datasets are investigated. Existing approaches alleviated the issue by removing less important nodes from the neural network architecture, including the input features. However, it is common to have sites with very small datasets (< 100) where such pruning-based approaches are no longer effective. Thus, we propose an alternative approach based on data harmonisation and semi-supervised learning that tackles this issue by incorporating more data (on the same disease, but collected from other sites) into the analysis while addressing issues such as site differences and labelling inconsistencies. We demonstrated that existing works on biomarker discovery produce biomarkers that could be biased towards the largest site, especially when data imbalance exists across sites. On the other hand, our proposed architecture provides a technique to arrive at site-invariant biomarkers, making it also possible to reveal site-specific biomarkers more clearly. Secondly, a persistent issue with existing machine learning models is their poor generalisability on neuroimaging datasets. This is often hypothesised to be caused by disease heterogeneity. Furthermore, while some sites are carefully curated such that they represent a homogeneous subgroup, many sites still contain a heterogeneous mix of patients, warranting a need for techniques that can capture such variability. Our proposed approach uses both the brain graph and population graph approach to model structural and functional brain networks. It introduces an additional fine-tuning step that adds clustering information into the construction of the population graph, based on the clusters obtained from the brain graph embeddings. This makes it possible to produce subtype-specific biomarkers. Thirdly, we explore the possibility of combining both multimodal neuroimaging data and multi-omics datasets. Structural and functional neuroimaging data provides whole-brain, macroscale information but the limited spatial resolution leaves out microscale information. These are better captured via multi-omics data, but such multimodal and multi-scale imaging genetics research has been relatively under-explored as it further exacerbates the above-mentioned problem of model overfitting. To address this, we propose a scalable deep neural network architecture based on the attention mechanism that allows a myriad of omics modalities to be incorporated into the analysis. We demonstrate how combining imaging and genetics data leads to better model performance and go further to show how relative importance of the modalities involved in the analysis can be determined. Overall, these works demonstrated how existing biomarker discovery approaches are limited to a generic, class-wide view of the disease that could be biased especially for imbalanced multi-site datasets. These problems are addressed by careful design of deep learning architectures (graph neural networks with data harmonisation, semi-supervised learning, clustering and the attention mechanism) to take care of issues unique to biomedical datasets, leading to better model performance and producing richer biomarkers in the form of site-specific, site-invariant, subtype-specific and imaging genetics biomarkers. These biomarkers pave the way towards more effective treatments for these complex neurological conditions.

Similar Papers
  • Research Article
  • Citations18

GOAT: Gene-level biomarker discovery from multi-Omics data using graph ATtention neural network for eosinophilic asthma subtype.

  • Sep 22, 2023
  • Bioinformatics
  • Dabin Jeong +4
  • Conference Article

Connectivity-Aware GNN with Semi-Supervised Learning for EEG Alzheimer’s Detection

  • Sep 19, 2025
  • Jiawen Yin
  • Research Article
  • Citations27

Improved GNNs for Log D7.4 Prediction by Transferring Knowledge from Low-Fidelity Data

  • Mar 31, 2023
  • Journal of Chemical Information and Modeling
  • Yan-Jing Duan +10
  • Research Article
  • Citations2

AI-Driven molecule generation and bioactivity prediction: A multi-model approach combining VAE, graph and language-based neural networks.

  • Dec 01, 2025
  • Computational biology and chemistry
  • Latefa Oulladji +4
  • Research Article
  • Citations3

SGNN-T: Space graph neural network coupled transformer for molecular property prediction

  • Sep 10, 2024
  • Computational Materials Science
  • Taohong Zhang +5
  • Research Article
  • Citations35

SCN_GNN: A GNN-based fraud detection algorithm combining strong node and graph topology information

  • Sep 22, 2023
  • Expert Systems with Applications
  • Jing Chen +5
  • Conference Article

GCFA: Graph Neural Networks on Collaborative Filtering Recommendation via Attention Mechanism

  • May 01, 2020
  • Hui Zou +2
  • PDF
  • Research Article
  • Citations29

Target Detection Network for SAR Images Based on Semi-Supervised Learning and Attention Mechanism

  • Jul 08, 2021
  • Remote Sensing
  • Di Wei +3
  • Research Article

StructuredLight-GNN: A graph neural network for end-to-end structured light 3D point cloud processing

  • Jan 01, 2026
  • Results in Optics
  • Lingxi Liu +3
  • Conference Article
  • Citations1

Combining feature fusion link prediction with graph neural networks

  • Apr 13, 2023
  • Yamin Zheng +2
  • Supplementary Content

Visual Localisation Using Deep Learning and Graph Neural Networks: Approaches and Evaluation

  • Aug 20, 2025
  • Dinesh Kumar Koilada
  • PDF
  • Research Article
  • Citations27

Graph neural network and machine learning analysis of functional neuroimaging for understanding schizophrenia.

  • Jan 02, 2024
  • BMC neuroscience
  • Gayathri Sunil +4
  • Research Article
  • Citations12

Signed attention based graph neural network for graphs with heterophily

  • Aug 23, 2023
  • Neurocomputing
  • Yang Wu +2
  • Research Article

A novel method of BiFormer with temporal-spatial characteristics for ECG-based PVC detection

  • May 20, 2025
  • Frontiers in Physiology
  • Siyuan Chen +5
  • Research Article

Knowledge-Based Spatio-Temporal Attention Network for Disease Prediction with Chinese Electronic Medical Records

  • Apr 23, 2025
  • ACM Transactions on Asian and Low-Resource Language Information Processing
  • Zhichao Zhu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.