• Home
  • Search
  • CoCa-GAN: Common-Feature-Learning-Based Context-Aware Generative Adversarial Network for Glioma Grading
  • Cite Icon29
  • https://doi.org/10.1007/978-3-030-32248-9_18Copy DOI Icon

CoCa-GAN: Common-Feature-Learning-Based Context-Aware Generative Adversarial Network for Glioma Grading

  • Jan 1, 2019
  • Pu Huang +7 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Multi-modal structural MRI has been widely used for presurgical glioma grading for treatment planning. Despite providing complementary information, a complete set of high-resolution multi-modality data is costly and often impossible to acquire in clinical settings (although T1 MRI is more commonly acquired). To leverage more comprehensive multimodality information for better glioma grading instead of doing so with T1 MRI data only, we introduce a three-dimensional common feature learning-based context-aware generative adversarial network (CoCa-GAN) for multimodal MRI data synthesis based on T1 MRI and use the comprehensive features from a common feature space to achieve a clinically feasible glioma grading with limited imaging modality. The common feature space is first learned by simultaneously utilizing four MRI modalities with the adversarial learning and context-aware learning, where the inter-modality relationships and lesion-specific features can be explicitly encoded. Then, the domain (modality) invariant information represented in the common space is leveraged to synthesize the missing modalities for a joint prediction of glioma grades (high- vs. low-grade). Furthermore, Gradient-weighted Class Activation Mapping (GradCAM) is utilized to provide interpretability to the factors that contribute to the grading, for potential clinical usage. Results demonstrate that the common feature learning achieves more accurate glioma grading than simply using single modality data and leads to a comparable performance to that with complete modalities as inputs. Our method offers a highly feasible solution to clinical practice where multi-modality data is often unavailable.

Similar Papers
  • Research Article
  • Citations72

Dual Adversarial Graph Neural Networks for Multi-label Cross-modal Retrieval

  • May 18, 2021
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Shengsheng Qian +4
  • Research Article
  • Citations2

Cross-modal retrieval of remote sensing images and text based on self-attention unsupervised deep common feature space

  • Jun 18, 2023
  • International Journal of Remote Sensing
  • Qilin Ding +3
  • PDF
  • Research Article
  • Citations49

A Bridge Neural Network-Based Optical-SAR Image Joint Intelligent Interpretation Framework

  • Jan 01, 2021
  • Space: Science & Technology
  • Meiyu Huang +8
  • Research Article
  • Citations26

MouseGAN++: Unsupervised Disentanglement and Contrastive Representation for Multiple MRI Modalities Synthesis and Structural Segmentation of Mouse Brain.

  • Apr 01, 2023
  • IEEE Transactions on Medical Imaging
  • Ziqi Yu +5
  • Conference Article
  • Citations72

MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification

  • Oct 17, 2021
  • Yajun Gao +6
  • Conference Article
  • Citations78

Cross-View Action Recognition over Heterogeneous Feature Spaces

  • Dec 01, 2013
  • Xinxiao Wu +3
  • Research Article
  • Citations7

Improving visible-thermal ReID with structural common space embedding and part models

  • Dec 16, 2020
  • Pattern Recognition Letters
  • Lingyan Ran +4
  • Research Article
  • Citations39

Zero-shot Cross-modal Retrieval by Assembling AutoEncoder and Generative Adversarial Network

  • Jan 31, 2021
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Xing Xu +5
  • Research Article
  • Citations9

MMCNet: deep learning–based multimodal classification model using dynamic knowledge

  • Aug 02, 2019
  • Personal and Ubiquitous Computing
  • Sung-Soo Park +1
  • Conference Article
  • Citations2

Analysing and Evaluating Complementarity of Multi-Modal Data Fusion in AD Diagnosis

  • Dec 01, 2022
  • Zhaodong Chen +4
  • Research Article
  • Citations25

Cross-View Action Recognition Over Heterogeneous Feature Spaces.

  • Jun 12, 2015
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Xinxiao Wu +3
  • Research Article
  • Citations37

Common feature learning for brain tumor MRI synthesis by context-aware generative adversarial network

  • Jul 01, 2022
  • Medical Image Analysis
  • Pu Huang +8
  • Conference Article
  • Citations6

OTCMR: Bridging Heterogeneity Gap with Optimal Transport for Cross-modal Retrieval

  • Oct 26, 2021
  • Mingyang Li +2
  • Research Article
  • Citations1

Adversarial task-specific learning

  • Jul 20, 2019
  • Neurocomputing
  • Xin Fu +5
  • Research Article
  • Citations1

Multi-Modal Encrypted Retrieval Method With Semantic Feature Fusion Towards Internet of Medical Things.

  • Jan 01, 2025
  • IEEE journal of biomedical and health informatics
  • Puning Zhang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.