• Home
  • Search
  • Deep adversarial metric learning for cross-modal retrieval
  • Cite Icon227
  • https://doi.org/10.1007/s11280-018-0541-xCopy DOI Icon

Deep adversarial metric learning for cross-modal retrieval

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Cross-modal retrieval has become a highlighted research topic, to provide flexible retrieval experience across multimedia data such as image, video, text and audio. The core of existing cross-modal retrieval approaches is to narrow down the gap between different modalities either by finding a maximally correlated embedding space. Recently, researchers leverage Deep Neural Network (DNN) to learn nonlinear transformations for each modality to obtain transformed features in a common subspace where cross-modal matching can be performed. However, the statistical characteristics of the original features for each modality are not explicitly preserved in the learned subspace. Inspired by recent advances in adversarial learning, we propose a novel Deep Adversarial Metric Learning approach, termed DAML for cross-modal retrieval. DAML nonlinearly maps labeled data pairs of different modalities into a shared latent feature subspace, under which the intra-class variation is minimized and the inter-class variation is maximized, and the difference of each data pair captured from two modalities of the same class is minimized, respectively. In addition to maximizing the correlations between modalities, we add an additional regularization by introducing adversarial learning. In particular, we introduce a modality classifier to predict the modality of a transformed feature, which ensures that the transformed features are also statistically indistinguishable. Experiments on three popular multimodal datasets show that DAML achieves superior performance compared to several state of the art cross-modal retrieval methods.

Similar Papers
  • Research Article
  • Citations44

Deep Adversarial Metric Learning.

  • Oct 25, 2019
  • IEEE Transactions on Image Processing
  • Yueqi Duan +3
  • Conference Article
  • Citations245

Deep Adversarial Metric Learning

  • Jun 01, 2018
  • Yueqi Duan +4
  • Conference Article
  • Citations832

Adversarial Cross-Modal Retrieval

  • Oct 19, 2017
  • Bokun Wang +4
  • PDF
  • Research Article
  • Citations28

DeepMal: maliciousness-Preserving adversarial instruction learning against static malware detection

  • May 14, 2021
  • Cybersecurity
  • Chun Yang +6
  • Research Article
  • Citations116

Adversarial Deep Learning in EEG Biometrics.

  • Mar 27, 2019
  • IEEE Signal Processing Letters
  • Ozan Ozdenizci +3
  • Conference Article
  • Citations2

Self-supervised adversarial learning for cross-modal retrieval

  • Mar 07, 2021
  • Yangchao Wang +5
  • Research Article
  • Citations135

Adversarial Deep Learning for Over-the-Air Spectrum Poisoning Attacks

  • Feb 01, 2021
  • IEEE Transactions on Mobile Computing
  • Yalin E Sagduyu +2
  • Research Article
  • Citations22

Wearable Sensor-Based Chronic Condition Severity Assessment: An Adversarial Attention-Based Deep Multisource Multitask Learning Approach

  • Sep 01, 2022
  • MIS Quarterly
  • Shuo Yu +4
  • Conference Article
  • Citations15

Deep Adversarial Learning for

  • Jan 01, 2019
  • William Yang Wang +2
  • Research Article
  • Citations1

Adversarial task-specific learning

  • Jul 20, 2019
  • Neurocomputing
  • Xin Fu +5
  • Research Article
  • Citations391

Adversarial Machine Learning for Network Intrusion Detection Systems: A Comprehensive Survey

  • Jan 01, 2023
  • IEEE Communications Surveys & Tutorials
  • Ke He +2
  • Conference Article
  • Citations6

Deep Semantic Correlation with Adversarial Learning for Cross-Modal Retrieval

  • Jul 01, 2019
  • Yan Hua +1
  • Research Article
  • Citations85

A network security situation assessment method based on adversarial deep learning

  • Jan 11, 2021
  • Applied Soft Computing
  • Hongyu Yang +3
  • Conference Article
  • Citations148

Adversarial Deep Learning for Cognitive Radio Security: Jamming Attack and Defense Strategies

  • May 01, 2018
  • Yi Shi +5
  • Conference Article
  • Citations31

Deep adversarial one-class learning for normal and abnormal chest radiograph classification

  • Mar 13, 2019
  • Medical Imaging 2019: Computer-Aided Diagnosis
  • Yuxing Tang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.