• Home
  • Search
  • Weakly Supervised Face Naming with Symmetry-Enhanced Contrastive Loss
  • Open Access IconOpen Access
  • Cite Icon2
  • https://doi.org/10.1109/wacv56688.2023.00350Copy DOI Icon

Weakly Supervised Face Naming with Symmetry-Enhanced Contrastive Loss

  • Jan 1, 2023
  • Tingyu Qu +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

We revisit the weakly supervised cross-modal face-name alignment task; that is, given an image and a caption, we label the faces in the image with the names occurring in the caption. Whereas past approaches have learned the latent alignment between names and faces by uncertainty reasoning over a set of images and their respective captions, in this paper, we rely on appropriate loss functions to learn the alignments in a neural network setting and propose SECLA and SECLA-B.SECLA is a Symmetry-Enhanced Contrastive Learning-based Alignment model that can effectively maximize the similarity scores between corresponding faces and names in a weakly supervised fashion. A variation of the model, SECLA-B, learns to align names and faces as humans do, that is, learning from easy to hard cases to further increase the performance of SECLA. More specifically, SECLA-B applies a two-stage learning framework: (1) Training the model on an easy subset with a few names and faces in each image-caption pair. (2) Leveraging the known pairs of names and faces from the easy cases using a bootstrapping strategy with additional loss to prevent forgetting and learning new alignments at the same time. We achieve state-of-the-art results for both the augmented Labeled Faces in the Wild dataset and the Celebrity Together dataset. In addition, we believe that our methods can be adapted to other multimodal news understanding tasks.

Similar Papers
  • Research Article

The Judiciary and Fiscal Crises: An Institutional Critique

  • May 11, 2018
  • SSRN Electronic Journal
  • Peter Conti-Brown +1
  • Research Article
  • Citations31

Hemispheric activation differences in novice and expert clinicians during clinical decision making.

  • Nov 03, 2015
  • Advances in Health Sciences Education
  • Pam Hruska +8
  • Research Article
  • Citations5

Legal Realism Untamed

  • May 23, 2012
  • SSRN Electronic Journal
  • Frederick Schauer
  • Research Article

How Many Cases are Easy?

  • Jun 22, 2018
  • SSRN Electronic Journal
  • Joshua B Fischman
  • Research Article
  • Citations4

Causation and Opportunity in Tort

  • Oct 24, 2017
  • Oxford Journal of Legal Studies
  • Emmanuel Voyiakis
  • Book Chapter
  • Citations1

Legal Reasoning and Argumentation

  • Jan 01, 2001
  • International Encyclopedia of Social & Behavioral Sciences
  • W.L Twining
  • Research Article
  • Citations3

Being Familiar with What One Wants

  • Nov 09, 2020
  • Pacific Philosophical Quarterly
  • Uku Tooming
  • Book Chapter
  • Citations3

Speedy Adjudication in Hard Cases and Low Settlement Rates in Easy Cases

  • Dec 19, 2019
  • Yun-Chien Chang +1
  • Research Article
  • Citations11

BMF-CNN: an object detection method based on multi-scale feature fusion in VHR remote sensing images

  • Dec 24, 2019
  • Remote Sensing Letters
  • Zhong Dong +1
  • Book Chapter
  • Citations21

The (Weighted) Metric Dimension of Graphs: Hard and Easy Cases

  • Jan 01, 2012
  • Leah Epstein +2
  • Book Chapter
  • Citations13

The Shortest Superstring Problem

  • Jan 01, 2014
  • Theodoros P Gevezes +1
  • Research Article

Legal Adjudication, Material Corecctness, and Moral Objectivity

  • Sep 13, 2024
  • Eudaimonia
  • Jorge L Rodríguez
  • Research Article
  • Citations8

ViComp: Video Compensation for Projector-Camera Systems.

  • May 01, 2024
  • IEEE Transactions on Visualization and Computer Graphics
  • Yuxi Wang +2
  • Conference Article
  • Citations13

Localized Motion Artifact Reduction on Brain MRI Using Deep Learning with Effective Data Augmentation Techniques

  • Jul 18, 2021
  • Yijun Zhao +6
  • Research Article

Judicial Perceptions of Legal Difficulty: An Empirical Inquiry

  • Nov 26, 2025
  • Journal of Empirical Legal Studies
  • Brian Sheppard +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.