• Home
  • Search
  • Dynamic Alignment Mask CTC: Improved Mask CTC With Aligned Cross Entropy
  • Cite Icon4
  • https://doi.org/10.1109/icassp49357.2023.10095227Copy DOI Icon

Dynamic Alignment Mask CTC: Improved Mask CTC With Aligned Cross Entropy

  • Jun 4, 2023
  • Xulong Zhang +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Because of predicting all the target tokens in parallel, the non-autoregressive models greatly improve the decoding efficiency of speech recognition compared with traditional autoregressive models. In this work, we present dynamic alignment Mask CTC, introducing two methods: (1) Aligned Cross Entropy (AXE), finding the monotonic alignment that minimizes the cross-entropy loss through dynamic programming, (2) Dynamic Rectification, creating new training samples by replacing some masks with model predicted tokens. The AXE ignores the absolute position alignment between prediction and ground truth sentence and focuses on tokens matching in relative order. The dynamic rectification method makes the model capable of simulating the non-mask but possible wrong tokens, even if they have high confidence. Our experiments on WSJ dataset demonstrated that not only AXE loss but also the rectification method could improve the WER performance of Mask CTC.

Similar Papers
  • PDF
  • Research Article
  • Citations2

A Multi-Featured Factor Analysis and Dynamic Window Rectification Method for Remaining Useful Life Prognosis of Rolling Bearings

  • Nov 13, 2023
  • Entropy
  • Cheng Peng +4
  • PDF
  • Research Article
  • Citations15

Study on the semi-supervised learning-based patient similarity from heterogeneous electronic medical records

  • Jul 01, 2021
  • BMC Medical Informatics and Decision Making
  • Ni Wang +6
  • Research Article
  • Citations11

Optimal load clipping with time of use rates

  • May 01, 1998
  • International Journal of Electrical Power and Energy Systems
  • Isto Aho +3
  • Research Article
  • Citations9

Prediction Model of Transpiration Rate of Strawberry in Closed Cultivation Based on DBN-LSSVM Algorithm

  • Jan 01, 2018
  • IFAC-PapersOnLine
  • Li Shuaishuai +6
  • Abstract

1221 Deciphering cellular features: StyleGAN for enhancing H&E cell classification

  • Nov 01, 2024
  • Journal for ImmunoTherapy of Cancer
  • Zheng Yi Ho +7
  • Research Article
  • Citations76

The application of dynamic programming to slope stability analysis

  • Aug 01, 2003
  • Canadian Geotechnical Journal
  • Ha T.V Pham +1
  • Research Article
  • Citations26

Multi-Stage Dynamic Programming Method for Short-Term Cascade Reservoirs Optimal Operation with Flow Attenuation

  • Jul 05, 2017
  • Water Resources Management
  • Changming Ji +4
  • Conference Article
  • Citations1

A Highly-Efficient Face Recognition Method Based on Weighted LDA

  • Dec 01, 2008
  • Ru-Yan Wang +4
  • Dissertation

Dynamic Programming as a Scheduling Tool in Multiprogrammed Computing Systems

  • Jan 01, 1978
  • Raymond Douglas Brownrigg
  • Research Article
  • Citations2

Hydropower Optimization for the Lower Seyhan Basin System in Turkey using dynamic programming

  • Dec 01, 2006
  • Water International
  • Recep Yurtal +2
  • Research Article

Decision Analysis Based on Enterprise Production Process

  • Aug 12, 2025
  • Scientific and Social Research
  • Wu Ning Xi +1
  • PDF
  • Research Article
  • Citations3

Research on Dynamic Programming Strategy of Bayesian Network Structure Learning

  • May 20, 2022
  • Scientific Programming
  • Ruohai Di +4
  • Research Article

Penerapan Program Dinamik untuk Mengoptimalkan Total Biaya dalam Perencanaan Produksi dan Pengendalian Persediaan

  • Jun 13, 2024
  • Konstanta : Jurnal Matematika dan Ilmu Pengetahuan Alam
  • Bella Lestari +1
  • Conference Article
  • Citations2

Breast mass segmentation in mammography using improved dynamic programming

  • Jun 01, 2012
  • Buer Qi +3
  • Research Article
  • Citations39

Dynamic Programming for QFD Optimization

  • Jan 01, 2005
  • Quality and Reliability Engineering International
  • X Lai +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.