• Home
  • Search
  • Joint Training and Decoding for Multilingual End-to-End Simultaneous Speech Translation
  • https://doi.org/10.1109/icassp49357.2023.10095811Copy DOI Icon

Joint Training and Decoding for Multilingual End-to-End Simultaneous Speech Translation

  • Jun 4, 2023
  • Wuwei Huang +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Recent studies on end-to-end speech translation(ST) have facilitated the exploration of multilingual end-to-end ST and end-to-end simultaneous ST. In this paper, we investigate end-to-end simultaneous speech translation in a one-to-many multilingual setting which is closer to applications in real scenarios. We explore a separate decoder architecture and a unified architecture for joint synchronous training in this scenario. To further explore knowledge transfer across languages, we propose an asynchronous training strategy on the proposed unified decoder architecture. A multi-way aligned multilingual end-to-end ST dataset was curated as a benchmark testbed to evaluate our methods. Experimental results demonstrate the effectiveness of our models on the collected dataset. Our codes and data are available at: https://github.com/XiaoMi/TED-MMST.

Similar Papers
  • PDF
  • Conference Article
  • Citations21

Neural Speech Translation using Lattice Transformations and Graph Networks

  • Jan 01, 2019
  • Daniel Beck +2
  • Research Article
  • Citations3

Signal detection and material identification method for loose particles inside aerospace relays based on overlapping signals

  • Jan 16, 2024
  • Mechanical Systems and Signal Processing
  • Zhigang Sun +5
  • Conference Article
  • Citations7

In-the-Wild End-to-End Detection of Speech Affecting Diseases

  • Dec 01, 2019
  • 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
  • Joana Correia +2
  • PDF
  • Conference Article
  • Citations102

Prediction Improves Simultaneous Neural Machine Translation

  • Jan 01, 2018
  • Ashkan Alinejad +2
  • Research Article
  • Citations16

A polyelectrolyte based supramolecular assembly for ratiometric sensing of ATP with very high discrimination from pyrophosphate

  • Jan 07, 2021
  • Journal of Molecular Liquids
  • Vidya R Singh +2
  • Book Chapter
  • Citations4

AI-Based Renewable Energy with Emerging Applications

  • Oct 07, 2021
  • Omkar Singh +3
  • Conference Article
  • Citations8

A Survey of Semantic Segmentation Methods in Traffic Scenarios

  • Aug 01, 2022
  • Yuanhui Guo +1
  • Dissertation

Teaching counselling ethics: a resource book

  • Jan 01, 2009
  • Shandee M Whitehead
  • Research Article

Overconfidence Bias as an Explanation of Economic Behaviours

  • Dec 24, 2024
  • Highlights in Business, Economics and Management
  • Yijia Zhang
  • Research Article
  • Citations44

A hybrid decomposed fuzzy multi-criteria decision-making model for optimizing parcel lockers location in the last-mile delivery landscape

  • Feb 05, 2024
  • Applied Soft Computing
  • Sarbast Moslem +3
  • Research Article
  • Citations33

Blockchain Applied to Vehicular Odometers

  • Jan 01, 2020
  • IEEE Network
  • Lucas R Abbade +7
  • Research Article
  • Citations20

Exploiting Raw Images for Real-Scene Super-Resolution.

  • Jan 01, 2020
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Xiangyu Xu +3
  • Conference Article
  • Citations1

LJPCheck: Functional Tests for Legal Judgment Prediction

  • Jan 01, 2024
  • Yuan Zhang +7
  • Research Article
  • Citations38

Robust principal component analysis via optimal mean by joint ℓ2,1 and Schatten p-norms minimization

  • Jan 04, 2018
  • Neurocomputing
  • Xiaoshuang Shi +3
  • Conference Article
  • Citations4

Complex event processing model for distributed RFID network

  • Nov 24, 2009
  • Xiao Jia +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.