• Home
  • Search
  • Towards Learning a Universal Non-Semantic Representation of Speech
  • Open Access IconOpen Access
  • Cite Icon133
  • https://doi.org/10.21437/interspeech.2020-1242Copy DOI Icon

Towards Learning a Universal Non-Semantic Representation of Speech

  • Oct 25, 2020
  • Joel Shor +9 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The ultimate goal of transfer learning is to reduce labeled data requirements by exploiting a pre-existing embedding model trained for different datasets or tasks. The visual and language communities have established benchmarks to compare embeddings, but the speech community has yet to do so. This paper proposes a benchmark for comparing speech representations on non-semantic tasks, and proposes a representation based on an unsupervised triplet-loss objective. The proposed representation outperforms other representations on the benchmark, and even exceeds state-of-the-art performance on a number of transfer learning tasks. The embedding is trained on a publicly available dataset, and it is tested on a variety of low-resource downstream tasks, including personalization tasks and medical domain. The benchmark, models, and evaluation code are publicly released.

Similar Papers
  • Book Chapter
  • Citations11

Arabic on the media: Hybridity and styles

  • Jan 01, 2007
  • Mushira Eid
  • PDF
  • Supplementary Content
  • Citations238

Heritage language and linguistic theory

  • Oct 09, 2015
  • Frontiers in Psychology
  • Gregory Scontras +2
  • Dissertation
  • Citations1

A (Contact-)Grammar of Romeyka

  • Jan 01, 2023
  • Laurentia Schreiber
  • Research Article
  • Citations3

A critical analysis of the use of code-switching in Nhlapho's novel Imbali YemaNgcamane

  • Jul 03, 2014
  • South African Journal of African Languages
  • Stanley Madonsela
  • Research Article
  • Citations4

The Bajjika language and speech community Abhishek Kumar Kashyap

  • Jan 01, 2014
  • International Journal of the Sociology of Language
  • Abhishek Kumar Kashyap
  • Research Article
  • Citations13

Explainable Artificial Intelligence–A New Step towards the Trust in Medical Diagnosis with AI Frameworks: A Review

  • Jan 01, 2022
  • Computer Modeling in Engineering & Sciences
  • Nilkanth Mukund Deshpande +3
  • Research Article

Lynn Anthonissen: Individuality in language change

  • Nov 01, 2023
  • Folia Linguistica
  • Alexander Bergs
  • Research Article
  • Citations6

Lexical expansion and terminological planning in indigenous and planned languages

  • Jul 21, 2014
  • Language Problems and Language Planning
  • Chris Krägeloh +1
  • Book Chapter
  • Citations6

English as an International Language

  • Dec 13, 2017
  • The International Encyclopedia of Intercultural Communication
  • Farzad Sharifian
  • Research Article
  • Citations3

Language choices and industrialization

  • Oct 12, 2006
  • Journal of Asian Pacific Communication
  • Jinyi Yang
  • Research Article

“It makes It the Market”

  • Jun 15, 2021
  • Lifespans and Styles
  • Canaan Zengyu Lan
  • Research Article
  • Citations252

Whaddayaknow?: The modes of folk linguistic awareness1

  • Jan 01, 1996
  • Language Awareness
  • Dennis R Preston
  • Research Article
  • Citations184

The semiotic stance

  • Oct 13, 2005
  • Semiotica
  • Paul Kockelman
  • Research Article

The use of specific linguistic features within the context of a casual conversation in a speech community

  • Apr 15, 2020
  • EJOTMAS: Ekpoma Journal of Theatre and Media Arts
  • Ekiyokere Ekiye
  • Research Article

The Ethnolinguistic Vitality of Gulgulia

  • Jun 01, 2023
  • Sustainable Multilingualism
  • Sneha Mishra +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.