• Home
  • Search
  • Incompleteness and fragmentation in spoken language syntax and its relation to prosody and gesturing: Cognitive processes vs. Possible formal cues
  • Cite Icon6
  • https://doi.org/10.1109/coginfocom.2013.6719243Copy DOI Icon

Incompleteness and fragmentation in spoken language syntax and its relation to prosody and gesturing: Cognitive processes vs. Possible formal cues

  • Dec 1, 2013
  • Laszlo Hunyadi
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Spoken dialogs represent a considerable challenge for language technology for at least two reasons: (a) due to the frequent incompleteness of syntactic structure a given sequence of words cannot often undergo satisfactory parsing, (b) as a result, the associated fragmented prosody may not be used to substitute for missing elements. However, spoken dialogs are essentially multimodal with nonverbal means having the potential of offering some particular structural cues as well as functional-pragmatic ones. An incomplete syntax should in principle break down automatic syntactic analysis, however, its combination with the output of other; non-verbal modalities may generate cues to some possible interpretation and decision making. An important challenge is to identify a proper complex of such aligning cues for a suitable decision making. In this context relying on larger amounts of data gleaned from longer stretches of communicative events may contribute to a more successful representation of the cognitive content behind similar instances of fragmented communication if these sets of data are based on a theoretically founded understanding of multimodal communication. The HuComTech multimodal corpus of 60 hours of spoken dialogues of Hungarian [1] consists of a multi-level annotation of both physical and interpretative (functional, pragmatic) aspects of communication. Annotation is not purely descriptive: it is based on a novel generative model of communication allowing for the capturing of the two-way, top down and bottom up character of communication with the purpose to identify the individual minimal building blocks of communication and to get a deeper understanding of how these components make up a complex communicative event as a whole. Based on these insights, a novel scheme of annotation for syntax, prosody as well as uni- and multimodal pragmatics is introduced aiming at describing and understanding the multimodal nature of human communication, cognitive info-communication in general, and, on the longer run, contributing to the further development of human-computer interaction systems.

Similar Papers
  • Research Article
  • Citations5

ESL Readers’ Perceptions of Reading in Well Structured and Less Structured Hypertext Environment

  • Apr 01, 2005
  • CALICO Journal
  • Khalid Al-Seghayer
  • Research Article
  • Citations2

Masks, Empathy, and a Pediatric Cancer Diagnosis During COVID-19.

  • Nov 01, 2021
  • Pediatrics
  • Sarah R Brand Mccarthy +1
  • Research Article
  • Citations13

The influence of visual–spatial skills on the association between processing of nonsymbolic numerical magnitude and number word sequence skills

  • Oct 30, 2018
  • Journal of Experimental Child Psychology
  • Jan Lonnemann +3
  • Abstract

Effects of executive function stimulation in the language improvement of children with ASD

  • Apr 01, 2017
  • European Psychiatry
  • I Sun +1
  • Research Article
  • Citations158

Sequential processing of cues in memory-based multiattribute decisions

  • Oct 01, 2007
  • Psychonomic Bulletin & Review
  • Arndt Bröder +1
  • Research Article
  • Citations7

Argumentative Strategies and Multimodality in Oral Business Discourse: From Theory to Practice

  • Feb 01, 2014
  • Procedia - Social and Behavioral Sciences
  • Inmaculada Tamarit +1
  • Research Article

Проблеми моделювання лексико-семантичного поля: прагматичний і комунікативний аспекти

  • Feb 20, 2019
  • Science and Education a New Dimension
  • O Leptuga +1
  • Research Article
  • Citations19

Connectionism and information processing abstractions

  • Dec 01, 1988
  • AI Magazine
  • B Chandrasekaran +2
  • Research Article
  • Citations2

Linguopragmatic Scopes of Modern Media Texts

  • Oct 15, 2023
  • RUDN Journal of Language Studies, Semiotics and Semantics
  • Natalia A Akhrenova +1
  • Conference Article

Muslim Sermons In Russian: Communicative And Pragmatic Aspect

  • Dec 28, 2019
  • ˜The œEuropean Proceedings of Social & Behavioural Sciences
  • Tatiana Itskovich* +1
  • Research Article
  • Citations1

Political Discourse of the Fuel and Energy Complex: Communicative and Pragmatic Aspect

  • Jan 15, 2024
  • Russian Studies in Philology
  • V V Kolesnikov +1
  • Research Article
  • Citations1

PROFESSIONALLY ORIENTED TRAINING COURSE "RUSSIAN LANGUAGE AND SPEECH CULTURE" AS A CONDITION FOR IMPROVING THE SPEECH TRAINING QUALITY OF SPECIALISTS

  • Mar 31, 2015
  • Anastasia V Koreneva +1
  • Research Article
  • Citations1

WAR IN UKRAINE: HUMOR VS FEAR (COMMUNICATIVE AND PRAGMATIC ASPECT)

  • Dec 23, 2022
  • Вісник Житомирського державного університету імені Івана Франка. Філологічні науки
  • N Diachenko +1
  • PDF
  • Research Article

Appeals in Russian and Persian Linguistic Cultures: Comparative Aspect

  • Feb 06, 2023
  • Vestnik NSU. Series: History and Philology
  • Kh Siami Eidlak +1
  • Research Article

A construção de intensificação com lexemas de cor no português brasileiro

  • Oct 06, 2020
  • Revista Linguíʃtica
  • Nahendi Almeida Mota +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.