• Home
  • Search
  • Modulating Dynamic Models for Lip Motion Generation
  • Cite Icon1
  • https://doi.org/10.1145/2974804.2980499Copy DOI Icon

Modulating Dynamic Models for Lip Motion Generation

  • Oct 4, 2016
  • Singo Sawa +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Generation of natural human motion is one of key techniques for multimodal dialogue systems with a human-like avatar. In particular, natural and expressive lip motion synthesis is necessary to make conversation between a user and an avatar richer. However, such expressive lip motion is often difficult to be generated automatically because it can be changed depending on phonemic context and prosody. To address this difficulty, we introduce a novel motion generation method on the basis of the modulation of a set of dynamic models learned from neutral motion data. As a suitable model for lip motion generation, we adopt a hybrid dynamical system, which consists of linear dynamical systems for each motion unit and a symbolic automaton for switching between these units. We show that, from the viewpoint of control theory, it is possible to modulate linear dynamical systems for various types of motion. Early results demonstrate the applicability of the proposed method using lip motion synthesis for simple phoneme sequences.

Similar Papers
  • Research Article
  • Citations13

Linear vibration of thin-walled beams of equal angle-section

  • Jan 01, 1974
  • Journal of Sound and Vibration
  • S Ali Hasan +1
  • Conference Article
  • Citations2

The Periodic and Chaotic Vibration of Dynamical System With Elastic Pendulum

  • Jan 01, 2006
  • Volume 3: Dynamic Systems and Controls, Symposium on Design and Analysis of Advanced Structures, and Tribology
  • Danuta Sado
  • Conference Article
  • Citations4

Imitation learning for variable speed motion generation over multiple actions

  • Oct 13, 2021
  • Yuki Saigusa +3
  • Research Article
  • Citations68

Unified hydrodynamics study for various types of fishes-like undulating rigid hydrofoil in a free stream flow

  • Jul 01, 2018
  • Physics of Fluids
  • Namshad Thekkethil +2
  • Research Article

Dynamic Masking Strategy: An Effective Approach to Enhancing Accurate Human Motion Generation

  • Nov 17, 2025
  • Journal of Artificial Intelligence Research and Innovation
  • Xuan Liu +7
  • Research Article
  • Citations1

Treating Conformational Flexibility in Protein-Protein Docking

  • Jan 01, 2013
  • Current Physical Chemistry
  • Mykhaylo Berynskyy +1
  • Conference Article
  • Citations1

Collective motion of interacting simple robots

  • Nov 29, 2001
  • K Sugawara +2
  • Book Chapter
  • Citations13

Unity3D Virtual Animation of Robots with Coupled and Uncoupled Mechanism

  • Jan 01, 2016
  • Víctor Hugo Andaluz +8
  • Research Article
  • Citations2

On a method for the uniformization of solutions in central motion problems

  • Jan 01, 1981
  • Journal of Applied Mathematics and Mechanics
  • I.M Belen'Kii
  • Research Article
  • Citations27

Practical considerations for a method of rapid cardiac function analysis based on three-dimensional speckle tracking in a three-dimensional diagnostic ultrasound system.

  • Dec 29, 2009
  • Journal of Medical Ultrasonics
  • Tomoyuki Takeguchi +4
  • Conference Article
  • Citations4

Availability Analysis of Robotic Swarm Systems

  • Dec 01, 2008
  • Yansheng Zhang +4
  • Research Article
  • Citations39

Identification and quantification of stick-slip induced brake groan events using experimental and analytical investigations

  • Jan 01, 2008
  • Noise Control Engineering Journal
  • Ashley R Crowther +1
  • Research Article
  • Citations269

How Much the Eye Tells the Brain

  • Jul 01, 2006
  • Current biology : CB
  • Kristin Koch +6
  • Conference Article
  • Citations4

Sensory-Motor Learning for Simultaneous Control of Motion and Force: Generating Rubbing Motion against Uneven Object

  • Jan 09, 2022
  • Hiroshi Ito +2
  • Research Article
  • Citations7

Multimodal feature extraction and fusion for audio-visual speech recognition

  • Jan 01, 2009
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne)
  • Mihai Gurban
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.