A Novel Approach for Allocating Mathematical Expressions to Visual Speech Signals

Mohammad Hossein Sadaghiani, Niusha Shafiabady, Dino Isa

Research output: Contribution to journalArticlepeer-review

Abstract

In this article, visual speech information modeling analysis by explicit mathematical expressions coupled with words’ phonemic structure is presented. The visual information is obtained from deformation of lips’ dimensions during articulation of a set of words that is called visual speech sample set. The continuous interpretation of the lips’ movement has been provided using Barycentric Lagrange Interpolation producing a unique mathematical expression named visual speech signal. Hierarchical analysis of the phoneme sequences has been applied for words’ categorization to organize the database properly. The visual samples were extracted from three visual feature points chosen on the lips via an experiment in which two individuals pronounced the aforementioned words. The simulation results show that each individual word can be represented by a mathematical expression or visual speech signal whereas the sample sets can also be derived from the same mathematical expression, and this is a significant improvement over the popular statistical methods.

Original languageEnglish
Pages (from-to)1–11
Number of pages11
JournalSage Open
Volume5
Issue number4
DOIs
Publication statusPublished - 27 Oct 2015
Externally publishedYes

Fingerprint

Dive into the research topics of 'A Novel Approach for Allocating Mathematical Expressions to Visual Speech Signals'. Together they form a unique fingerprint.

Cite this