Genisletilmis DTK Yardimi ile Akustik Isaret Tabanli, Dilden Bagimsiz Bir Ses-Dudak Sekli Eslestirme Yontemi ve Gerceklemesi

Translated title of the contribution: An Acoustic Signal Based Language Independent Lip Synchronization Method and Its Implementation via Extended LPC

Halil Said Cankurtaran, Ali Boyaci, Serhan Yarkan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Processing human speech with the use of digital technologies leads to several important fields of research. Speech- to-text and lip-syncing are among the instances of relevant prominent research areas. In this regard, audio-visualization of acoustic signals, providing visual aid in real-time for disabled people, and realization of text-free animation applications are just to name a few. Therefore, in this study, a language-independent lip-sync method that is based on extended linear predictive coding is proposed. The proposed method operates on baseband electrical signal that is acquired by a standard single-channel off-the-shelf microphone and exploits the statistical characteristics of acoustic signals produced by human speech. In addition, the proposed method is implemented on an embedded system, tested, and its performance is evaluated. Results are given along with discussions and future directions.

Translated title of the contributionAn Acoustic Signal Based Language Independent Lip Synchronization Method and Its Implementation via Extended LPC
Original languageTurkish
Title of host publication2020 28th Signal Processing and Communications Applications Conference, SIU 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728172064
DOIs
StatePublished - Oct 5 2020
Externally publishedYes
Event28th Signal Processing and Communications Applications Conference, SIU 2020 - Gaziantep, Turkey
Duration: Oct 5 2020Oct 7 2020

Publication series

Name2020 28th Signal Processing and Communications Applications Conference, SIU 2020 - Proceedings

Conference

Conference28th Signal Processing and Communications Applications Conference, SIU 2020
Country/TerritoryTurkey
CityGaziantep
Period10/5/2010/7/20

Keywords

  • formant frequency
  • linear predictive coding
  • lip sync

Fingerprint

Dive into the research topics of 'An Acoustic Signal Based Language Independent Lip Synchronization Method and Its Implementation via Extended LPC'. Together they form a unique fingerprint.

Cite this