Çok bakişli i̇şitsel-görsel dans verilerinin analizi ve sentezi

Translated title of the contribution: Analysis and synthesis of multiview audio-visual dance figures

F. Ofli, Y. Demir, C. Canton-Ferrer, J. Tilmanne, K. Balci, E. Bozkurt, I. Kizoǧlu, Y. Yemez, E. Erzin, A. M. Tekalp, L. Akarun, A. T. Erdem

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a framework for audio-driven human body motion analysis and synthesis. The video is analyzed to capture the time-varying posture of the dancer's body whereas the musical audio signal is processed to extract the beat information. The human body posture is extracted from multiview video information without any human intervention using a novel marker-based algorithm based on annealing particle filtering. Body movements of the dancer are characterized by a set of recurring semantic motion patterns, i.e., dance figures. Each dance figure is modeled in a supervised manner with a set of HMM (Hidden Markov Model) structures and the associated beat frequency. In synthesis, given an audio signal of a learned musical type, the motion parameters of the corresponding dance figures are synthesized via the trained HMM structures in synchrony with the input audio signal based on the estimated tempo information. Finally, the generated motion parameters are animated along with the musical audio using a graphical animation tool. Experimental results demonstrate the effectiveness of the proposed framework.

Original languageTurkish
Title of host publication2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU
DOIs
Publication statusPublished - 26 Nov 2008
Event2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU - Aydin, Turkey
Duration: 20 Apr 200822 Apr 2008

Publication series

Name2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU

Conference

Conference
CountryTurkey
CityAydin
Period20/4/0822/4/08

    Fingerprint

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Communication

Cite this

Ofli, F., Demir, Y., Canton-Ferrer, C., Tilmanne, J., Balci, K., Bozkurt, E., Kizoǧlu, I., Yemez, Y., Erzin, E., Tekalp, A. M., Akarun, L., & Erdem, A. T. (2008). Çok bakişli i̇şitsel-görsel dans verilerinin analizi ve sentezi. In 2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU [4632725] (2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU). https://doi.org/10.1109/SIU.2008.4632725