İşitsel-görsel dans verilerinin birleşik i̇linti analizi

Translated title of the contribution: Joint correlation analysis of audio-visual dance figures

F. Ofli, Y. Demir, E. Erzin, Y. Yemez, A. M. Tekalp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present a framework for analysis of dance figures from audio-visual data. Our audio-visual data is the multiview video of a dancing actor which is acquired using 8 synchronized cameras. The multi-camera motion capture technique of this framework is based on 3D tracking of the markers attached to the dancer's body, using stereo color information. The extracted 3D points are used to calculate the body motion features as 3D displacement vectors. On the other hand, MFC coefficients serve as the audio features. In the first stage of the two stage analysis task, we perform Hidden Markov Model (HMM) based unsupervised temporal segmentation of the audio and body motion features, separately, to extract the recurrent elementary audio and body motion patterns. In the second stage, the correlation of body motion patterns with audio patterns is investigated to create a correlation model that can be used during the synthesis of an audio-driven body animation.

Original languageTurkish
Title of host publication2007 IEEE 15th Signal Processing and Communications Applications, SIU
PublisherIEEE Computer Society
ISBN (Print)1424407192, 9781424407194
DOIs
Publication statusPublished - 1 Jan 2007
Event2007 IEEE 15th Signal Processing and Communications Applications, SIU - Eskisehir, Turkey
Duration: 11 Jun 200713 Jun 2007

Publication series

Name2007 IEEE 15th Signal Processing and Communications Applications, SIU

Conference

Conference
CountryTurkey
CityEskisehir
Period11/6/0713/6/07

    Fingerprint

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Communication
  • Signal Processing

Cite this

Ofli, F., Demir, Y., Erzin, E., Yemez, Y., & Tekalp, A. M. (2007). İşitsel-görsel dans verilerinin birleşik i̇linti analizi. In 2007 IEEE 15th Signal Processing and Communications Applications, SIU [4298617] (2007 IEEE 15th Signal Processing and Communications Applications, SIU). IEEE Computer Society. https://doi.org/10.1109/SIU.2007.4298617