Dans fi̇gürleri̇ni̇n i̇şi̇tsel-görsel anali̇zi̇ i̇çi̇n i̇şi̇tsel özni̇teli̇kleri̇n deǧerlendi̇ri̇lmesi̇

Y. Demir, F. Ofli, E. Erzin, Y. Yemez, Ve A.M. Tekalp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a framework for selecting best audio features for audiovisual analysis and synthesis of dance figures. Dance figures are performed synchronously with the musical rhythm. They can be analyzed through the audio spectra using spectral and rhythmic musical features. In the proposed audio feature evaluation system, dance figures are manually labeled over the video stream. The music segments, which correspond to labeled dance figures, are used to train hidden Markov model (HMM) structures to learn temporal spectrum patterns for the dance figures. The dance figure recognition performances of the HMM models for various spectral feature sets are evaluated. Audio features, which are maximizing dance figure recognition performances, are selected as the best audio features for the analyzed audiovisual dance recordings. In our evaluations, mel-scale cepstral coefficients (MFCC) with their first and second derivatives, spectral centroid, spectral flux and spectral roll-off are used as candidate audio features. Selection of the best audio features can be used towards analysis and synthesis of audio-driven body animation.

Original languageTurkish
Title of host publication2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU
DOIs
Publication statusPublished - 26 Nov 2008
Event2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU - Aydin, Turkey
Duration: 20 Apr 200822 Apr 2008

Publication series

Name2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU

Conference

Conference
CountryTurkey
CityAydin
Period20/4/0822/4/08

Keywords

  • Audio-driven body animation
  • Audio-visual analysis

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Communication

Cite this

Demir, Y., Ofli, F., Erzin, E., Yemez, Y., & Tekalp, V. A. M. (2008). Dans fi̇gürleri̇ni̇n i̇şi̇tsel-görsel anali̇zi̇ i̇çi̇n i̇şi̇tsel özni̇teli̇kleri̇n deǧerlendi̇ri̇lmesi̇. In 2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU [4632707] (2008 IEEE 16th Signal Processing, Communication and Applications Conference, SIU). https://doi.org/10.1109/SIU.2008.4632707