Video data mining

Semantic indexing and event detection from the association perspective

Xingquan Zhu, Xindong Wu, Ahmed Elmagarmid, Zhe Feng, Lide Wu

Research output: Contribution to journalArticle

98 Citations (Scopus)

Abstract

Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the performance of the proposed approach.

Original languageEnglish
Pages (from-to)665-677
Number of pages13
JournalIEEE Transactions on Knowledge and Data Engineering
Volume17
Issue number5
DOIs
Publication statusPublished - 1 May 2005
Externally publishedYes

Fingerprint

Data mining
Audio streaming
Semantics
Labels
Textures
Cameras
Color
Processing
Industry

Keywords

  • Database management
  • Knowledge-based systems
  • Multimedia systems
  • Video mining

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Artificial Intelligence
  • Information Systems

Cite this

Video data mining : Semantic indexing and event detection from the association perspective. / Zhu, Xingquan; Wu, Xindong; Elmagarmid, Ahmed; Feng, Zhe; Wu, Lide.

In: IEEE Transactions on Knowledge and Data Engineering, Vol. 17, No. 5, 01.05.2005, p. 665-677.

Research output: Contribution to journalArticle

@article{ad3a5a96e1b142e297bef81836f724f6,
title = "Video data mining: Semantic indexing and event detection from the association perspective",
abstract = "Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the performance of the proposed approach.",
keywords = "Database management, Knowledge-based systems, Multimedia systems, Video mining",
author = "Xingquan Zhu and Xindong Wu and Ahmed Elmagarmid and Zhe Feng and Lide Wu",
year = "2005",
month = "5",
day = "1",
doi = "10.1109/TKDE.2005.83",
language = "English",
volume = "17",
pages = "665--677",
journal = "IEEE Transactions on Knowledge and Data Engineering",
issn = "1041-4347",
publisher = "IEEE Computer Society",
number = "5",

}

TY - JOUR

T1 - Video data mining

T2 - Semantic indexing and event detection from the association perspective

AU - Zhu, Xingquan

AU - Wu, Xindong

AU - Elmagarmid, Ahmed

AU - Feng, Zhe

AU - Wu, Lide

PY - 2005/5/1

Y1 - 2005/5/1

N2 - Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the performance of the proposed approach.

AB - Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the performance of the proposed approach.

KW - Database management

KW - Knowledge-based systems

KW - Multimedia systems

KW - Video mining

UR - http://www.scopus.com/inward/record.url?scp=19944366235&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=19944366235&partnerID=8YFLogxK

U2 - 10.1109/TKDE.2005.83

DO - 10.1109/TKDE.2005.83

M3 - Article

VL - 17

SP - 665

EP - 677

JO - IEEE Transactions on Knowledge and Data Engineering

JF - IEEE Transactions on Knowledge and Data Engineering

SN - 1041-4347

IS - 5

ER -