InsightVideo

Toward hierarchical video content organization for efficient browsing, summarization and retrieval

Xingquan Zhu, Ahmed Elmagarmid, Xiangyang Xue, Lide Wu, Ann Christine Catlin

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.

Original languageEnglish
Pages (from-to)648-666
Number of pages19
JournalIEEE Transactions on Multimedia
Volume7
Issue number4
DOIs
Publication statusPublished - 1 Aug 2005
Externally publishedYes

Fingerprint

Cameras
Processing

Keywords

  • Video browsing
  • Video content organization
  • Video retrieval
  • Video similarity assessment

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

InsightVideo : Toward hierarchical video content organization for efficient browsing, summarization and retrieval. / Zhu, Xingquan; Elmagarmid, Ahmed; Xue, Xiangyang; Wu, Lide; Catlin, Ann Christine.

In: IEEE Transactions on Multimedia, Vol. 7, No. 4, 01.08.2005, p. 648-666.

Research output: Contribution to journalArticle

Zhu, Xingquan ; Elmagarmid, Ahmed ; Xue, Xiangyang ; Wu, Lide ; Catlin, Ann Christine. / InsightVideo : Toward hierarchical video content organization for efficient browsing, summarization and retrieval. In: IEEE Transactions on Multimedia. 2005 ; Vol. 7, No. 4. pp. 648-666.
@article{19a09870ec3c4df49ad18f08d0f39feb,
title = "InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval",
abstract = "Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.",
keywords = "Video browsing, Video content organization, Video retrieval, Video similarity assessment",
author = "Xingquan Zhu and Ahmed Elmagarmid and Xiangyang Xue and Lide Wu and Catlin, {Ann Christine}",
year = "2005",
month = "8",
day = "1",
doi = "10.1109/TMM.2005.850977",
language = "English",
volume = "7",
pages = "648--666",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "4",

}

TY - JOUR

T1 - InsightVideo

T2 - Toward hierarchical video content organization for efficient browsing, summarization and retrieval

AU - Zhu, Xingquan

AU - Elmagarmid, Ahmed

AU - Xue, Xiangyang

AU - Wu, Lide

AU - Catlin, Ann Christine

PY - 2005/8/1

Y1 - 2005/8/1

N2 - Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.

AB - Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.

KW - Video browsing

KW - Video content organization

KW - Video retrieval

KW - Video similarity assessment

UR - http://www.scopus.com/inward/record.url?scp=24944491051&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=24944491051&partnerID=8YFLogxK

U2 - 10.1109/TMM.2005.850977

DO - 10.1109/TMM.2005.850977

M3 - Article

VL - 7

SP - 648

EP - 666

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 4

ER -