InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval

Xingquan Zhu, Ahmed Elmagarmid, Xiangyang Xue, Lide Wu, Ann Christine Catlin

Research output: Contribution to journalArticle

68 Citations (Scopus)


Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.

Original languageEnglish
Pages (from-to)648-666
Number of pages19
JournalIEEE Transactions on Multimedia
Issue number4
Publication statusPublished - 1 Aug 2005
Externally publishedYes



  • Video browsing
  • Video content organization
  • Video retrieval
  • Video similarity assessment

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this