User-assisted reflection detection and feature point tracking

Mohamed A. Elgharib, François Pitite, Anil Kokaram, Venkatesh Saligrama

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Reflections in image sequences violate the single layer model used by most current image processing techniques. As a result reflections cause many techniques to fail e.g. detection, tracking, motion estimation, etc. Recent work was proposed by Ahmed et al. [5] to detect reflections. Their technique is robust to pathological motion and motion blur. This paper has three main contributions. The first simplifies and fully automates the technique of Ahmed et al. User feedback is common in post-production video manipulation tools. Hence in the second contribution we propose an effective way of integrating few user-assisted masks to improve detection rates. The third contribution of this paper is an application for reflection detection. Here we explore better feature point tracking for the regions detected as reflection. Tracks usually die quickly in such regions due to temporal color inconsistencies. In this paper we show that the lifespan of such tracks can be extended through layer separation. Results show reduction in missed detections and in computational load over Ahmed et al. Results also show the generation of more reliable tracks despite strong layer mixing.

Original languageEnglish
Title of host publicationProceedings of the 10th European Conference on Visual Media Production, CVMP 2013
DOIs
Publication statusPublished - 1 Dec 2013
Event10th European Conference on Visual Media Production, CVMP 2013 - London, United Kingdom
Duration: 6 Nov 20137 Nov 2013

Publication series

NameACM International Conference Proceeding Series

Other

Other10th European Conference on Visual Media Production, CVMP 2013
CountryUnited Kingdom
CityLondon
Period6/11/137/11/13

    Fingerprint

Keywords

  • feature point tracks
  • layer separation
  • reflection detection
  • user-assisted masks

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Elgharib, M. A., Pitite, F., Kokaram, A., & Saligrama, V. (2013). User-assisted reflection detection and feature point tracking. In Proceedings of the 10th European Conference on Visual Media Production, CVMP 2013 (ACM International Conference Proceeding Series). https://doi.org/10.1145/2534008.2534011