Eye localization in low and standard definition content with application to face matching

Bart Kroon, Sander Maas, Sabri Boughorbel, Alan Hanjalic

Research output: Contribution to journalArticle

28 Citations (Scopus)

Abstract

In this paper we address the problem of eye localization for the purpose of face matching in low and standard definition image and video content. In addition to an explorative study that aimed at discovering the effect of eye localization accuracy on face matching performance, we also present a probabilistic eye localization method based on well-known multi-scale local binary patterns (LBPs). These patterns provide a simple but powerful spatial description of texture, and are robust to the noise typical to low and standard definition content. The extensive evaluation involving multiple eye localizers and face matchers showed that the shape of the eye localizer error distribution has a big impact on face matching performance. Conditioned by the error distribution shape and the minimum required eye localization accuracy, eye localization can boost the performance of naive face matchers and allow for more efficient face matching without degrading its performance. The evaluation also showed that our proposed method has superior accuracy with respect to the state-of-the-art on eye localization, and that it fulfills the criteria for improving the face matching performance and efficiency mentioned above.

Original languageEnglish
Pages (from-to)921-933
Number of pages13
JournalComputer Vision and Image Understanding
Volume113
Issue number8
DOIs
Publication statusPublished - Aug 2009
Externally publishedYes

Fingerprint

Textures

Keywords

  • Experimentation
  • Eye localization
  • Face detection
  • Face matching
  • Face recognition
  • Face registration
  • Local binary pattern

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition

Cite this

Eye localization in low and standard definition content with application to face matching. / Kroon, Bart; Maas, Sander; Boughorbel, Sabri; Hanjalic, Alan.

In: Computer Vision and Image Understanding, Vol. 113, No. 8, 08.2009, p. 921-933.

Research output: Contribution to journalArticle

@article{ec39223ec78d4ada86e9c5e89e29d169,
title = "Eye localization in low and standard definition content with application to face matching",
abstract = "In this paper we address the problem of eye localization for the purpose of face matching in low and standard definition image and video content. In addition to an explorative study that aimed at discovering the effect of eye localization accuracy on face matching performance, we also present a probabilistic eye localization method based on well-known multi-scale local binary patterns (LBPs). These patterns provide a simple but powerful spatial description of texture, and are robust to the noise typical to low and standard definition content. The extensive evaluation involving multiple eye localizers and face matchers showed that the shape of the eye localizer error distribution has a big impact on face matching performance. Conditioned by the error distribution shape and the minimum required eye localization accuracy, eye localization can boost the performance of naive face matchers and allow for more efficient face matching without degrading its performance. The evaluation also showed that our proposed method has superior accuracy with respect to the state-of-the-art on eye localization, and that it fulfills the criteria for improving the face matching performance and efficiency mentioned above.",
keywords = "Experimentation, Eye localization, Face detection, Face matching, Face recognition, Face registration, Local binary pattern",
author = "Bart Kroon and Sander Maas and Sabri Boughorbel and Alan Hanjalic",
year = "2009",
month = "8",
doi = "10.1016/j.cviu.2009.03.013",
language = "English",
volume = "113",
pages = "921--933",
journal = "Computer Vision and Image Understanding",
issn = "1077-3142",
publisher = "Academic Press Inc.",
number = "8",

}

TY - JOUR

T1 - Eye localization in low and standard definition content with application to face matching

AU - Kroon, Bart

AU - Maas, Sander

AU - Boughorbel, Sabri

AU - Hanjalic, Alan

PY - 2009/8

Y1 - 2009/8

N2 - In this paper we address the problem of eye localization for the purpose of face matching in low and standard definition image and video content. In addition to an explorative study that aimed at discovering the effect of eye localization accuracy on face matching performance, we also present a probabilistic eye localization method based on well-known multi-scale local binary patterns (LBPs). These patterns provide a simple but powerful spatial description of texture, and are robust to the noise typical to low and standard definition content. The extensive evaluation involving multiple eye localizers and face matchers showed that the shape of the eye localizer error distribution has a big impact on face matching performance. Conditioned by the error distribution shape and the minimum required eye localization accuracy, eye localization can boost the performance of naive face matchers and allow for more efficient face matching without degrading its performance. The evaluation also showed that our proposed method has superior accuracy with respect to the state-of-the-art on eye localization, and that it fulfills the criteria for improving the face matching performance and efficiency mentioned above.

AB - In this paper we address the problem of eye localization for the purpose of face matching in low and standard definition image and video content. In addition to an explorative study that aimed at discovering the effect of eye localization accuracy on face matching performance, we also present a probabilistic eye localization method based on well-known multi-scale local binary patterns (LBPs). These patterns provide a simple but powerful spatial description of texture, and are robust to the noise typical to low and standard definition content. The extensive evaluation involving multiple eye localizers and face matchers showed that the shape of the eye localizer error distribution has a big impact on face matching performance. Conditioned by the error distribution shape and the minimum required eye localization accuracy, eye localization can boost the performance of naive face matchers and allow for more efficient face matching without degrading its performance. The evaluation also showed that our proposed method has superior accuracy with respect to the state-of-the-art on eye localization, and that it fulfills the criteria for improving the face matching performance and efficiency mentioned above.

KW - Experimentation

KW - Eye localization

KW - Face detection

KW - Face matching

KW - Face recognition

KW - Face registration

KW - Local binary pattern

UR - http://www.scopus.com/inward/record.url?scp=67349088551&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67349088551&partnerID=8YFLogxK

U2 - 10.1016/j.cviu.2009.03.013

DO - 10.1016/j.cviu.2009.03.013

M3 - Article

VL - 113

SP - 921

EP - 933

JO - Computer Vision and Image Understanding

JF - Computer Vision and Image Understanding

SN - 1077-3142

IS - 8

ER -