Design of a vision-based human-machine interface device for remote control applications

Mansour Karkoub, M. G. Her, C. C. Huang, Y. W. Kuo

Research output: Contribution to journalArticle

Abstract

In this study, a computerized vision system is successfully developed to control the orientation of a camera via two DC motors. This vision-based human-machine interface device is able to move in the same direction as the operator head. The backbone of this device is a sophisticated image-processing technique used to locate skin colour and separate the face from the complex background. Subsequently, the centre of the face is determined as well as the direction of sight. The motion of the servo motors controlling the orientation of the remote camera is controlled by the judged viewing angle and head position. Therefore, controlling the motor rotation is achieved through distant remote control made possible by the human-machine interface and wireless internet connection. A video of the experimental setup can be found at: http://www.youtube.com/watch?v=ZPrDWrzNJNQ.

Original languageEnglish
Pages (from-to)2265-2276
Number of pages12
JournalProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science
Volume225
Issue number9
DOIs
Publication statusPublished - Sep 2011

Fingerprint

Remote control
Cameras
DC motors
Watches
Interfaces (computer)
Skin
Image processing
Internet
Color

Keywords

  • CAM shift
  • Human-machine interface
  • Image processing
  • Mean shift

ASJC Scopus subject areas

  • Mechanical Engineering

Cite this

@article{e5d4c33612f64203b0add9cdb4afaafa,
title = "Design of a vision-based human-machine interface device for remote control applications",
abstract = "In this study, a computerized vision system is successfully developed to control the orientation of a camera via two DC motors. This vision-based human-machine interface device is able to move in the same direction as the operator head. The backbone of this device is a sophisticated image-processing technique used to locate skin colour and separate the face from the complex background. Subsequently, the centre of the face is determined as well as the direction of sight. The motion of the servo motors controlling the orientation of the remote camera is controlled by the judged viewing angle and head position. Therefore, controlling the motor rotation is achieved through distant remote control made possible by the human-machine interface and wireless internet connection. A video of the experimental setup can be found at: http://www.youtube.com/watch?v=ZPrDWrzNJNQ.",
keywords = "CAM shift, Human-machine interface, Image processing, Mean shift",
author = "Mansour Karkoub and Her, {M. G.} and Huang, {C. C.} and Kuo, {Y. W.}",
year = "2011",
month = "9",
doi = "10.1177/0954406211406332",
language = "English",
volume = "225",
pages = "2265--2276",
journal = "Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science",
issn = "0954-4062",
publisher = "SAGE Publications Ltd",
number = "9",

}

TY - JOUR

T1 - Design of a vision-based human-machine interface device for remote control applications

AU - Karkoub, Mansour

AU - Her, M. G.

AU - Huang, C. C.

AU - Kuo, Y. W.

PY - 2011/9

Y1 - 2011/9

N2 - In this study, a computerized vision system is successfully developed to control the orientation of a camera via two DC motors. This vision-based human-machine interface device is able to move in the same direction as the operator head. The backbone of this device is a sophisticated image-processing technique used to locate skin colour and separate the face from the complex background. Subsequently, the centre of the face is determined as well as the direction of sight. The motion of the servo motors controlling the orientation of the remote camera is controlled by the judged viewing angle and head position. Therefore, controlling the motor rotation is achieved through distant remote control made possible by the human-machine interface and wireless internet connection. A video of the experimental setup can be found at: http://www.youtube.com/watch?v=ZPrDWrzNJNQ.

AB - In this study, a computerized vision system is successfully developed to control the orientation of a camera via two DC motors. This vision-based human-machine interface device is able to move in the same direction as the operator head. The backbone of this device is a sophisticated image-processing technique used to locate skin colour and separate the face from the complex background. Subsequently, the centre of the face is determined as well as the direction of sight. The motion of the servo motors controlling the orientation of the remote camera is controlled by the judged viewing angle and head position. Therefore, controlling the motor rotation is achieved through distant remote control made possible by the human-machine interface and wireless internet connection. A video of the experimental setup can be found at: http://www.youtube.com/watch?v=ZPrDWrzNJNQ.

KW - CAM shift

KW - Human-machine interface

KW - Image processing

KW - Mean shift

UR - http://www.scopus.com/inward/record.url?scp=80052814468&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052814468&partnerID=8YFLogxK

U2 - 10.1177/0954406211406332

DO - 10.1177/0954406211406332

M3 - Article

AN - SCOPUS:80052814468

VL - 225

SP - 2265

EP - 2276

JO - Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

JF - Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

SN - 0954-4062

IS - 9

ER -