Design of a vision-based human-machine interface device for remote control applications

Mansour Karkoub, M. G. Her, C. C. Huang, Y. W. Kuo

Research output: Contribution to journalArticle


In this study, a computerized vision system is successfully developed to control the orientation of a camera via two DC motors. This vision-based human-machine interface device is able to move in the same direction as the operator head. The backbone of this device is a sophisticated image-processing technique used to locate skin colour and separate the face from the complex background. Subsequently, the centre of the face is determined as well as the direction of sight. The motion of the servo motors controlling the orientation of the remote camera is controlled by the judged viewing angle and head position. Therefore, controlling the motor rotation is achieved through distant remote control made possible by the human-machine interface and wireless internet connection. A video of the experimental setup can be found at:

Original languageEnglish
Pages (from-to)2265-2276
Number of pages12
JournalProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science
Issue number9
Publication statusPublished - Sep 2011



  • CAM shift
  • Human-machine interface
  • Image processing
  • Mean shift

ASJC Scopus subject areas

  • Mechanical Engineering

Cite this