Development of a vision non-contact sensing system for telerobotic applications

Mansour Karkoub, M. G. Her, M. I. Ho, C. C. Huang

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The study presented here describes a novel vision-based motion detection system for telerobotic operations such as distant surgical procedures. The system uses a CCD camera and image processing to detect the motion of a master robot or operator. Colour tags are placed on the arm and head of a human operator to detect the up/down, right/left motion of the head as well as the right/left motion of the arm. The motion of the colour tags are used to actuate a slave robot or a remote system. The determination of the colour tags motion is achieved through image processing using eigenvectors and colour system morphology and the relative head, shoulder and wrist rotation angles through inverse dynamics and coordinate transformation. A program is used to transform this motion data into motor control commands and transmit them to a slave robot or remote system through wireless internet. The system performed well even in complex environments with errors that did not exceed 2 pixels with a response time of about 0.1 s.

Original languageEnglish
Pages (from-to)1438-1449
Number of pages12
JournalInternational Journal of Systems Science
Volume44
Issue number8
DOIs
Publication statusPublished - 1 Aug 2013

Fingerprint

Telerobotics
Non-contact
Sensing
Color
Motion
Robots
Image processing
Robot
Image Processing
CCD cameras
Eigenvalues and eigenfunctions
Motion Detection
Inverse Dynamics
Motor Control
Pixels
Coordinate Transformation
CCD Camera
Internet
Operator
Response Time

Keywords

  • image processing
  • teleoperations
  • visual joystick

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications

Cite this

Development of a vision non-contact sensing system for telerobotic applications. / Karkoub, Mansour; Her, M. G.; Ho, M. I.; Huang, C. C.

In: International Journal of Systems Science, Vol. 44, No. 8, 01.08.2013, p. 1438-1449.

Research output: Contribution to journalArticle

@article{f688b6637d6644df8b03539da7e1e94b,
title = "Development of a vision non-contact sensing system for telerobotic applications",
abstract = "The study presented here describes a novel vision-based motion detection system for telerobotic operations such as distant surgical procedures. The system uses a CCD camera and image processing to detect the motion of a master robot or operator. Colour tags are placed on the arm and head of a human operator to detect the up/down, right/left motion of the head as well as the right/left motion of the arm. The motion of the colour tags are used to actuate a slave robot or a remote system. The determination of the colour tags motion is achieved through image processing using eigenvectors and colour system morphology and the relative head, shoulder and wrist rotation angles through inverse dynamics and coordinate transformation. A program is used to transform this motion data into motor control commands and transmit them to a slave robot or remote system through wireless internet. The system performed well even in complex environments with errors that did not exceed 2 pixels with a response time of about 0.1 s.",
keywords = "image processing, teleoperations, visual joystick",
author = "Mansour Karkoub and Her, {M. G.} and Ho, {M. I.} and Huang, {C. C.}",
year = "2013",
month = "8",
day = "1",
doi = "10.1080/00207721.2012.659688",
language = "English",
volume = "44",
pages = "1438--1449",
journal = "International Journal of Systems Science",
issn = "0020-7721",
publisher = "Taylor and Francis Ltd.",
number = "8",

}

TY - JOUR

T1 - Development of a vision non-contact sensing system for telerobotic applications

AU - Karkoub, Mansour

AU - Her, M. G.

AU - Ho, M. I.

AU - Huang, C. C.

PY - 2013/8/1

Y1 - 2013/8/1

N2 - The study presented here describes a novel vision-based motion detection system for telerobotic operations such as distant surgical procedures. The system uses a CCD camera and image processing to detect the motion of a master robot or operator. Colour tags are placed on the arm and head of a human operator to detect the up/down, right/left motion of the head as well as the right/left motion of the arm. The motion of the colour tags are used to actuate a slave robot or a remote system. The determination of the colour tags motion is achieved through image processing using eigenvectors and colour system morphology and the relative head, shoulder and wrist rotation angles through inverse dynamics and coordinate transformation. A program is used to transform this motion data into motor control commands and transmit them to a slave robot or remote system through wireless internet. The system performed well even in complex environments with errors that did not exceed 2 pixels with a response time of about 0.1 s.

AB - The study presented here describes a novel vision-based motion detection system for telerobotic operations such as distant surgical procedures. The system uses a CCD camera and image processing to detect the motion of a master robot or operator. Colour tags are placed on the arm and head of a human operator to detect the up/down, right/left motion of the head as well as the right/left motion of the arm. The motion of the colour tags are used to actuate a slave robot or a remote system. The determination of the colour tags motion is achieved through image processing using eigenvectors and colour system morphology and the relative head, shoulder and wrist rotation angles through inverse dynamics and coordinate transformation. A program is used to transform this motion data into motor control commands and transmit them to a slave robot or remote system through wireless internet. The system performed well even in complex environments with errors that did not exceed 2 pixels with a response time of about 0.1 s.

KW - image processing

KW - teleoperations

KW - visual joystick

UR - http://www.scopus.com/inward/record.url?scp=84878683982&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878683982&partnerID=8YFLogxK

U2 - 10.1080/00207721.2012.659688

DO - 10.1080/00207721.2012.659688

M3 - Article

AN - SCOPUS:84878683982

VL - 44

SP - 1438

EP - 1449

JO - International Journal of Systems Science

JF - International Journal of Systems Science

SN - 0020-7721

IS - 8

ER -