Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation

Xiaoqian Jia, Sicheng Wang, Xiao Liang, Anjali Balagopal, Dan Nguyen, Ming Yang, Zhangyang Wang, Jim Xiuquan Ji, Xiaoning Qian, Steve Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Cone-beam computed tomography (CBCT) is increasingly used in radiotherapy for patient alignment and adaptive therapy where organ segmentation and target delineation are often required. However, due to the poor image quality, low soft tissue contrast, as well as the difficulty in acquiring segmentation labels on CBCT images, developing effective segmentation methods on CBCT has been a challenge. In this paper, we propose a deep model for segmenting organs in CBCT images without requiring labelled training CBCT images. By taking advantage of the available segmented computed tomography (CT) images, our adversarial learning domain adaptation method aims to synthesize CBCT images from CT images. Then the segmentation labels of the CT images can help train a deep segmentation network for CBCT images, using both CTs with labels and CBCTs without labels. Our adversarial learning domain adaptation is integrated with the CBCT segmentation network training with the designed loss functions. The synthesized CBCT images by pixel-level domain adaptation best capture the critical image features that help achieve accurate CBCT segmentation. Our experiments on the bladder images from Radiation Oncology clinics have shown that our CBCT segmentation with adversarial learning domain adaptation significantly improves segmentation accuracy compared to the existing methods without doing domain adaptation from CT to CBCT.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings
EditorsDinggang Shen, Pew-Thian Yap, Tianming Liu, Terry M. Peters, Ali Khan, Lawrence H. Staib, Caroline Essert, Sean Zhou
PublisherSpringer
Pages567-575
Number of pages9
ISBN (Print)9783030322250
DOIs
Publication statusPublished - 1 Jan 2019
Event22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019 - Shenzhen, China
Duration: 13 Oct 201917 Oct 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11769 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019
CountryChina
CityShenzhen
Period13/10/1917/10/19

Fingerprint

Computed Tomography
Tomography
Cones
Cone
Segmentation
Labels
Learning
Oncology
Radiotherapy
Soft Tissue
Loss Function
Image Quality
Image quality
Therapy

Keywords

  • CBCT segmentation
  • CycleGAN
  • Domain adaptation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Jia, X., Wang, S., Liang, X., Balagopal, A., Nguyen, D., Yang, M., ... Jiang, S. (2019). Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation. In D. Shen, P-T. Yap, T. Liu, T. M. Peters, A. Khan, L. H. Staib, C. Essert, ... S. Zhou (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings (pp. 567-575). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11769 LNCS). Springer. https://doi.org/10.1007/978-3-030-32226-7_63

Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation. / Jia, Xiaoqian; Wang, Sicheng; Liang, Xiao; Balagopal, Anjali; Nguyen, Dan; Yang, Ming; Wang, Zhangyang; Ji, Jim Xiuquan; Qian, Xiaoning; Jiang, Steve.

Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings. ed. / Dinggang Shen; Pew-Thian Yap; Tianming Liu; Terry M. Peters; Ali Khan; Lawrence H. Staib; Caroline Essert; Sean Zhou. Springer, 2019. p. 567-575 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11769 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jia, X, Wang, S, Liang, X, Balagopal, A, Nguyen, D, Yang, M, Wang, Z, Ji, JX, Qian, X & Jiang, S 2019, Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation. in D Shen, P-T Yap, T Liu, TM Peters, A Khan, LH Staib, C Essert & S Zhou (eds), Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11769 LNCS, Springer, pp. 567-575, 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019, Shenzhen, China, 13/10/19. https://doi.org/10.1007/978-3-030-32226-7_63
Jia X, Wang S, Liang X, Balagopal A, Nguyen D, Yang M et al. Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation. In Shen D, Yap P-T, Liu T, Peters TM, Khan A, Staib LH, Essert C, Zhou S, editors, Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings. Springer. 2019. p. 567-575. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-32226-7_63
Jia, Xiaoqian ; Wang, Sicheng ; Liang, Xiao ; Balagopal, Anjali ; Nguyen, Dan ; Yang, Ming ; Wang, Zhangyang ; Ji, Jim Xiuquan ; Qian, Xiaoning ; Jiang, Steve. / Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings. editor / Dinggang Shen ; Pew-Thian Yap ; Tianming Liu ; Terry M. Peters ; Ali Khan ; Lawrence H. Staib ; Caroline Essert ; Sean Zhou. Springer, 2019. pp. 567-575 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{1c225e5106b04dadadab4e537aa5b725,
title = "Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation",
abstract = "Cone-beam computed tomography (CBCT) is increasingly used in radiotherapy for patient alignment and adaptive therapy where organ segmentation and target delineation are often required. However, due to the poor image quality, low soft tissue contrast, as well as the difficulty in acquiring segmentation labels on CBCT images, developing effective segmentation methods on CBCT has been a challenge. In this paper, we propose a deep model for segmenting organs in CBCT images without requiring labelled training CBCT images. By taking advantage of the available segmented computed tomography (CT) images, our adversarial learning domain adaptation method aims to synthesize CBCT images from CT images. Then the segmentation labels of the CT images can help train a deep segmentation network for CBCT images, using both CTs with labels and CBCTs without labels. Our adversarial learning domain adaptation is integrated with the CBCT segmentation network training with the designed loss functions. The synthesized CBCT images by pixel-level domain adaptation best capture the critical image features that help achieve accurate CBCT segmentation. Our experiments on the bladder images from Radiation Oncology clinics have shown that our CBCT segmentation with adversarial learning domain adaptation significantly improves segmentation accuracy compared to the existing methods without doing domain adaptation from CT to CBCT.",
keywords = "CBCT segmentation, CycleGAN, Domain adaptation",
author = "Xiaoqian Jia and Sicheng Wang and Xiao Liang and Anjali Balagopal and Dan Nguyen and Ming Yang and Zhangyang Wang and Ji, {Jim Xiuquan} and Xiaoning Qian and Steve Jiang",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-32226-7_63",
language = "English",
isbn = "9783030322250",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer",
pages = "567--575",
editor = "Dinggang Shen and Pew-Thian Yap and Tianming Liu and Peters, {Terry M.} and Ali Khan and Staib, {Lawrence H.} and Caroline Essert and Sean Zhou",
booktitle = "Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings",

}

TY - GEN

T1 - Cone-Beam Computed Tomography (CBCT) Segmentation by Adversarial Learning Domain Adaptation

AU - Jia, Xiaoqian

AU - Wang, Sicheng

AU - Liang, Xiao

AU - Balagopal, Anjali

AU - Nguyen, Dan

AU - Yang, Ming

AU - Wang, Zhangyang

AU - Ji, Jim Xiuquan

AU - Qian, Xiaoning

AU - Jiang, Steve

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Cone-beam computed tomography (CBCT) is increasingly used in radiotherapy for patient alignment and adaptive therapy where organ segmentation and target delineation are often required. However, due to the poor image quality, low soft tissue contrast, as well as the difficulty in acquiring segmentation labels on CBCT images, developing effective segmentation methods on CBCT has been a challenge. In this paper, we propose a deep model for segmenting organs in CBCT images without requiring labelled training CBCT images. By taking advantage of the available segmented computed tomography (CT) images, our adversarial learning domain adaptation method aims to synthesize CBCT images from CT images. Then the segmentation labels of the CT images can help train a deep segmentation network for CBCT images, using both CTs with labels and CBCTs without labels. Our adversarial learning domain adaptation is integrated with the CBCT segmentation network training with the designed loss functions. The synthesized CBCT images by pixel-level domain adaptation best capture the critical image features that help achieve accurate CBCT segmentation. Our experiments on the bladder images from Radiation Oncology clinics have shown that our CBCT segmentation with adversarial learning domain adaptation significantly improves segmentation accuracy compared to the existing methods without doing domain adaptation from CT to CBCT.

AB - Cone-beam computed tomography (CBCT) is increasingly used in radiotherapy for patient alignment and adaptive therapy where organ segmentation and target delineation are often required. However, due to the poor image quality, low soft tissue contrast, as well as the difficulty in acquiring segmentation labels on CBCT images, developing effective segmentation methods on CBCT has been a challenge. In this paper, we propose a deep model for segmenting organs in CBCT images without requiring labelled training CBCT images. By taking advantage of the available segmented computed tomography (CT) images, our adversarial learning domain adaptation method aims to synthesize CBCT images from CT images. Then the segmentation labels of the CT images can help train a deep segmentation network for CBCT images, using both CTs with labels and CBCTs without labels. Our adversarial learning domain adaptation is integrated with the CBCT segmentation network training with the designed loss functions. The synthesized CBCT images by pixel-level domain adaptation best capture the critical image features that help achieve accurate CBCT segmentation. Our experiments on the bladder images from Radiation Oncology clinics have shown that our CBCT segmentation with adversarial learning domain adaptation significantly improves segmentation accuracy compared to the existing methods without doing domain adaptation from CT to CBCT.

KW - CBCT segmentation

KW - CycleGAN

KW - Domain adaptation

UR - http://www.scopus.com/inward/record.url?scp=85075817720&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075817720&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-32226-7_63

DO - 10.1007/978-3-030-32226-7_63

M3 - Conference contribution

AN - SCOPUS:85075817720

SN - 9783030322250

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 567

EP - 575

BT - Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings

A2 - Shen, Dinggang

A2 - Yap, Pew-Thian

A2 - Liu, Tianming

A2 - Peters, Terry M.

A2 - Khan, Ali

A2 - Staib, Lawrence H.

A2 - Essert, Caroline

A2 - Zhou, Sean

PB - Springer

ER -