Construction of multimodal 3D model of pancreatic cancer tumor

Yushi Goto, Mauricio Kugler, Tatsuya Yokota, Chika Iwamoto, Kenoki Ouchida, Makoto Hashizume, Hidekata Hontani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Histopathological imaging and Magnetic Resonance (MR) are two equally important yet very distinct modalities of medical imaging. The high resolution of the first and the non-invasiveness of the later provide complementary information for medical diagnosis and research. Due to their largely different resolutions, the registration between 3D images of these two modalities is challenging. The objective of this paper is to create a multimodal 3D model of pancreatic cancer tumor by performing the registration of a reconstructed 3D pathological image and an MR image from a KPC mouse. The tumor portions were manually segmented and the 3D pathological image was reconstructed using landmark-based non-linear registration. The process starts by registering the outline of the images using the LDDMM non-linear registration method to match the binary labels of the tumor regions. Next, a non-linear B-spline deformation method based on mutual information maximization is used to register the internal structures of the images. Experimental results show that the overall shape of the tumor and its internal necrosis portion could be correctly registered, although the quality of the manual segmentations affects the accuracy of the registration.

Original languageEnglish
Title of host publicationInternational Forum on Medical Imaging in Asia 2019
EditorsFeng Lin, Jong Hyo Kim, Hiroshi Fujita
PublisherSPIE
ISBN (Electronic)9781510627758
DOIs
Publication statusPublished - Jan 1 2019
EventInternational Forum on Medical Imaging in Asia 2019 - Singapore, Singapore
Duration: Jan 7 2019Jan 9 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11050
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceInternational Forum on Medical Imaging in Asia 2019
CountrySingapore
CitySingapore
Period1/7/191/9/19

Fingerprint

3D Model
Registration
Tumors
Tumor
Cancer
tumors
cancer
3D Image
Magnetic resonance
Modality
magnetic resonance
Medical imaging
Internal
Necrosis
Magnetic Resonance Image
Splines
Magnetic Resonance
Medical Imaging
Labels
Landmarks

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Goto, Y., Kugler, M., Yokota, T., Iwamoto, C., Ouchida, K., Hashizume, M., & Hontani, H. (2019). Construction of multimodal 3D model of pancreatic cancer tumor. In F. Lin, J. H. Kim, & H. Fujita (Eds.), International Forum on Medical Imaging in Asia 2019 [110501H] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11050). SPIE. https://doi.org/10.1117/12.2521394

Construction of multimodal 3D model of pancreatic cancer tumor. / Goto, Yushi; Kugler, Mauricio; Yokota, Tatsuya; Iwamoto, Chika; Ouchida, Kenoki; Hashizume, Makoto; Hontani, Hidekata.

International Forum on Medical Imaging in Asia 2019. ed. / Feng Lin; Jong Hyo Kim; Hiroshi Fujita. SPIE, 2019. 110501H (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11050).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Goto, Y, Kugler, M, Yokota, T, Iwamoto, C, Ouchida, K, Hashizume, M & Hontani, H 2019, Construction of multimodal 3D model of pancreatic cancer tumor. in F Lin, JH Kim & H Fujita (eds), International Forum on Medical Imaging in Asia 2019., 110501H, Proceedings of SPIE - The International Society for Optical Engineering, vol. 11050, SPIE, International Forum on Medical Imaging in Asia 2019, Singapore, Singapore, 1/7/19. https://doi.org/10.1117/12.2521394
Goto Y, Kugler M, Yokota T, Iwamoto C, Ouchida K, Hashizume M et al. Construction of multimodal 3D model of pancreatic cancer tumor. In Lin F, Kim JH, Fujita H, editors, International Forum on Medical Imaging in Asia 2019. SPIE. 2019. 110501H. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2521394
Goto, Yushi ; Kugler, Mauricio ; Yokota, Tatsuya ; Iwamoto, Chika ; Ouchida, Kenoki ; Hashizume, Makoto ; Hontani, Hidekata. / Construction of multimodal 3D model of pancreatic cancer tumor. International Forum on Medical Imaging in Asia 2019. editor / Feng Lin ; Jong Hyo Kim ; Hiroshi Fujita. SPIE, 2019. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{d69e5e354eab4f6b902b6e48e91b5470,
title = "Construction of multimodal 3D model of pancreatic cancer tumor",
abstract = "Histopathological imaging and Magnetic Resonance (MR) are two equally important yet very distinct modalities of medical imaging. The high resolution of the first and the non-invasiveness of the later provide complementary information for medical diagnosis and research. Due to their largely different resolutions, the registration between 3D images of these two modalities is challenging. The objective of this paper is to create a multimodal 3D model of pancreatic cancer tumor by performing the registration of a reconstructed 3D pathological image and an MR image from a KPC mouse. The tumor portions were manually segmented and the 3D pathological image was reconstructed using landmark-based non-linear registration. The process starts by registering the outline of the images using the LDDMM non-linear registration method to match the binary labels of the tumor regions. Next, a non-linear B-spline deformation method based on mutual information maximization is used to register the internal structures of the images. Experimental results show that the overall shape of the tumor and its internal necrosis portion could be correctly registered, although the quality of the manual segmentations affects the accuracy of the registration.",
author = "Yushi Goto and Mauricio Kugler and Tatsuya Yokota and Chika Iwamoto and Kenoki Ouchida and Makoto Hashizume and Hidekata Hontani",
year = "2019",
month = "1",
day = "1",
doi = "10.1117/12.2521394",
language = "English",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Feng Lin and Kim, {Jong Hyo} and Hiroshi Fujita",
booktitle = "International Forum on Medical Imaging in Asia 2019",
address = "United States",

}

TY - GEN

T1 - Construction of multimodal 3D model of pancreatic cancer tumor

AU - Goto, Yushi

AU - Kugler, Mauricio

AU - Yokota, Tatsuya

AU - Iwamoto, Chika

AU - Ouchida, Kenoki

AU - Hashizume, Makoto

AU - Hontani, Hidekata

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Histopathological imaging and Magnetic Resonance (MR) are two equally important yet very distinct modalities of medical imaging. The high resolution of the first and the non-invasiveness of the later provide complementary information for medical diagnosis and research. Due to their largely different resolutions, the registration between 3D images of these two modalities is challenging. The objective of this paper is to create a multimodal 3D model of pancreatic cancer tumor by performing the registration of a reconstructed 3D pathological image and an MR image from a KPC mouse. The tumor portions were manually segmented and the 3D pathological image was reconstructed using landmark-based non-linear registration. The process starts by registering the outline of the images using the LDDMM non-linear registration method to match the binary labels of the tumor regions. Next, a non-linear B-spline deformation method based on mutual information maximization is used to register the internal structures of the images. Experimental results show that the overall shape of the tumor and its internal necrosis portion could be correctly registered, although the quality of the manual segmentations affects the accuracy of the registration.

AB - Histopathological imaging and Magnetic Resonance (MR) are two equally important yet very distinct modalities of medical imaging. The high resolution of the first and the non-invasiveness of the later provide complementary information for medical diagnosis and research. Due to their largely different resolutions, the registration between 3D images of these two modalities is challenging. The objective of this paper is to create a multimodal 3D model of pancreatic cancer tumor by performing the registration of a reconstructed 3D pathological image and an MR image from a KPC mouse. The tumor portions were manually segmented and the 3D pathological image was reconstructed using landmark-based non-linear registration. The process starts by registering the outline of the images using the LDDMM non-linear registration method to match the binary labels of the tumor regions. Next, a non-linear B-spline deformation method based on mutual information maximization is used to register the internal structures of the images. Experimental results show that the overall shape of the tumor and its internal necrosis portion could be correctly registered, although the quality of the manual segmentations affects the accuracy of the registration.

UR - http://www.scopus.com/inward/record.url?scp=85063879790&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063879790&partnerID=8YFLogxK

U2 - 10.1117/12.2521394

DO - 10.1117/12.2521394

M3 - Conference contribution

AN - SCOPUS:85063879790

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - International Forum on Medical Imaging in Asia 2019

A2 - Lin, Feng

A2 - Kim, Jong Hyo

A2 - Fujita, Hiroshi

PB - SPIE

ER -