Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor

Hidekata Hontani, Yushi Goto, Yuki Tamura, Tomoshige Shimomura, Naoki Kawamura, Hirokazu Kobayashi, Mauricio Kugler, Tatsuya Yokota, Chika Iwamoto, Kenoki Ouchida, Makoto Hashizume, Takahiro Katagiri, Tomonari Sei, Akinobu Shimizu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we report on the construction of a pancreatic tumor model that represents the relationship between the tumor growth and the micro anatomical structures. The former, the tumor growth, is described by referring to the temporal series of MRI images of the whole body and the latter, the micro structures of the tumor, is described by a spatial series of microscopic images of thin-sections sliced from the extracted pancreatic tumor. For the model construction, we developed new non-rigid registration methods for (1) accurate description of tumor growth, (2) reconstruction of 3D microscopic images, and (3) registration between an MRI image and corresponding microscopic images. In addition, we constructed a neural network that can generate a set of fake microscopic image patches of a pancreatic tumor that corresponds to each voxel inside the tumor region in an MRI image. The outlines of the methods are introduced and some examples of experimental results are demonstrated.

Original languageEnglish
Title of host publicationInternational Forum on Medical Imaging in Asia 2019
EditorsHiroshi Fujita, Jong Hyo Kim, Feng Lin
PublisherSPIE
ISBN (Electronic)9781510627758
DOIs
Publication statusPublished - Jan 1 2019
EventInternational Forum on Medical Imaging in Asia 2019 - Singapore, Singapore
Duration: Jan 7 2019Jan 9 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11050
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceInternational Forum on Medical Imaging in Asia 2019
CountrySingapore
CitySingapore
Period1/7/191/9/19

Fingerprint

Magnetic resonance imaging
Registration
Tumors
Tumor
Cancer
Coloring Agents
tumors
cancer
Tumor Growth
Non-rigid Registration
Series
Voxel
3D Image
microstructure
Microstructure
Patch
Neural Networks
Experimental Results
Neural networks
Model

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Hontani, H., Goto, Y., Tamura, Y., Shimomura, T., Kawamura, N., Kobayashi, H., ... Shimizu, A. (2019). Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor. In H. Fujita, J. H. Kim, & F. Lin (Eds.), International Forum on Medical Imaging in Asia 2019 [110501F] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11050). SPIE. https://doi.org/10.1117/12.2522052

Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor. / Hontani, Hidekata; Goto, Yushi; Tamura, Yuki; Shimomura, Tomoshige; Kawamura, Naoki; Kobayashi, Hirokazu; Kugler, Mauricio; Yokota, Tatsuya; Iwamoto, Chika; Ouchida, Kenoki; Hashizume, Makoto; Katagiri, Takahiro; Sei, Tomonari; Shimizu, Akinobu.

International Forum on Medical Imaging in Asia 2019. ed. / Hiroshi Fujita; Jong Hyo Kim; Feng Lin. SPIE, 2019. 110501F (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11050).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hontani, H, Goto, Y, Tamura, Y, Shimomura, T, Kawamura, N, Kobayashi, H, Kugler, M, Yokota, T, Iwamoto, C, Ouchida, K, Hashizume, M, Katagiri, T, Sei, T & Shimizu, A 2019, Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor. in H Fujita, JH Kim & F Lin (eds), International Forum on Medical Imaging in Asia 2019., 110501F, Proceedings of SPIE - The International Society for Optical Engineering, vol. 11050, SPIE, International Forum on Medical Imaging in Asia 2019, Singapore, Singapore, 1/7/19. https://doi.org/10.1117/12.2522052
Hontani H, Goto Y, Tamura Y, Shimomura T, Kawamura N, Kobayashi H et al. Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor. In Fujita H, Kim JH, Lin F, editors, International Forum on Medical Imaging in Asia 2019. SPIE. 2019. 110501F. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2522052
Hontani, Hidekata ; Goto, Yushi ; Tamura, Yuki ; Shimomura, Tomoshige ; Kawamura, Naoki ; Kobayashi, Hirokazu ; Kugler, Mauricio ; Yokota, Tatsuya ; Iwamoto, Chika ; Ouchida, Kenoki ; Hashizume, Makoto ; Katagiri, Takahiro ; Sei, Tomonari ; Shimizu, Akinobu. / Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor. International Forum on Medical Imaging in Asia 2019. editor / Hiroshi Fujita ; Jong Hyo Kim ; Feng Lin. SPIE, 2019. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{9c268f7ed95642d8a8f7dcb033ca47f9,
title = "Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor",
abstract = "In this paper, we report on the construction of a pancreatic tumor model that represents the relationship between the tumor growth and the micro anatomical structures. The former, the tumor growth, is described by referring to the temporal series of MRI images of the whole body and the latter, the micro structures of the tumor, is described by a spatial series of microscopic images of thin-sections sliced from the extracted pancreatic tumor. For the model construction, we developed new non-rigid registration methods for (1) accurate description of tumor growth, (2) reconstruction of 3D microscopic images, and (3) registration between an MRI image and corresponding microscopic images. In addition, we constructed a neural network that can generate a set of fake microscopic image patches of a pancreatic tumor that corresponds to each voxel inside the tumor region in an MRI image. The outlines of the methods are introduced and some examples of experimental results are demonstrated.",
author = "Hidekata Hontani and Yushi Goto and Yuki Tamura and Tomoshige Shimomura and Naoki Kawamura and Hirokazu Kobayashi and Mauricio Kugler and Tatsuya Yokota and Chika Iwamoto and Kenoki Ouchida and Makoto Hashizume and Takahiro Katagiri and Tomonari Sei and Akinobu Shimizu",
year = "2019",
month = "1",
day = "1",
doi = "10.1117/12.2522052",
language = "English",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Hiroshi Fujita and Kim, {Jong Hyo} and Feng Lin",
booktitle = "International Forum on Medical Imaging in Asia 2019",
address = "United States",

}

TY - GEN

T1 - Registration between histopathological images with different stains and an MRI Image of pancreatic cancer tumor

AU - Hontani, Hidekata

AU - Goto, Yushi

AU - Tamura, Yuki

AU - Shimomura, Tomoshige

AU - Kawamura, Naoki

AU - Kobayashi, Hirokazu

AU - Kugler, Mauricio

AU - Yokota, Tatsuya

AU - Iwamoto, Chika

AU - Ouchida, Kenoki

AU - Hashizume, Makoto

AU - Katagiri, Takahiro

AU - Sei, Tomonari

AU - Shimizu, Akinobu

PY - 2019/1/1

Y1 - 2019/1/1

N2 - In this paper, we report on the construction of a pancreatic tumor model that represents the relationship between the tumor growth and the micro anatomical structures. The former, the tumor growth, is described by referring to the temporal series of MRI images of the whole body and the latter, the micro structures of the tumor, is described by a spatial series of microscopic images of thin-sections sliced from the extracted pancreatic tumor. For the model construction, we developed new non-rigid registration methods for (1) accurate description of tumor growth, (2) reconstruction of 3D microscopic images, and (3) registration between an MRI image and corresponding microscopic images. In addition, we constructed a neural network that can generate a set of fake microscopic image patches of a pancreatic tumor that corresponds to each voxel inside the tumor region in an MRI image. The outlines of the methods are introduced and some examples of experimental results are demonstrated.

AB - In this paper, we report on the construction of a pancreatic tumor model that represents the relationship between the tumor growth and the micro anatomical structures. The former, the tumor growth, is described by referring to the temporal series of MRI images of the whole body and the latter, the micro structures of the tumor, is described by a spatial series of microscopic images of thin-sections sliced from the extracted pancreatic tumor. For the model construction, we developed new non-rigid registration methods for (1) accurate description of tumor growth, (2) reconstruction of 3D microscopic images, and (3) registration between an MRI image and corresponding microscopic images. In addition, we constructed a neural network that can generate a set of fake microscopic image patches of a pancreatic tumor that corresponds to each voxel inside the tumor region in an MRI image. The outlines of the methods are introduced and some examples of experimental results are demonstrated.

UR - http://www.scopus.com/inward/record.url?scp=85063903925&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063903925&partnerID=8YFLogxK

U2 - 10.1117/12.2522052

DO - 10.1117/12.2522052

M3 - Conference contribution

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - International Forum on Medical Imaging in Asia 2019

A2 - Fujita, Hiroshi

A2 - Kim, Jong Hyo

A2 - Lin, Feng

PB - SPIE

ER -