Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image

Tomoshige Shimomura, Kugler Mauricio, Tatsuya Yokota, Chika Iwamoto, Kenoki Ouchida, Makoto Hashizume, Hidekata Hontani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this paper, we propose a method for constructing a multi-scale model of pancreas tumor of a KrasLSL.G12D/+; p53R172H/+; PdxCretg/+ (KPC) mouse that is a genetically engineered mouse model of pancreas tumor. The model represents the correlation between the value at each voxel in the MRI image of the tumor and the pathology image patches that are observed at each portion corresponds to the location of the voxel in the MRI image. The model is represented by a cascade of image generators trained by a Laplacian Pyramid of Generative Adversarial Network (LAPGAN). When some voxel in a pancreas tumor region in an MRI image is selected, the cascade of generators outputs patches of the pathology images that can be observed at the location corresponds to the selected voxel. We trained the generators by using an MRI image and a 3D pathology image, the latter was first reconstructed from a spatial series of the 2D pathology images and was then registered to the MRI image.

Original languageEnglish
Title of host publicationComputational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings
EditorsZeike Taylor, Hrvoje Bogunovic, David Snead, Mona K. Garvin, Xin Jan Chen, Francesco Ciompi, Yanwu Xu, Lena Maier-Hein, Mitko Veta, Emanuele Trucco, Danail Stoyanov, Nasir Rajpoot, Jeroen van der Laak, Anne Martel, Stephen McKenna
PublisherSpringer Verlag
Pages27-34
Number of pages8
ISBN (Print)9783030009489
DOIs
Publication statusPublished - Jan 1 2018
Event1st International Workshop on Computational Pathology, COMPAY 2018 and 5th International Workshop on Ophthalmic Medical Image Analysis, OMIA 2018 Held in Conjunction with MICCAI 2018 - Granada, Spain
Duration: Sep 16 2018Sep 20 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11039 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st International Workshop on Computational Pathology, COMPAY 2018 and 5th International Workshop on Ophthalmic Medical Image Analysis, OMIA 2018 Held in Conjunction with MICCAI 2018
CountrySpain
CityGranada
Period9/16/189/20/18

Fingerprint

Generative Models
Voxel
Pathology
Magnetic resonance imaging
Tumors
Tumor
Generator
Cascade
Patch
Mouse
Multiscale Model
Pyramid
3D Image
Model
Series
Output

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Shimomura, T., Mauricio, K., Yokota, T., Iwamoto, C., Ouchida, K., Hashizume, M., & Hontani, H. (2018). Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image. In Z. Taylor, H. Bogunovic, D. Snead, M. K. Garvin, X. J. Chen, F. Ciompi, Y. Xu, L. Maier-Hein, M. Veta, E. Trucco, D. Stoyanov, N. Rajpoot, J. van der Laak, A. Martel, ... S. McKenna (Eds.), Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings (pp. 27-34). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11039 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-00949-6_4

Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image. / Shimomura, Tomoshige; Mauricio, Kugler; Yokota, Tatsuya; Iwamoto, Chika; Ouchida, Kenoki; Hashizume, Makoto; Hontani, Hidekata.

Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings. ed. / Zeike Taylor; Hrvoje Bogunovic; David Snead; Mona K. Garvin; Xin Jan Chen; Francesco Ciompi; Yanwu Xu; Lena Maier-Hein; Mitko Veta; Emanuele Trucco; Danail Stoyanov; Nasir Rajpoot; Jeroen van der Laak; Anne Martel; Stephen McKenna. Springer Verlag, 2018. p. 27-34 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11039 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shimomura, T, Mauricio, K, Yokota, T, Iwamoto, C, Ouchida, K, Hashizume, M & Hontani, H 2018, Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image. in Z Taylor, H Bogunovic, D Snead, MK Garvin, XJ Chen, F Ciompi, Y Xu, L Maier-Hein, M Veta, E Trucco, D Stoyanov, N Rajpoot, J van der Laak, A Martel & S McKenna (eds), Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11039 LNCS, Springer Verlag, pp. 27-34, 1st International Workshop on Computational Pathology, COMPAY 2018 and 5th International Workshop on Ophthalmic Medical Image Analysis, OMIA 2018 Held in Conjunction with MICCAI 2018, Granada, Spain, 9/16/18. https://doi.org/10.1007/978-3-030-00949-6_4
Shimomura T, Mauricio K, Yokota T, Iwamoto C, Ouchida K, Hashizume M et al. Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image. In Taylor Z, Bogunovic H, Snead D, Garvin MK, Chen XJ, Ciompi F, Xu Y, Maier-Hein L, Veta M, Trucco E, Stoyanov D, Rajpoot N, van der Laak J, Martel A, McKenna S, editors, Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings. Springer Verlag. 2018. p. 27-34. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-00949-6_4
Shimomura, Tomoshige ; Mauricio, Kugler ; Yokota, Tatsuya ; Iwamoto, Chika ; Ouchida, Kenoki ; Hashizume, Makoto ; Hontani, Hidekata. / Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image. Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings. editor / Zeike Taylor ; Hrvoje Bogunovic ; David Snead ; Mona K. Garvin ; Xin Jan Chen ; Francesco Ciompi ; Yanwu Xu ; Lena Maier-Hein ; Mitko Veta ; Emanuele Trucco ; Danail Stoyanov ; Nasir Rajpoot ; Jeroen van der Laak ; Anne Martel ; Stephen McKenna. Springer Verlag, 2018. pp. 27-34 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{b5bddc3070fe4b179cf6cc183e231619,
title = "Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image",
abstract = "In this paper, we propose a method for constructing a multi-scale model of pancreas tumor of a KrasLSL.G12D/+; p53R172H/+; PdxCretg/+ (KPC) mouse that is a genetically engineered mouse model of pancreas tumor. The model represents the correlation between the value at each voxel in the MRI image of the tumor and the pathology image patches that are observed at each portion corresponds to the location of the voxel in the MRI image. The model is represented by a cascade of image generators trained by a Laplacian Pyramid of Generative Adversarial Network (LAPGAN). When some voxel in a pancreas tumor region in an MRI image is selected, the cascade of generators outputs patches of the pathology images that can be observed at the location corresponds to the selected voxel. We trained the generators by using an MRI image and a 3D pathology image, the latter was first reconstructed from a spatial series of the 2D pathology images and was then registered to the MRI image.",
author = "Tomoshige Shimomura and Kugler Mauricio and Tatsuya Yokota and Chika Iwamoto and Kenoki Ouchida and Makoto Hashizume and Hidekata Hontani",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-00949-6_4",
language = "English",
isbn = "9783030009489",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "27--34",
editor = "Zeike Taylor and Hrvoje Bogunovic and David Snead and Garvin, {Mona K.} and Chen, {Xin Jan} and Francesco Ciompi and Yanwu Xu and Lena Maier-Hein and Mitko Veta and Emanuele Trucco and Danail Stoyanov and Nasir Rajpoot and {van der Laak}, Jeroen and Anne Martel and Stephen McKenna",
booktitle = "Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Construction of a Generative Model of H&E Stained Pathology Images of Pancreas Tumors Conditioned by a Voxel Value of MRI Image

AU - Shimomura, Tomoshige

AU - Mauricio, Kugler

AU - Yokota, Tatsuya

AU - Iwamoto, Chika

AU - Ouchida, Kenoki

AU - Hashizume, Makoto

AU - Hontani, Hidekata

PY - 2018/1/1

Y1 - 2018/1/1

N2 - In this paper, we propose a method for constructing a multi-scale model of pancreas tumor of a KrasLSL.G12D/+; p53R172H/+; PdxCretg/+ (KPC) mouse that is a genetically engineered mouse model of pancreas tumor. The model represents the correlation between the value at each voxel in the MRI image of the tumor and the pathology image patches that are observed at each portion corresponds to the location of the voxel in the MRI image. The model is represented by a cascade of image generators trained by a Laplacian Pyramid of Generative Adversarial Network (LAPGAN). When some voxel in a pancreas tumor region in an MRI image is selected, the cascade of generators outputs patches of the pathology images that can be observed at the location corresponds to the selected voxel. We trained the generators by using an MRI image and a 3D pathology image, the latter was first reconstructed from a spatial series of the 2D pathology images and was then registered to the MRI image.

AB - In this paper, we propose a method for constructing a multi-scale model of pancreas tumor of a KrasLSL.G12D/+; p53R172H/+; PdxCretg/+ (KPC) mouse that is a genetically engineered mouse model of pancreas tumor. The model represents the correlation between the value at each voxel in the MRI image of the tumor and the pathology image patches that are observed at each portion corresponds to the location of the voxel in the MRI image. The model is represented by a cascade of image generators trained by a Laplacian Pyramid of Generative Adversarial Network (LAPGAN). When some voxel in a pancreas tumor region in an MRI image is selected, the cascade of generators outputs patches of the pathology images that can be observed at the location corresponds to the selected voxel. We trained the generators by using an MRI image and a 3D pathology image, the latter was first reconstructed from a spatial series of the 2D pathology images and was then registered to the MRI image.

UR - http://www.scopus.com/inward/record.url?scp=85053888252&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053888252&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-00949-6_4

DO - 10.1007/978-3-030-00949-6_4

M3 - Conference contribution

SN - 9783030009489

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 27

EP - 34

BT - Computational Pathology and Ophthalmic Medical Image Analysis - First International Workshop, COMPAY 2018, and 5th International Workshop, OMIA 2018, Held in Conjunction with MICCAI 2018, Proceedings

A2 - Taylor, Zeike

A2 - Bogunovic, Hrvoje

A2 - Snead, David

A2 - Garvin, Mona K.

A2 - Chen, Xin Jan

A2 - Ciompi, Francesco

A2 - Xu, Yanwu

A2 - Maier-Hein, Lena

A2 - Veta, Mitko

A2 - Trucco, Emanuele

A2 - Stoyanov, Danail

A2 - Rajpoot, Nasir

A2 - van der Laak, Jeroen

A2 - Martel, Anne

A2 - McKenna, Stephen

PB - Springer Verlag

ER -