Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan

Ammar Safwan Bin Mustafa, Takashi Ishii, Yoshiki Matsunaga, Ryu Nakadate, Hiroyuki Ishii, Kouji Ogawa, Akiko Saito, Motoaki Sugawara, Kiyomi Niki, Atsuo Takanishi

研究成果: 著書/レポートタイプへの貢献会議での発言

1 引用 (Scopus)

抄録

Physicians use ultrasound scans to obtain real-time images of internal organs, because such scans are safe and inexpensive. However, people in remote areas face difficulties to be scanned due to aging society and physician's shortage. Hence, it is important to develop an autonomous robotic system to perform remote ultrasound scans. Previously, we developed a robotic system for automatic ultrasound scan focusing on human's liver. In order to make it a completely autonomous system, we present in this paper a way to autonomously localize the epigastric region as the starting position for the automatic ultrasound scan. An image processing algorithm marks the umbilicus and mammary papillae on a digital photograph of the patient's abdomen. Then, we made estimation for the location of the epigastric region using the distances between these landmarks. A supporting algorithm distinguishes rib position from epigastrium using the relationship between force and displacement. We implemented these algorithms with the automatic scanning system into an apparatus: a Mitsubishi Electric's MELFA RV-1 six axis manipulator. Tests on 14 healthy male subjects showed the apparatus located the epigastric region with a success rate of 94%. The results suggest that image recognition was effective in localizing a human body part.

元の言語英語
ホスト出版物のタイトル2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013
ページ4855-4858
ページ数4
DOI
出版物ステータス出版済み - 10 31 2013
イベント2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013 - Osaka, 日本
継続期間: 7 3 20137 7 2013

出版物シリーズ

名前Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN(印刷物)1557-170X

その他

その他2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013
日本
Osaka
期間7/3/137/7/13

Fingerprint

Abdomen
Ultrasonics
Cameras
Robotics
Robots
Human Body
Sensors
Physicians
Umbilicus
Ribs
Image recognition
Healthy Volunteers
Breast
Liver
Manipulators
Image processing
Aging of materials
Scanning

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

これを引用

Mustafa, A. S. B., Ishii, T., Matsunaga, Y., Nakadate, R., Ishii, H., Ogawa, K., ... Takanishi, A. (2013). Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan. : 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013 (pp. 4855-4858). [6610635] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). https://doi.org/10.1109/EMBC.2013.6610635

Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan. / Mustafa, Ammar Safwan Bin; Ishii, Takashi; Matsunaga, Yoshiki; Nakadate, Ryu; Ishii, Hiroyuki; Ogawa, Kouji; Saito, Akiko; Sugawara, Motoaki; Niki, Kiyomi; Takanishi, Atsuo.

2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013. 2013. p. 4855-4858 6610635 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).

研究成果: 著書/レポートタイプへの貢献会議での発言

Mustafa, ASB, Ishii, T, Matsunaga, Y, Nakadate, R, Ishii, H, Ogawa, K, Saito, A, Sugawara, M, Niki, K & Takanishi, A 2013, Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan. : 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013., 6610635, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 4855-4858, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013, Osaka, 日本, 7/3/13. https://doi.org/10.1109/EMBC.2013.6610635
Mustafa ASB, Ishii T, Matsunaga Y, Nakadate R, Ishii H, Ogawa K その他. Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan. : 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013. 2013. p. 4855-4858. 6610635. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). https://doi.org/10.1109/EMBC.2013.6610635
Mustafa, Ammar Safwan Bin ; Ishii, Takashi ; Matsunaga, Yoshiki ; Nakadate, Ryu ; Ishii, Hiroyuki ; Ogawa, Kouji ; Saito, Akiko ; Sugawara, Motoaki ; Niki, Kiyomi ; Takanishi, Atsuo. / Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan. 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013. 2013. pp. 4855-4858 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).
@inproceedings{c6eb1a9e8da44af88aae4e01fc2e08c8,
title = "Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan",
abstract = "Physicians use ultrasound scans to obtain real-time images of internal organs, because such scans are safe and inexpensive. However, people in remote areas face difficulties to be scanned due to aging society and physician's shortage. Hence, it is important to develop an autonomous robotic system to perform remote ultrasound scans. Previously, we developed a robotic system for automatic ultrasound scan focusing on human's liver. In order to make it a completely autonomous system, we present in this paper a way to autonomously localize the epigastric region as the starting position for the automatic ultrasound scan. An image processing algorithm marks the umbilicus and mammary papillae on a digital photograph of the patient's abdomen. Then, we made estimation for the location of the epigastric region using the distances between these landmarks. A supporting algorithm distinguishes rib position from epigastrium using the relationship between force and displacement. We implemented these algorithms with the automatic scanning system into an apparatus: a Mitsubishi Electric's MELFA RV-1 six axis manipulator. Tests on 14 healthy male subjects showed the apparatus located the epigastric region with a success rate of 94{\%}. The results suggest that image recognition was effective in localizing a human body part.",
author = "Mustafa, {Ammar Safwan Bin} and Takashi Ishii and Yoshiki Matsunaga and Ryu Nakadate and Hiroyuki Ishii and Kouji Ogawa and Akiko Saito and Motoaki Sugawara and Kiyomi Niki and Atsuo Takanishi",
year = "2013",
month = "10",
day = "31",
doi = "10.1109/EMBC.2013.6610635",
language = "English",
isbn = "9781457702167",
series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
pages = "4855--4858",
booktitle = "2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013",

}

TY - GEN

T1 - Human abdomen recognition using camera and force sensor in medical robot system for automatic ultrasound scan

AU - Mustafa, Ammar Safwan Bin

AU - Ishii, Takashi

AU - Matsunaga, Yoshiki

AU - Nakadate, Ryu

AU - Ishii, Hiroyuki

AU - Ogawa, Kouji

AU - Saito, Akiko

AU - Sugawara, Motoaki

AU - Niki, Kiyomi

AU - Takanishi, Atsuo

PY - 2013/10/31

Y1 - 2013/10/31

N2 - Physicians use ultrasound scans to obtain real-time images of internal organs, because such scans are safe and inexpensive. However, people in remote areas face difficulties to be scanned due to aging society and physician's shortage. Hence, it is important to develop an autonomous robotic system to perform remote ultrasound scans. Previously, we developed a robotic system for automatic ultrasound scan focusing on human's liver. In order to make it a completely autonomous system, we present in this paper a way to autonomously localize the epigastric region as the starting position for the automatic ultrasound scan. An image processing algorithm marks the umbilicus and mammary papillae on a digital photograph of the patient's abdomen. Then, we made estimation for the location of the epigastric region using the distances between these landmarks. A supporting algorithm distinguishes rib position from epigastrium using the relationship between force and displacement. We implemented these algorithms with the automatic scanning system into an apparatus: a Mitsubishi Electric's MELFA RV-1 six axis manipulator. Tests on 14 healthy male subjects showed the apparatus located the epigastric region with a success rate of 94%. The results suggest that image recognition was effective in localizing a human body part.

AB - Physicians use ultrasound scans to obtain real-time images of internal organs, because such scans are safe and inexpensive. However, people in remote areas face difficulties to be scanned due to aging society and physician's shortage. Hence, it is important to develop an autonomous robotic system to perform remote ultrasound scans. Previously, we developed a robotic system for automatic ultrasound scan focusing on human's liver. In order to make it a completely autonomous system, we present in this paper a way to autonomously localize the epigastric region as the starting position for the automatic ultrasound scan. An image processing algorithm marks the umbilicus and mammary papillae on a digital photograph of the patient's abdomen. Then, we made estimation for the location of the epigastric region using the distances between these landmarks. A supporting algorithm distinguishes rib position from epigastrium using the relationship between force and displacement. We implemented these algorithms with the automatic scanning system into an apparatus: a Mitsubishi Electric's MELFA RV-1 six axis manipulator. Tests on 14 healthy male subjects showed the apparatus located the epigastric region with a success rate of 94%. The results suggest that image recognition was effective in localizing a human body part.

UR - http://www.scopus.com/inward/record.url?scp=84886555198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886555198&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2013.6610635

DO - 10.1109/EMBC.2013.6610635

M3 - Conference contribution

AN - SCOPUS:84886555198

SN - 9781457702167

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 4855

EP - 4858

BT - 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013

ER -