Recognition of doctors' cursive handwritten medical words by using bidirectional LSTM and SRP data augmentation

Shaira Tabassum, Ryo Takahashi, Md Mahmudur Rahman, Yosuke Imamura, Luo Sixian, Md Moshiur Rahman, Ashir Ahmed

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Inability to read doctors' handwritten prescriptions causes 7, 000 deaths a year in a developed country like the US. The situation should be worse in developing countries where more doctors use handwriting prescriptions. In Bangladesh, the writings become more indecipherable as they contain both English and Bangla words with Latin abbreviations of medical terms. As a result, patients and pharmacists find them difficult to read and the pharmacists provide wrong medicines. In order to ease the difficulty of reading doctors' prescriptions, this paper proposes an online handwritten recognition system to predict the doctors' handwriting and develop a digital prescription. To build this system, the 'Handwritten Medical Term Corpus' dataset is introduced which contains 17, 431 data samples of 480 words (360 English and 120 Bangla) from 39 Bangladeshi doctors and medical professionals. A bigger sample size can improve the recognition efficiency. A new data augmentation technique SRP (Stroke Rotation and Parallel shift) method is proposed to widen the variety of handwriting styles and increase the sample size. A sequence of line data is extracted from the augmented image dataset of 1, 591, 100 samples which is fed to a Bidirectional LSTM model. The proposed method has achieved 89.5% accuracy which is 16.1% higher than the recognition accuracy with no data expansion. This technology can reduce medical errors and save medical cost and ensure healthy living.

Original languageEnglish
Title of host publication2021 IEEE Technology and Engineering Management Conference - Europe, TEMSCON-EUR 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665440912
DOIs
Publication statusPublished - May 17 2021
Event2021 IEEE Technology and Engineering Management Conference - Europe, TEMSCON-EUR 2021 - Virtual, Online, Croatia
Duration: May 17 2021May 20 2021

Publication series

Name2021 IEEE Technology and Engineering Management Conference - Europe, TEMSCON-EUR 2021

Conference

Conference2021 IEEE Technology and Engineering Management Conference - Europe, TEMSCON-EUR 2021
Country/TerritoryCroatia
CityVirtual, Online
Period5/17/215/20/21

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Strategy and Management
  • Engineering (miscellaneous)
  • Civil and Structural Engineering
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Recognition of doctors' cursive handwritten medical words by using bidirectional LSTM and SRP data augmentation'. Together they form a unique fingerprint.

Cite this