Detecting Mathematical Expressions in Scientific Document Images Using a U-Net Trained on a Diverse Dataset

Wataru Ohyama, Masakazu Suzuki, Seiichi Uchida

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

A detection method for mathematical expressions in scientific document images is proposed. Inspired by the promising performance of U-Net, a convolutional network architecture originally proposed for the semantic segmentation of biomedical images, the proposed method uses image conversion by a U-Net framework. The proposed method does not use any information from mathematical and linguistic grammar so that it can be a supplemental bypass in the conventional mathematical optical character recognition (OCR) process pipeline. The evaluation experiments confirmed that (1) the performance of mathematical symbol and expression detection by the proposed method is superior to that of InftyReader, which is state-of-the-art software for mathematical OCR; (2) the coverage of the training dataset to the variation of document style is important; and (3) retraining with small additional training samples will be effective to improve the performance. An additional contribution is the release of a dataset for benchmarking the OCR for scientific documents.

Original languageEnglish
Article number8861044
Pages (from-to)144030-144042
Number of pages13
JournalIEEE Access
Volume7
DOIs
Publication statusPublished - 2019

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of 'Detecting Mathematical Expressions in Scientific Document Images Using a U-Net Trained on a Diverse Dataset'. Together they form a unique fingerprint.

Cite this