Recovery and localization of handwritings by a camera-pen based on tracking and document image retrieval

Megumi Chikano, Koichi Kise, Masakazu Iwamura, Seiichi Uchida, Shinichiro Omachi

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

We propose a camera-based method for digital recovery of handwritings on ordinary paper. Our method is characterized by the following two points: (1) it requires no special device such as special paper other than a camera-pen to recover handwritings, (2) if the handwriting is on a printed document, the method is capable of localizing it onto an electronic equivalent of the printed document. The above points are enabled by the following processing. The handwriting is recovered by the LK tracking to trace the move of the pen-tip. The recovered shape is localized onto the corresponding part of the electronic document with the help of document image retrieval called LLAH (locally likely arrangement hashing). A new framework for stably estimating the homography from a camera-captured image to the corresponding electronic document allows us to localize the recovered handwritings accurately. We experimentally evaluate the accuracy, processing time and memory usage of the proposed method using 30 handwritings. From the comparison to other methods that implement alternative ways for realizing the same functionality, we have confirmed that the proposed method is superior to those other methods.

Original languageEnglish
Pages (from-to)214-224
Number of pages11
JournalPattern Recognition Letters
Volume35
Issue number1
DOIs
Publication statusPublished - Jan 1 2014

Fingerprint

Light pens
Image retrieval
Cameras
Recovery
Processing
Data storage equipment

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this

Recovery and localization of handwritings by a camera-pen based on tracking and document image retrieval. / Chikano, Megumi; Kise, Koichi; Iwamura, Masakazu; Uchida, Seiichi; Omachi, Shinichiro.

In: Pattern Recognition Letters, Vol. 35, No. 1, 01.01.2014, p. 214-224.

Research output: Contribution to journalArticle

Chikano, Megumi ; Kise, Koichi ; Iwamura, Masakazu ; Uchida, Seiichi ; Omachi, Shinichiro. / Recovery and localization of handwritings by a camera-pen based on tracking and document image retrieval. In: Pattern Recognition Letters. 2014 ; Vol. 35, No. 1. pp. 214-224.
@article{4659b03037f04adbaa48aec0c93a8d4a,
title = "Recovery and localization of handwritings by a camera-pen based on tracking and document image retrieval",
abstract = "We propose a camera-based method for digital recovery of handwritings on ordinary paper. Our method is characterized by the following two points: (1) it requires no special device such as special paper other than a camera-pen to recover handwritings, (2) if the handwriting is on a printed document, the method is capable of localizing it onto an electronic equivalent of the printed document. The above points are enabled by the following processing. The handwriting is recovered by the LK tracking to trace the move of the pen-tip. The recovered shape is localized onto the corresponding part of the electronic document with the help of document image retrieval called LLAH (locally likely arrangement hashing). A new framework for stably estimating the homography from a camera-captured image to the corresponding electronic document allows us to localize the recovered handwritings accurately. We experimentally evaluate the accuracy, processing time and memory usage of the proposed method using 30 handwritings. From the comparison to other methods that implement alternative ways for realizing the same functionality, we have confirmed that the proposed method is superior to those other methods.",
author = "Megumi Chikano and Koichi Kise and Masakazu Iwamura and Seiichi Uchida and Shinichiro Omachi",
year = "2014",
month = "1",
day = "1",
doi = "10.1016/j.patrec.2012.10.003",
language = "English",
volume = "35",
pages = "214--224",
journal = "Pattern Recognition Letters",
issn = "0167-8655",
publisher = "Elsevier",
number = "1",

}

TY - JOUR

T1 - Recovery and localization of handwritings by a camera-pen based on tracking and document image retrieval

AU - Chikano, Megumi

AU - Kise, Koichi

AU - Iwamura, Masakazu

AU - Uchida, Seiichi

AU - Omachi, Shinichiro

PY - 2014/1/1

Y1 - 2014/1/1

N2 - We propose a camera-based method for digital recovery of handwritings on ordinary paper. Our method is characterized by the following two points: (1) it requires no special device such as special paper other than a camera-pen to recover handwritings, (2) if the handwriting is on a printed document, the method is capable of localizing it onto an electronic equivalent of the printed document. The above points are enabled by the following processing. The handwriting is recovered by the LK tracking to trace the move of the pen-tip. The recovered shape is localized onto the corresponding part of the electronic document with the help of document image retrieval called LLAH (locally likely arrangement hashing). A new framework for stably estimating the homography from a camera-captured image to the corresponding electronic document allows us to localize the recovered handwritings accurately. We experimentally evaluate the accuracy, processing time and memory usage of the proposed method using 30 handwritings. From the comparison to other methods that implement alternative ways for realizing the same functionality, we have confirmed that the proposed method is superior to those other methods.

AB - We propose a camera-based method for digital recovery of handwritings on ordinary paper. Our method is characterized by the following two points: (1) it requires no special device such as special paper other than a camera-pen to recover handwritings, (2) if the handwriting is on a printed document, the method is capable of localizing it onto an electronic equivalent of the printed document. The above points are enabled by the following processing. The handwriting is recovered by the LK tracking to trace the move of the pen-tip. The recovered shape is localized onto the corresponding part of the electronic document with the help of document image retrieval called LLAH (locally likely arrangement hashing). A new framework for stably estimating the homography from a camera-captured image to the corresponding electronic document allows us to localize the recovered handwritings accurately. We experimentally evaluate the accuracy, processing time and memory usage of the proposed method using 30 handwritings. From the comparison to other methods that implement alternative ways for realizing the same functionality, we have confirmed that the proposed method is superior to those other methods.

UR - http://www.scopus.com/inward/record.url?scp=84887491819&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887491819&partnerID=8YFLogxK

U2 - 10.1016/j.patrec.2012.10.003

DO - 10.1016/j.patrec.2012.10.003

M3 - Article

VL - 35

SP - 214

EP - 224

JO - Pattern Recognition Letters

JF - Pattern Recognition Letters

SN - 0167-8655

IS - 1

ER -