On bit-parallel processing of multi-byte text

Heikki Hyyrö, Jun Takaba, Ayumi Shinohara, Masayuki Takeda

Research output: Contribution to journalConference article

2 Citations (Scopus)

Abstract

There exist practical bit-parallel algorithms for several types of pair-wise string processing, such as longest common subsequence computation or approximate string matching. The bit-parallel algorithms typically use a size-σ table of match bit-vectors, where the bits in the vector for a character λ identify the positions where the character λ occurs in one of the processed strings, and a is the alphabet size. The time or space cost of computing the match table is not prohibitive with reasonably small alphabets such as ASCII text. However, for example in the case of general Unicode text the possible numerical code range of the characters is roughly one million. This makes using a simple table impractical. In this paper we evaluate three different schemes for overcoming this problem. First we propose to replace the character code table by a character code automaton. Then we compare this method with two other schemes: using a hash table, and the binary-search based solution proposed by Wu, Manber and Myers. We find that the best choice is to use either the automaton-based method or a hash table.

Original languageEnglish
Pages (from-to)289-300
Number of pages12
JournalLecture Notes in Computer Science
Volume3411
DOIs
Publication statusPublished - 2005
EventAsia Information Retrieval Symposium, AIRS 2004 - Beijing, China
Duration: Oct 18 2004Oct 20 2004

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'On bit-parallel processing of multi-byte text'. Together they form a unique fingerprint.

  • Cite this