TY - JOUR

T1 - Efficient dynamic dictionary matching with DAWGs and AC-automata

AU - Hendrian, Diptarama

AU - Inenaga, Shunsuke

AU - Yoshinaka, Ryo

AU - Shinohara, Ayumi

N1 - Funding Information:
The research of Diptarama, Ryo Yoshinaka, and Ayumi Shinohara is supported by Tohoku University Division for Interdisciplinary Advance Research and Education , JSPS KAKENHI Grant Numbers JP15H05706 , JP24106010 , and ImPACT Program of Council for Science, Technology and Innovation (Cabinet Office, Government of Japan) . The research of Shunsuke Inenaga is in part supported by JSPS KAKENHI Grant Number 17H01697 .
Publisher Copyright:
© 2018 Elsevier B.V.

PY - 2019/11/5

Y1 - 2019/11/5

N2 - The dictionary matching is a task to find all occurrences of pattern strings in a set D (called a dictionary) on a text string T. The Aho–Corasick-automaton (AC-automaton) which is built on D is a fundamental data structure which enables us to solve the dictionary matching problem in O(dlogσ) preprocessing time and O(nlogσ+occ) matching time, where d is the total length of the patterns in the dictionary D, n is the length of the text, σ is the alphabet size, and occ is the total number of occurrences of all the patterns in the text. The dynamic dictionary matching is a variant where patterns may dynamically be inserted into and deleted from the dictionary D. This problem is called semi-dynamic dictionary matching if only insertions are allowed. In this paper, we propose two efficient algorithms that can solve both problems with some modifications. For a pattern of length m, our first algorithm supports insertions in O(mlogσ+logd/loglogd) time and pattern matching in O(nlogσ+occ) for the semi-dynamic setting. This algorithm also supports both insertions and deletions in O(σm+logd/loglogd) time and pattern matching in O(n(logd/loglogd+logσ)+occ(logd/loglogd)) time for the dynamic dictionary matching problem by some modifications. This algorithm is based on the directed acyclic word graph (DAWG) of Blumer et al. (JACM 1987). Our second algorithm, which is based on the AC-automaton, supports insertions in O(mlogσ+uf+uo) time for the semi-dynamic setting and supports both insertions and deletions in O(σm+uf+uo) time for the dynamic setting, where uf and uo respectively denote the numbers of states in which the failure function and the output function need to be updated. This algorithm performs pattern matching in O(nlogσ+occ) time for both settings. Our algorithm achieves optimal update time for AC-automaton based methods over constant-size alphabets, since any algorithm which explicitly maintains the AC-automaton requires Ω(m+uf+uo) update time.

AB - The dictionary matching is a task to find all occurrences of pattern strings in a set D (called a dictionary) on a text string T. The Aho–Corasick-automaton (AC-automaton) which is built on D is a fundamental data structure which enables us to solve the dictionary matching problem in O(dlogσ) preprocessing time and O(nlogσ+occ) matching time, where d is the total length of the patterns in the dictionary D, n is the length of the text, σ is the alphabet size, and occ is the total number of occurrences of all the patterns in the text. The dynamic dictionary matching is a variant where patterns may dynamically be inserted into and deleted from the dictionary D. This problem is called semi-dynamic dictionary matching if only insertions are allowed. In this paper, we propose two efficient algorithms that can solve both problems with some modifications. For a pattern of length m, our first algorithm supports insertions in O(mlogσ+logd/loglogd) time and pattern matching in O(nlogσ+occ) for the semi-dynamic setting. This algorithm also supports both insertions and deletions in O(σm+logd/loglogd) time and pattern matching in O(n(logd/loglogd+logσ)+occ(logd/loglogd)) time for the dynamic dictionary matching problem by some modifications. This algorithm is based on the directed acyclic word graph (DAWG) of Blumer et al. (JACM 1987). Our second algorithm, which is based on the AC-automaton, supports insertions in O(mlogσ+uf+uo) time for the semi-dynamic setting and supports both insertions and deletions in O(σm+uf+uo) time for the dynamic setting, where uf and uo respectively denote the numbers of states in which the failure function and the output function need to be updated. This algorithm performs pattern matching in O(nlogσ+occ) time for both settings. Our algorithm achieves optimal update time for AC-automaton based methods over constant-size alphabets, since any algorithm which explicitly maintains the AC-automaton requires Ω(m+uf+uo) update time.

UR - http://www.scopus.com/inward/record.url?scp=85045537552&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045537552&partnerID=8YFLogxK

U2 - 10.1016/j.tcs.2018.04.016

DO - 10.1016/j.tcs.2018.04.016

M3 - Article

AN - SCOPUS:85045537552

SN - 0304-3975

VL - 792

SP - 161

EP - 172

JO - Theoretical Computer Science

JF - Theoretical Computer Science

ER -