TY - JOUR
T1 - Deep attentive time warping
AU - Matsuo, Shinnosuke
AU - Wu, Xiaomeng
AU - Atarsaikhan, Gantugs
AU - Kimura, Akisato
AU - Kashino, Kunio
AU - Iwana, Brian Kenji
AU - Uchida, Seiichi
N1 - Funding Information:
This work was partially supported by MEXT-Japan (Grant No. J17H06100 and J22H00540).
Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2023/4
Y1 - 2023/4
N2 - Similarity measures for time series are important problems for time series classification. To handle the nonlinear time distortions, Dynamic Time Warping (DTW) has been widely used. However, DTW is not learnable and suffers from a trade-off between robustness against time distortion and discriminative power. In this paper, we propose a neural network model for task-adaptive time warping. Specifically, we use the attention model, called the bipartite attention model, to develop an explicit time warping mechanism with greater distortion invariance. Unlike other learnable models using DTW for warping, our model predicts all local correspondences between two time series and is trained based on metric learning, which enables it to learn the optimal data-dependent warping for the target task. We also propose to induce pre-training of our model by DTW to improve the discriminative power. Extensive experiments demonstrate the superior effectiveness of our model over DTW and its state-of-the-art performance in online signature verification.
AB - Similarity measures for time series are important problems for time series classification. To handle the nonlinear time distortions, Dynamic Time Warping (DTW) has been widely used. However, DTW is not learnable and suffers from a trade-off between robustness against time distortion and discriminative power. In this paper, we propose a neural network model for task-adaptive time warping. Specifically, we use the attention model, called the bipartite attention model, to develop an explicit time warping mechanism with greater distortion invariance. Unlike other learnable models using DTW for warping, our model predicts all local correspondences between two time series and is trained based on metric learning, which enables it to learn the optimal data-dependent warping for the target task. We also propose to induce pre-training of our model by DTW to improve the discriminative power. Extensive experiments demonstrate the superior effectiveness of our model over DTW and its state-of-the-art performance in online signature verification.
UR - http://www.scopus.com/inward/record.url?scp=85143680677&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85143680677&partnerID=8YFLogxK
U2 - 10.1016/j.patcog.2022.109201
DO - 10.1016/j.patcog.2022.109201
M3 - Article
AN - SCOPUS:85143680677
SN - 0031-3203
VL - 136
JO - Pattern Recognition
JF - Pattern Recognition
M1 - 109201
ER -