Detecting anomalies from human activities by an autonomous mobile robot based on “Fast and slow” thinking

Muhammad Fikko Fadjrimiratno, Yusuke Hatae, Tetsu Matsukawa, Einoshin Suzuki

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

抄録

In this paper, we propose an anomaly detection method from human activities by an autonomous mobile robot which is based on “Fast and Slow Thinking”. Our previous method employes deep captioning and detects anomalous image regions based on image visual features, caption features, and coordinate features. However, detecting anomalous image region pairs is a more challenging problem due to the larger number of candidates. Moreover, realizing reminiscence, which represents re-checking past, similar examples to cope with overlooking, is another challenge for a robot operating in real-time. Inspired by “Fast and Slow Thinking” from the dual process theory, we achieve detection of these kinds of anomalies in real-time onboard an autonomous mobile robot. Our method consists of a fast module which models caption-coordinate features to detect single-region anomalies, and a slow module which models image visual features and overlapping image regions to detect also neighboring-region anomalies. The reminiscence is triggered by the fast module as a result of its anomaly detection and the slow module seeks for single-region anomalies in recent images. Experiments with a real robot platform show the superiority of our method to the baseline methods in terms of recall, precision, and AUC.

本文言語英語
ホスト出版物のタイトルVISAPP
編集者Giovanni Maria Farinella, Petia Radeva, Jose Braz, Kadi Bouatouch
出版社SciTePress
ページ943-953
ページ数11
ISBN(電子版)9789897584886
出版ステータス出版済み - 2021
イベント16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2021 - Virtual, Online
継続期間: 2 8 20212 10 2021

出版物シリーズ

名前VISIGRAPP 2021 - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
5

会議

会議16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2021
CityVirtual, Online
Period2/8/212/10/21

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

フィンガープリント 「Detecting anomalies from human activities by an autonomous mobile robot based on “Fast and slow” thinking」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル