DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices

Run Wang, Felix Juefei-Xu, Yihao Huang, Qing Guo, Xiaofei Xie, Lei Ma, Yang Liu

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

3 被引用数 (Scopus)

抄録

With the recent advances in voice synthesis, AI-synthesized fake voices are indistinguishable to human ears and widely are applied to produce realistic and natural DeepFakes, exhibiting real threats to our society. However, effective and robust detectors for synthesized fake voices are still in their infancy and are not ready to fully tackle this emerging threat. In this paper, we devise a novel approach, named DeepSonar, based on monitoring neuron behaviors of speaker recognition (SR) system, i.e., a deep neural network (DNN), to discern AI-synthesized fake voices. Layer-wise neuron behaviors provide an important insight to meticulously catch the differences among inputs, which are widely employed for building safety, robust, and interpretable DNNs. In this work, we leverage the power of layer-wise neuron activation patterns with a conjecture that they can capture the subtle differences between real and AI-synthesized fake voices, in providing a cleaner signal to classifiers than raw inputs. Experiments are conducted on three datasets (including commercial products from Google, Baidu, etc) containing both English and Chinese languages to corroborate the high detection rates (98.1% average accuracy) and low false alarm rates (about 2% error rate) of DeepSonar in discerning fake voices. Furthermore, extensive experimental results also demonstrate its robustness against manipulation attacks (e.g., voice conversion and additive real-world noises). Our work further poses a new insight into adopting neuron behaviors for effective and robust AI aided multimedia fakes forensics as an inside-out approach instead of being motivated and swayed by various artifacts introduced in synthesizing fakes.

本文言語英語
ホスト出版物のタイトルMM 2020 - Proceedings of the 28th ACM International Conference on Multimedia
出版社Association for Computing Machinery, Inc
ページ1207-1216
ページ数10
ISBN(電子版)9781450379885
DOI
出版ステータス出版済み - 10 12 2020
イベント28th ACM International Conference on Multimedia, MM 2020 - Virtual, Online, 米国
継続期間: 10 12 202010 16 2020

出版物シリーズ

名前MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia

会議

会議28th ACM International Conference on Multimedia, MM 2020
国/地域米国
CityVirtual, Online
Period10/12/2010/16/20

All Science Journal Classification (ASJC) codes

  • ソフトウェア
  • コンピュータ グラフィックスおよびコンピュータ支援設計
  • 人間とコンピュータの相互作用

フィンガープリント

「DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル