Topic modeling for sequential documents based on hybrid inter-document topic dependency

Wenbo Li, Hiroto Saigo, Bin Tong, Einoshin Suzuki

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


We propose two new topic modeling methods for sequential documents based on hybrid inter-document topic dependency. Topic modeling for sequential documents is the basis of many attractive applications such as emerging topic clustering and novel topic detection. For these tasks, most of the existing models introduce inter-document dependencies between topic distributions. However, in a real situation, adjacent emerging topics are often intertwined and mixed with outliers. These single-dependency based models have difficulties in handling the topic evolution in such multi-topic and outlier mixed sequential documents. To solve this problem, our first method considers three kinds of topic dependencies for each document to handle its probabilities of belonging to a fading topic, an emerging topic, or an independent topic. Secondly, we extend our first method by considering fine-grained dependencies in a given context for more complex topic evolution sequences. Our experiments conducted on six standard datasets on topic modeling show that our proposals outperform state-of-the-art models in terms of the accuracy of topic modeling, the quality of topic clustering, and the effectiveness of outlier detection.

Original languageEnglish
Pages (from-to)435-458
Number of pages24
JournalJournal of Intelligent Information Systems
Issue number3
Publication statusPublished - Jun 2021

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence


Dive into the research topics of 'Topic modeling for sequential documents based on hybrid inter-document topic dependency'. Together they form a unique fingerprint.

Cite this