模式识别与人工智能
Friday, Apr. 11, 2025 Home      About Journal      Editorial Board      Instructions      Ethics Statement      Contact Us                   中文
  2018, Vol. 31 Issue (8): 715-724    DOI: 10.16451/j.cnki.issn1003-6059.201808004
Papers and Reports Current Issue| Next Issue| Archive| Adv Search |
Supervised Topic Model with Deep Learning
YUAN Dongdong1, ZHAO Jieyu1, YE Xulun1
1.Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211

Download: PDF (830 KB)   HTML (1 KB) 
Export: BibTeX | EndNote (RIS)      
Abstract  

Some discriminative text features are lost due to the lack of guidance of label information during dimensionality reduction in unsupervised topic models. Thus, the classification result is unsatisfactory. A supervised topic model with deep learning, namely supervised latent Dirichlet allocation with deep learning(DL-sLDA) is proposed in this paper. A deep neural network is exploited to establish the mapping between the topic of a document and its label. Both variational expectation-maximization and deep learning method are adopted to update the defined parameters under Bayesian framework in DL-sLDA. When the structure of the deep network and the type of the activation function are changed properly, the proposed model can be utilized for both classification and regression tasks. The experimental result demonstrates that DL-sLDA maintains the ability of topic extraction and gains a better predictive ability.

Key wordsSupervised Topic Model      Deep Learning      Variational Expectation-Maximization(EM) Algorithm     
Received: 17 January 2018     
ZTFLH: TP 391  
Fund:

Supported by National Natural Science Foundation of China(No.61571247), Natural Science Foundation of Zhejiang Province(No.LZ16F030001), International Cooperation Project of Zhejiang Province(No.2013C24027)

Corresponding Authors: ZHAO Jieyu, Ph.D., professor. His research interests include image and graphics technology, natural human-computer interaction and computer vision.   
About author:: YUAN Dongdong, master student. His research interests include machine learning and natural language processing. YE Xulun, Ph.D. candidate. His research interests include manifold learning and non-negative matrix factorization.
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
YUAN Dongdong
ZHAO Jieyu
YE Xulun
Cite this article:   
YUAN Dongdong,ZHAO Jieyu,YE Xulun. Supervised Topic Model with Deep Learning[J]. , 2018, 31(8): 715-724.
URL:  
http://manu46.magtech.com.cn/Jweb_prai/EN/10.16451/j.cnki.issn1003-6059.201808004      OR     http://manu46.magtech.com.cn/Jweb_prai/EN/Y2018/V31/I8/715
Copyright © 2010 Editorial Office of Pattern Recognition and Artificial Intelligence
Address: No.350 Shushanhu Road, Hefei, Anhui Province, P.R. China Tel: 0551-65591176 Fax:0551-65591176 Email: bjb@iim.ac.cn
Supported by Beijing Magtech  Email:support@magtech.com.cn