Search: onr:"swepub:oai:DiVA.org:his-17664" >
An Infinite Replica...
An Infinite Replicated Softmax Model for Topic Modeling
-
- Huhnstock, Nikolas Alexander, 1988- (author)
- Högskolan i Skövde,Institutionen för informationsteknologi,Forskningsmiljön Informationsteknologi,Skövde Artificial Intelligence Lab (SAIL),University of Skövde, Skövde, Sweden
-
- Karlsson, Alexander (author)
- Högskolan i Skövde,Institutionen för informationsteknologi,Forskningsmiljön Informationsteknologi,Skövde Artificial Intelligence Lab (SAIL),University of Skövde, Skövde, Sweden
-
- Riveiro, Maria, 1978- (author)
- Jönköping University,Jönköping AI Lab (JAIL),University of Skövde, Skövde, Sweden,Högskolan i Jönköping, JTH, Datateknik och informatik
-
show more...
-
- Steinhauer, H. Joe (author)
- Högskolan i Skövde,Institutionen för informationsteknologi,Forskningsmiljön Informationsteknologi,Skövde Artificial Intelligence Lab (SAIL),University of Skövde, Skövde, Sweden
-
show less...
-
(creator_code:org_t)
- 2019-07-24
- 2019
- English.
-
In: Modeling Decisions for Artificial Intelligence. - Cham : Springer. - 9783030267728 - 9783030267735 ; , s. 307-318
- Related links:
-
https://his.diva-por... (primary) (Raw object)
-
show more...
-
http://hj.diva-porta...
-
https://hj.diva-port... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
show less...
Abstract
Subject headings
Close
- In this paper, we describe the infinite replicated Softmax model (iRSM) as an adaptive topic model, utilizing the combination of the infinite restricted Boltzmann machine (iRBM) and the replicated Softmax model (RSM). In our approach, the iRBM extends the RBM by enabling its hidden layer to adapt to the data at hand, while the RSM allows for modeling low-dimensional latent semantic representation from a corpus. The combination of the two results is a method that is able to self-adapt to the number of topics within the document corpus and hence, renders manual identification of the correct number of topics superfluous. We propose a hybrid training approach to effectively improve the performance of the iRSM. An empirical evaluation is performed on a standard data set and the results are compared to the results of a baseline topic model. The results show that the iRSM adapts its hidden layer size to the data and when trained in the proposed hybrid manner outperforms the base RSM model.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Människa-datorinteraktion (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Human Computer Interaction (hsv//eng)
Keyword
- Restricted Boltzmann machine
- Unsupervised learning
- Topic modeling
- Adaptive Neural Network
- Skövde Artificial Intelligence Lab (SAIL)
- Skövde Artificial Intelligence Lab (SAIL)
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database