Sökning: id:"swepub:oai:DiVA.org:ri-51966" >
Cross-encoded meta ...
Cross-encoded meta embedding towards transfer learning
-
- Brännvall, Rickard (författare)
- Luleå tekniska universitet,RISE,Datavetenskap,Lulea University of Technology, Sweden,EISLAB,RISE ICE - Research Institutes of Sweden, Sweden
-
- Öhman, Johan, 1991- (författare)
- Luleå tekniska universitet,Strömningslära och experimentell mekanik
-
- Kovács, György, Postdoctoral researcher, 1984- (författare)
- Luleå tekniska universitet,EISLAB
-
visa fler...
-
- Liwicki, Marcus (författare)
- Luleå tekniska universitet,EISLAB
-
visa färre...
-
(creator_code:org_t)
- ESANN (i6doc.com), 2020
- 2020
- Engelska.
-
Ingår i: ESANN 2020 - Proceedings, 28th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. - : ESANN (i6doc.com). - 9782875870742 ; , s. 631-636, s. 631-636
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- In this paper we generate word meta-embeddings from already existing embeddings using cross-encoding. Previous approaches can only work with words that exist in each source embedding, while the architecture presented here drops this requirement. We demonstrate the method using two pre-trained embeddings, namely GloVE and FastText. Furthermore, we propose additional improvements to the training process of the metaembedding. Results on six standard tests for word similarity show that the meta-embedding trained outperforms the original embeddings. Moreover, this performance can be further increased with the proposed improvements, resulting in a competitive performance with those reported earlier.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Annan elektroteknik och elektronik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Other Electrical Engineering, Electronic Engineering, Information Engineering (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Maskinteknik -- Teknisk mekanik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Mechanical Engineering -- Applied Mechanics (hsv//eng)
Nyckelord
- Embeddings
- Intelligent computing
- Learning systems
- Transfer learning
- Competitive performance
- Standard tests
- Training process
- Word similarity
- Neural networks
- Maskininlärning
- Elektroniksystem
- Experimentell mekanik
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)
Hitta via bibliotek
Till lärosätets databas