SwePub
Sök i SwePub databas

  Extended search

Träfflista för sökning "AMNE:(NATURVETENSKAP Data- och informationsvetenskap Språkteknologi språkvetenskaplig databehandling) "

Search: AMNE:(NATURVETENSKAP Data- och informationsvetenskap Språkteknologi språkvetenskaplig databehandling)

  • Result 1-2 of 2
Sort/group result
   
EnumerationReferenceCoverFind
1.
  • Adewumi, Oluwatosin, 1978-, et al. (author)
  • Småprat : DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning
  • 2022
  • In: Vol. 3 (2022): Proceedings of the Northern Lights Deep Learning Workshop 2022. - : Septentrio Academic Publishing. - 2703-6928.
  • Conference paper (peer-reviewed)abstract
    • Building open-domain conversational systems (or chatbots) that produce convincing responses is a recognized challenge. Recent state-of-the-art (SoTA) transformer-based models for the generation of natural language dialogue have demonstrated impressive performance in simulating human-like, single-turn conversations in English.This work investigates, by an empirical study, the potential for transfer learning of such models to Swedish language. DialoGPT, an English language pre-trained model, is adapted by training on three different Swedish language conversational datasets obtained from publicly available sources: Reddit, Familjeliv and the GDC. Perplexity score (an automated intrinsic metric) and surveys by human evaluation were used to assess the performances of the fine-tuned models. We also compare the DialoGPT experiments with an attention-mechanism-based seq2seq baseline model, trained on the GDC dataset. The results indicate that the capacity for transfer learning can be exploited with considerable success. Human evaluators asked to score the simulated dialogues judged over 57% of the chatbot responses to be human-like for the model trained on the largest (Swedish) dataset. The work agrees with the hypothesis that deep monolingual models learn some abstractions which generalize across languages. We contribute the codes, datasets and model checkpoints and host the demos on the HuggingFace platform.
  •  
2.
  •  
Skapa referenser, mejla, bekava och länka
  • Result 1-2 of 2

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

 
pil uppåt Close

Copy and save the link in order to return to this view