Bidirectional Domain Adaptation Using Weighted Multi-Task Learning

Dakota, DanielUppsala universitet,Institutionen för lingvistik och filologi (författare)

Domain adaption in syntactic parsing is still a significant challenge. We address the issue of data imbalance between the in-domain and out-of-domain treebank typically used for the problem. We define domain adaptation as a Multi-task learning (MTL) problem, which allows us to train two parsers, one for each domain. Our results show that the MTL approach is beneficial for the smaller treebank. For the larger treebank, we need to use loss weighting in order to avoid a decrease in performance below the single task. In order to determine to what degree the data imbalance between two domains and the domain differences affect results, we also carry out an experiment with two imbalanced in-domain treebanks and show that loss weighting also improves performance in an in-domain setting. Given loss weighting in MTL, we can improve results for both parsers.

Sayyed, Zeeshan AliIndiana Univ, Bloomington, IN 47405 USA. (författare)
Kuebler, SandraIndiana Univ, Bloomington, IN 47405 USA. (författare)
Uppsala universitetInstitutionen för lingvistik och filologi (creator_code:org_t)

Ingår i:IWPT 2021Stroudsburg, PA, USA : Association for Computational Linguistics, s. 93-1059781954085800

Av författaren/redakt...: Dakota, Daniel; Sayyed, Zeeshan ...; Kuebler, Sandra

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Språkteknologi

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.