Exploring Cross-Lingual Transfer to Counteract Data Scarcity for Causality Detection

Reimann, SebastianUppsala universitet,Institutionen för lingvistik och filologi,Ruhr-Universität Bochum (author)

Finding causal relations in text is an important task for many types of textual analysis. It is a challenging task, especially for the many languages with no or only little annotated training data available. To overcome this issue, we explore cross-lingual methods. Our main focus is on Swedish, for which we have a limited amount of data, and where we explore transfer from English and German. We also present additional results for German with English as a source language. We explore both a zero-shot setting without any target training data, and a few-shot setting with a small amount of target data. An additional challenge is the fact that the annotation schemes for the different data sets differ, and we discuss how we can address this issue. Moreover, we explore the impact of different types of sentence representations. We find that we have the best results for Swedish with German as a source language, for which we have a rather small but compatible data set. We are able to take advantage of a limited amount of noisy Swedish training data, but only if we balance its classes. In addition we find that the newer transformer-based representations can make better use of target language data, but that a representation based on recurrent neural networks is surprisingly competitive in the zero-shot setting.

Stymne, Sara,1977-Uppsala universitet,Institutionen för lingvistik och filologi(Swepub:uu)sarst212 (author)
Uppsala universitetInstitutionen för lingvistik och filologi (creator_code:org_t)

In:WWW '22New York, USA : Association for Computing Machinery (ACM), s. 501-5089781450391306

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Language Technol ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.