Search: onr:"swepub:oai:DiVA.org:ltu-98272" >
Separating Grains f...
Separating Grains from the Chaff : Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languages
-
- Abdulmumin, Idris (author)
- Ahmadu Bello University, Zaria, Nigeria; HausaNLP
-
- Beukman, Michael (author)
- University of the Witwatersrand, South Africa
-
- Alabi, Jesujoba O. (author)
- Saarland University, Germany
-
show more...
-
- Emezue, Chris (author)
- TUM, Germany; Mila - Quebec AI Institute
-
- Asiko, Everlyn (author)
- University of Cape Town, South Africa; African Institute for Mathematical Sciences
-
- Adewumi, Oluwatosin, 1978- (author)
- Luleå tekniska universitet,EISLAB
-
- Muhammad, Shamsuddeen Hassan (author)
- HausaNLP; LIAAD-INESC TEC, Porto, Portugal
-
- Adeyemi, Mofetoluwa (author)
- Uppsala University, Sweden
-
- Yousuf, Oreen (author)
- Uppsala University, Sweden
-
- Singh, Sahib (author)
- Ford Motor Company
-
- Gwadabe, Tajuddeen Rabiu (author)
- HausaNLP; University of Chinese Academy of Sciences, China
-
show less...
-
(creator_code:org_t)
- Association for Computational Linguistics, 2022
- 2022
- English.
-
In: Proceedings of the Seventh Conference on Machine Translation (WMT). - : Association for Computational Linguistics. - 9781959429296 ; , s. 1001-1014
- Related links:
-
https://urn.kb.se/re...
Abstract
Subject headings
Close
- We participated in the WMT 2022 Large-Scale Machine Translation Evaluation for the African Languages Shared Task. This work de-scribes our approach, which is based on filtering the given noisy data using a sentence-pair classifier that was built by fine-tuning a pre-trained language model. To train the classifier, we obtain positive samples (i.e. high-quality parallel sentences) from a gold-standard curated dataset and extract negative samples (i.e.low-quality parallel sentences) from automatically aligned parallel data by choosing sentences with low alignment scores. Our final machine translation model was then trained on filtered data, instead of the entire noisy dataset. We empirically validate our approach by evaluating on two common datasets and show that data filtering generally improves overall translation quality, in some cases even significantly.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Keyword
- Maskininlärning
- Machine Learning
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database
- By the author/editor
-
Abdulmumin, Idri ...
-
Beukman, Michael
-
Alabi, Jesujoba ...
-
Emezue, Chris
-
Asiko, Everlyn
-
Adewumi, Oluwato ...
-
show more...
-
Muhammad, Shamsu ...
-
Adeyemi, Mofetol ...
-
Yousuf, Oreen
-
Singh, Sahib
-
Gwadabe, Tajudde ...
-
show less...
- About the subject
-
- NATURAL SCIENCES
-
NATURAL SCIENCES
-
and Computer and Inf ...
-
and Language Technol ...
- Articles in the publication
-
Proceedings of t ...
- By the university
-
Luleå University of Technology