Sökning: onr:"swepub:oai:DiVA.org:uu-197610" >
Predicting Linguist...
Predicting Linguistic Structure with Incomplete and Cross-Lingual Supervision
-
- Täckström, Oscar, 1979- (författare)
- RISE,Uppsala universitet,Institutionen för lingvistik och filologi,SICS,Department of Linguistics and Philology
-
- Nivre, Joakim (preses)
- Uppsala universitet,Institutionen för lingvistik och filologi
-
- Karlgren, Jussi (preses)
- School of Computer Science and Communication, KTH
-
visa fler...
-
- McDonald, Ryan (preses)
- Google
-
- Daumé III, Hal (opponent)
- Department of Computer Science, University of Maryland
-
visa färre...
-
(creator_code:org_t)
- ISBN 9789155486310
- Uppsala : Acta Universitatis Upsaliensis, 2013
- Engelska xii+215 s.
-
Serie: Studia Linguistica Upsaliensia, 1652-1366 ; 14
-
Serie: SICS Dissertation Series, 1101-1335 ; 61
- Relaterad länk:
-
https://uu.diva-port... (primary) (Raw object)
-
visa fler...
-
http://urn.kb.se/res...
-
https://ri.diva-port... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- Contemporary approaches to natural language processing are predominantly based on statistical machine learning from large amounts of text, which has been manually annotated with the linguistic structure of interest. However, such complete supervision is currently only available for the world's major languages, in a limited number of domains and for a limited range of tasks. As an alternative, this dissertation considers methods for linguistic structure prediction that can make use of incomplete and cross-lingual supervision, with the prospect of making linguistic processing tools more widely available at a lower cost. An overarching theme of this work is the use of structured discriminative latent variable models for learning with indirect and ambiguous supervision; as instantiated, these models admit rich model features while retaining efficient learning and inference properties.The first contribution to this end is a latent-variable model for fine-grained sentiment analysis with coarse-grained indirect supervision. The second is a model for cross-lingual word-cluster induction and the application thereof to cross-lingual model transfer. The third is a method for adapting multi-source discriminative cross-lingual transfer models to target languages, by means of typologically informed selective parameter sharing. The fourth is an ambiguity-aware self- and ensemble-training algorithm, which is applied to target language adaptation and relexicalization of delexicalized cross-lingual transfer parsers. The fifth is a set of sequence-labeling models that combine constraints at the level of tokens and types, and an instantiation of these models for part-of-speech tagging with incomplete cross-lingual and crowdsourced supervision. In addition to these contributions, comprehensive overviews are provided of structured prediction with no or incomplete supervision, as well as of learning in the multilingual and cross-lingual settings.Through careful empirical evaluation, it is established that the proposed methods can be used to create substantially more accurate tools for linguistic processing, compared to both unsupervised methods and to recently proposed cross-lingual methods. The empirical support for this claim is particularly strong in the latter case; our models for syntactic dependency parsing and part-of-speech tagging achieve the hitherto best published results for a wide number of target languages, in the setting where no annotated training data is available in the target language.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
Nyckelord
- linguistic structure prediction
- structured prediction
- latent-variable model
- semi-supervised learning
- multilingual learning
- cross-lingual learning
- indirect supervision
- partial supervision
- ambiguous supervision
- part-of-speech tagging
- dependency parsing
- named-entity recognition
- sentiment analysis
- Computational Linguistics
- Datorlingvistik
Publikations- och innehållstyp
- vet (ämneskategori)
- dok (ämneskategori)
Hitta via bibliotek
Till lärosätets databas