Sökning: WFRF:(de Lhoneux Miryam 1990 ) >
What Should/Do/Can ...
What Should/Do/Can LSTMs Learn When Parsing Auxiliary Verb Constructions?
-
- de Lhoneux, Miryam, 1990- (författare)
- Uppsala universitet,Institutionen för lingvistik och filologi
-
- Stymne, Sara, 1977- (författare)
- Uppsala universitet,Institutionen för lingvistik och filologi
-
- Nivre, Joakim, 1962- (författare)
- Uppsala universitet,Institutionen för lingvistik och filologi
-
(creator_code:org_t)
- 2019
- 2019
- Engelska.
-
Ingår i: CoRR. ; abs/1907.07950
- Relaterad länk:
-
http://arxiv.org/abs...
-
visa fler...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- This article is a linguistic investigation of a neural parser. We look at transitivity and agreement information of auxiliary verb constructions (AVCs) in comparison to finite main verbs (FMVs). This comparison is motivated by theoretical work in dependency grammar and in particular the work of Tesnière (1959) where AVCs and FMVs are both instances of a nucleus, the basic unit of syntax. An AVC is a dissociated nucleus, it consists of at least two words, and a FMV is its non-dissociated counterpart, consisting of exactly one word. We suggest that the representation of AVCs and FMVs should capture similar information. We use diagnostic classifiers to probe agreement and transitivity information in vectors learned by a transition-based neural parser in four typologically different languages. We find that the parser learns different information about AVCs and FMVs if only sequential models (BiLSTMs) are used in the architecture but similar information when a recursive layer is used. We find explanations for why this is the case by looking closely at how information is learned in the network and looking at what happens with different dependency representations of AVCs.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Nyckelord
- Datorlingvistik
- Computational Linguistics
Publikations- och innehållstyp
- vet (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas