Sökning: id:"swepub:oai:DiVA.org:uu-470251" >
A Tale of Three Par...
A Tale of Three Parsers : Towards Diagnostic Evaluation for Meaning Representation Parsing
-
- Buljan, Maja (författare)
- Univ Oslo, Dept Informat, Oslo, Norway.
-
- Nivre, Joakim, 1962- (författare)
- Uppsala universitet,Institutionen för lingvistik och filologi
-
- Oepen, Stephan (författare)
- Univ Oslo, Dept Informat, Oslo, Norway.
-
visa fler...
-
- Ovrelid, Lilja (författare)
- Univ Oslo, Dept Informat, Oslo, Norway.
-
visa färre...
-
Univ Oslo, Dept Informat, Oslo, Norway Institutionen för lingvistik och filologi (creator_code:org_t)
- Paris : European Language Resources Association (ELRA), 2020
- 2020
- Engelska.
-
Ingår i: Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020). - Paris : European Language Resources Association (ELRA). - 9791095546344 ; , s. 1902-1909
- Relaterad länk:
-
https://aclanthology...
-
visa fler...
-
https://uu.diva-port... (primary) (Raw object)
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- We discuss methodological choices in contrastive and diagnostic evaluation in meaning representation parsing, i.e. mapping from natural language utterances to graph-based encodings of semantic structure. Drawing inspiration from earlier work in syntactic dependency parsing, we transfer and refine several quantitative diagnosis techniques for use in the context of the 2019 shared task on Meaning Representation Parsing (MRP). As in parsing proper, moving evaluation from simple rooted trees to general graphs brings along its own range of challenges. Specifically, we seek to begin to shed light on relative strenghts and weaknesses in different broad families of parsing techniques. In addition to these theoretical reflections, we conduct a pilot experiment on a selection of top-performing MRP systems and two of the five meaning representation frameworks in the shared task. Empirical results suggest that the proposed methodology can be meaningfully applied to parsing into graph-structured target representations, uncovering hitherto unknown properties of the different systems that can inform future development and cross-fertilization across approaches.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Nyckelord
- Data-Driven Parsing
- Sentence Semantics
- Meaning Representation Parsing
- Contrastive Evaluation
- Diagnostics
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)
Hitta via bibliotek
Till lärosätets databas