Sökning: onr:"swepub:oai:DiVA.org:ri-59869" >
Quality Assurance o...
-
Borg, MarkusRISE,Mobilitet och system
(författare)
Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice
- Artikel/kapitelEngelska2022
Förlag, utgivningsår, omfång ...
-
2022-10-17
-
New York, NY, USA :Institute of Electrical and Electronics Engineers Inc.2022
-
printrdacarrier
Nummerbeteckningar
-
LIBRIS-ID:oai:DiVA.org:ri-59869
-
https://urn.kb.se/resolve?urn=urn:nbn:se:ri:diva-59869URI
-
https://doi.org/10.1145/3522664.3528592DOI
Kompletterande språkuppgifter
-
Språk:engelska
-
Sammanfattning på:engelska
Ingår i deldatabas
Klassifikation
-
Ämneskategori:ref swepub-contenttype
-
Ämneskategori:kon swepub-publicationtype
Anmärkningar
-
Due to the migration megatrend, efficient and effective second-language acquisition is vital. One proposed solution involves AI-enabled conversational agents for person-centered interactive language practice. We present results from ongoing action research targeting quality assurance of proprietary generative dialog models trained for virtual job interviews. The action team elicited a set of 38 requirements for which we designed corresponding automated test cases for 15 of particular interest to the evolving solution. Our results show that six of the test case designs can detect meaningful differences between candidate models. While quality assurance of natural language processing applications is complex, we provide initial steps toward an automated framework for machine learning model selection in the context of an evolving conversational agent. Future work will focus on model selection in an MLOps setting.
Ämnesord och genrebeteckningar
Biuppslag (personer, institutioner, konferenser, titlar ...)
-
Bengtsson, J.Lund University, Sweden
(författare)
-
Osterling, H.Lund University, Sweden
(författare)
-
Hagelborn, A.NordAxon AB, Sweden
(författare)
-
Gagner, IsabellaRISE,Mobilitet och system
(författare)
-
Tomaszewski, PiotrRISE,Mobilitet och system(Swepub:ri)piotrto@ri.se
(författare)
-
RISEMobilitet och system
(creator_code:org_t)
Sammanhörande titlar
-
Ingår i:Proceedings - 1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022New York, NY, USA : Institute of Electrical and Electronics Engineers Inc., s. 22-329781450392754
Internetlänk
Hitta via bibliotek
Till lärosätets databas