onr:"swepub:oai:DiVA.org:ri-59869"
Search: onr:"swepub:oai:DiVA.org:ri-59869" > Quality Assurance o...
- 1 of 1
- Previous record
- Next record
- To hitlist
Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice
-
- Borg, Markus (author)
- RISE,Mobilitet och system
-
- Bengtsson, J. (author)
- Lund University, Sweden
-
- Osterling, H. (author)
- Lund University, Sweden
- show more...
- show less...
- (creator_code:org_t)
- 2022-10-17
- 2022
- English.
- In: Proceedings - 1st International Conference on AI Engineering - Software Engineering for AI, CAIN 2022. - New York, NY, USA : Institute of Electrical and Electronics Engineers Inc.. - 9781450392754 ; , s. 22-32
- Conference paper (peer-reviewed)
Abstract
Subject headings
Close
- Due to the migration megatrend, efficient and effective second-language acquisition is vital. One proposed solution involves AI-enabled conversational agents for person-centered interactive language practice. We present results from ongoing action research targeting quality assurance of proprietary generative dialog models trained for virtual job interviews. The action team elicited a set of 38 requirements for which we designed corresponding automated test cases for 15 of particular interest to the evolving solution. Our results show that six of the test case designs can detect meaningful differences between candidate models. While quality assurance of natural language processing applications is complex, we provide initial steps toward an automated framework for machine learning model selection in the context of an evolving conversational agent. Future work will focus on model selection in an MLOps setting.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Programvaruteknik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Software Engineering (hsv//eng)
Keyword
- action research
- AI quality
- conversational agent
- generative dialog model
- requirements engineering
- software testing
- Learning algorithms
- Natural language processing systems
- Quality assurance
- Software agents
- Conversational agents
- Dialogue models
- Megatrends
- Model Selection
- Requirement engineering
- Software testings
- Swedishs
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
- Proceedings - 1st International Conference on AI Engineering - Software Engineer... (Search for host publication in LIBRIS)
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Borg, Markus
- Bengtsson, J.
- Osterling, H.
- Hagelborn, A.
- Gagner, Isabella
- Tomaszewski, Pio ...
- About the subject
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Software Enginee ...
- Articles in the publication
- Proceedings - 1s ...
- By the university
- RISE
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
