Sökning: id:"swepub:oai:DiVA.org:lnu-123315" >
Improving news head...
Improving news headline text generation quality through frequent POS-Tag patterns analysis
-
- Fatima, Noureen (författare)
- Sukkur IBA University, Pakistan
-
- Daudpota, Sher Muhammad (författare)
- Sukkur IBA University, Pakistan
-
- Kastrati, Zenun, 1984- (författare)
- Linnéuniversitetet,Institutionen för informatik (IK),Institutionen för datavetenskap och medieteknik (DM)
-
visa fler...
-
- Imran, Ali Shariq (författare)
- Norwegian University of Science and Technology (NTNU), Norway
-
- Hassan, Saif (författare)
- Sukkur IBA University, Pakistan
-
- Elmitwally, Nouh Sabri (författare)
- Birmingham City University, UK
-
visa färre...
-
(creator_code:org_t)
- Elsevier, 2023
- 2023
- Engelska.
-
Ingår i: Engineering applications of artificial intelligence. - : Elsevier. - 0952-1976 .- 1873-6769. ; 125
- Relaterad länk:
-
https://doi.org/10.1...
-
visa fler...
-
https://lnu.diva-por... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- Original synthetic content writing is one of the human abilities that algorithms aspire to emulate. The advent of sophisticated algorithms, especially based on neural networks has shown promising results in recent times. A watershed moment was witnessed when the attention mechanism was introduced which paved the way for transformers, a new exciting architecture in natural language processing. Recent sensations like GPT and BERT for synthetic text generation rely on NLP transformers. Although, GPT and BERT-based models are capable of generating creative text given they are properly trained on abundant data, however, the generated text suffers the quality aspect when limited data is available. This is especially an issue for low-resource languages where labeled data is still scarce. In such cases, the generated text, more often than not, lacks the proper sentence structure, thus unreadable. This study proposes a post-processing step in text generation that improves the quality of generated text through the GPT model. The proposed post-processing step is based on the analysis of POS tagging patterns in the original text and accepts only those generated sentences from GPT which satisfy POS patterns that are originally learned from the data. We exploit the GPT model to generate English headlines by utilizing Australian Broadcasting Corporation (ABC) news dataset. Furthermore, for assessing the applicability of the model in low-resource languages, we also train the model on the Urdu news dataset for Urdu news headlines generation. The experiments presented in this paper on these datasets from high- and low-resource languages show that the performance of generated headlines has a significant improvement by using the proposed headline POS pattern extraction. We evaluate the performance through subjective evaluation as well as using text generation quality metrics like BLEU and ROUGE.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Systemvetenskap, informationssystem och informatik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Information Systems (hsv//eng)
Nyckelord
- POS tagging
- Text generation
- Low resource language
- Generative pre-trained transformer
- Attention mechanism
- Informatik
- Information Systems
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas