Joint Handwritten Text Recognition and Word Classification for Tabular Information Extraction

In this paper, we present a system for extracting tabular information from loosely structured handwritten documents. The system consists of three parts, (i) a u-net like CNN-based method for text detection and segmentation, (ii) a new attention-based method for simultaneous text recognition and classification of word-parts, and (iii) a method for matching the word parts into a tabular structure for each entry. A key contribution is the observation that the new attention-based recognition and classification module makes it possible for improved spatial analysis of the tabular information. The method is evaluated on a unique historical document: The Swedish Wealth Tax of 1571, consisting of 11,453 pages of hand-written tax records. The evaluation shows that the system provides a significant improvement to the state-of-the-art to the problem of tabular extraction from loosely structured historical documents.

Enflo, KerstinLund University,Lunds universitet,Tillväxt, teknologisk förändring och ojämlikhet,Ekonomisk-historiska institutionen,Ekonomihögskolan,Growth, technological change, and inequality,Department of Economic History,Lund University School of Economics and Management, LUSEM(Swepub:lu)ekh-kse (author)
Jakobsson, AndreasLund University,Lunds universitet,Biomedical Modelling and Computation,Forskargrupper vid Lunds universitet,Statistical Signal Processing Group,Matematisk statistik,Matematikcentrum,Institutioner vid LTH,Lunds Tekniska Högskola,LTH profilområde: AI och digitalisering,LTH profilområden,Lund University Research Groups,Mathematical Statistics,Centre for Mathematical Sciences,Departments at LTH,Faculty of Engineering, LTH,LTH Profile Area: AI and Digitalization,LTH Profile areas,Faculty of Engineering, LTH(Swepub:lu)mats-aaj (author)
Åström, KalleLund University,Lunds universitet,Mathematical Imaging Group,Forskargrupper vid Lunds universitet,Matematik LTH,Matematikcentrum,Institutioner vid LTH,Lunds Tekniska Högskola,Stroke Imaging Research group,LTH profilområde: AI och digitalisering,LTH profilområden,Lund University Research Groups,Mathematics (Faculty of Engineering),Centre for Mathematical Sciences,Departments at LTH,Faculty of Engineering, LTH,LTH Profile Area: AI and Digitalization,LTH Profile areas,Faculty of Engineering, LTH(Swepub:lu)math-kas (author)
Lund UniversityTillväxt, teknologisk förändring och ojämlikhet (creator_code:org_t)

In:2022 26th International Conference on Pattern Recognition (ICPR), s. 1564-157097816654906349781665490627

By the author/editor: Blomqvist, Chris ...; Enflo, Kerstin; Jakobsson, Andre ...; Åström, Kalle

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Vision ...

SOCIAL SCIENCES: SOCIAL SCIENCES; and Economics and Bu ...; and Economic History

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.