SwePub
Sök i LIBRIS databas

  Utökad sökning

onr:"swepub:oai:DiVA.org:bth-22891"
 

Sökning: onr:"swepub:oai:DiVA.org:bth-22891" > Explainable Multime...

Explainable Multimedia Feature Fusion for Medical Applications

Wagenpfeil, Stefan (författare)
Univ Hagen, DEU
Mc Kevitt, Paul (författare)
Acad Int Sci & Res AISR, GBR
Cheddad, Abbas (författare)
Blekinge Tekniska Högskola,Institutionen för datavetenskap
visa fler...
Hemmje, Matthias (författare)
Univ Hagen, DEU
visa färre...
 (creator_code:org_t)
2022-04-08
2022
Engelska.
Ingår i: JOURNAL OF IMAGING. - : MDPI. - 2313-433X. ; 8:4
  • Tidskriftsartikel (refereegranskat)
Abstract Ämnesord
Stäng  
  • Due to the exponential growth of medical information in the form of, e.g., text, images, Electrocardiograms (ECGs), X-ray, and multimedia, the management of a patient's data has become a huge challenge. In particular, the extraction of features from various different formats and their representation in a homogeneous way are areas of interest in medical applications. Multimedia Information Retrieval (MMIR) frameworks, like the Generic Multimedia Analysis Framework (GMAF), can contribute to solving this problem, when adapted to special requirements and modalities of medical applications. In this paper, we demonstrate how typical multimedia processing techniques can be extended and adapted to medical applications and how these applications benefit from employing a Multimedia Feature Graph (MMFG) and specialized, efficient indexing indexing structures in the form of Graph Codes. These Graph Codes are transformed to feature relevant Graph Codes by employing a modified Term Frequency Inverse Document Frequency (TFIDF) algorithm, which further supports value ranges and Boolean operations required in the medical context. On this basis, various metrics for the calculation of similarity, recommendations, and automated inferencing and reasoning can be applied supporting the field of diagnostics. Finally, the presentation of these new facilities in the form of explainability is introduced and demonstrated. Thus, in this paper, we show how Graph Codes contribute new querying options for diagnosis and how Explainable Graph Codes can help to readily understand medical multimedia formats.

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

Nyckelord

indexing
retrieval
explainability
semantic
multimedia
feature graph
graph code
OF-THE-ART

Publikations- och innehållstyp

ref (ämneskategori)
art (ämneskategori)

Hitta via bibliotek

Till lärosätets databas

Sök utanför SwePub

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

 
pil uppåt Stäng

Kopiera och spara länken för att återkomma till aktuell vy