Deep Learning and Multi-Sensor Fusion for Glioma Classification Using Multistream 2D Convolutional Networks

Ge, Chenjie,1991Chalmers tekniska högskola,Chalmers University of Technology (author)

This paper addresses issues of brain tumor, glioma, grading from multi-sensor images. Different types of scanners (or sensors) like enhanced T1-MRI, T2-MRI and FLAIR, show different contrast and are sensitive to different brain tissues and fluid regions. Most existing works use 3D brain images from single sensor. In this paper, we propose a novel multistream deep Convolutional Neural Network (CNN) architecture that extracts and fuses the features from multiple sensors for glioma tumor grading/subcategory grading. The main contributions of the paper are: (a) propose a novel multistream deep CNN architecture for glioma grading; (b) apply sensor fusion from T1-MRI, T2-MRI and/or FLAIR for enhancing performance through feature aggregation; (c) mitigate overfitting by using 2D brain image slices in combination with 2D image augmentation. Two datasets were used for our experiments, one for classifying low/high grade gliomas, another for classifying glioma with/without 1p19q codeletion. Experiments using the proposed scheme have shown good results (with test accuracy of 90.87% for former case, and 89.39 % for the latter case). Comparisons with several existing methods have provided further support to the proposed scheme.

Gu, Irene Yu-Hua,1953Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)irenegu (author)
Jakola, AsgeirSahlgrenska universitetssjukhuset,Sahlgrenska University Hospital (author)
Yang, JieShanghai Jiao Tong University (author)
Chalmers tekniska högskolaSahlgrenska universitetssjukhuset (creator_code:org_t)

In:Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, s. 5894-58971557-170X

By the author/editor: Ge, Chenjie, 199 ...; Gu, Irene Yu-Hua ...; Jakola, Asgeir; Yang, Jie

About the subject

MEDICAL AND HEALTH SCIENCES: MEDICAL AND HEAL ...; and Clinical Medicin ...; and Radiology Nuclea ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Vision ...

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Medical Engineer ...; and Medical Image Pr ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.