Cross-Modality Augmentation of Brain Mr Images Using a Novel Pairwise Generative Adversarial Network for Enhanced Glioma Classification

• © 2019 IEEE. Brain Magnetic Resonance Images (MRIs) are commonly used for tumor diagnosis. Machine learning for brain tumor characterization often uses MRIs from many modalities (e.g., T1-MRI, Enhanced-T1-MRI, T2-MRI and FLAIR). This paper tackles two issues that may impact brain tumor characterization performance from deep learning: insufficiently large training dataset, and incomplete collection of MRIs from different modalities. We propose a novel pairwise generative adversarial network (GAN) architecture for generating synthetic brain MRIs in missing modalities by using existing MRIs in other modalities. By improving the training dataset, we aim to mitigate the overfitting and improve the deep learning performance. Main contributions of the paper include: (a) propose a pairwise generative adversarial network (GAN) for brain image augmentation via cross-modality image generation; (b) propose a training strategy to enhance the glioma classification performance, where GAN-augmented images are used for pre-training, followed by refined-training using real brain MRIs; (c) demonstrate the proposed method through tests and comparisons of glioma classifiers that are trained from mixing real and GAN synthetic data, as well as from real data only. Experiments were conducted on an open TCGA dataset, containing 167 subjects for classifying IDH genotypes (mutation or wild-type). Test results from two experimental settings have both provided supports to the proposed method, where glioma classification performance has consistently improved by using mixed real and augmented data (test accuracy 81.03%, with 2.57% improvement).

Ämnesord

MEDICIN OCH HÄLSOVETENSKAP  -- Klinisk medicin -- Neurologi (hsv//swe)

MEDICAL AND HEALTH SCIENCES  -- Clinical Medicine -- Neurology (hsv//eng)

MEDICIN OCH HÄLSOVETENSKAP  -- Klinisk medicin -- Cancer och onkologi (hsv//swe)

MEDICAL AND HEALTH SCIENCES  -- Clinical Medicine -- Cancer and Oncology (hsv//eng)

MEDICIN OCH HÄLSOVETENSKAP  -- Klinisk medicin -- Kirurgi (hsv//swe)

MEDICAL AND HEALTH SCIENCES  -- Clinical Medicine -- Surgery (hsv//eng)

TEKNIK OCH TEKNOLOGIER  -- Medicinteknik -- Medicinsk bildbehandling (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Medical Engineering -- Medical Image Processing (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Annan data- och informationsvetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Other Computer and Information Science (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)

Nyckelord

brain tumor

cross-modality image augmentation

glioma classification

MR images

Pairwise generative adversarial network (GAN)

cross-modality image augmentation

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)