| 1. |
- Ali, Muhaddisa Barat, 1986, et al.
(författare)
-
A Feasibility Study on Deep Learning Based Brain Tumor Segmentation Using 2D Ellipse Box Areas.
- 2022
-
Ingår i: Sensors (Basel, Switzerland). - : MDPI AG. - 1424-8220. ; 22:14
-
Tidskriftsartikel (refereegranskat)abstract
- In most deep learning-based brain tumor segmentation methods, training the deep network requires annotated tumor areas. However, accurate tumor annotation puts high demands on medical personnel. The aim of this study is to train a deep network for segmentation by using ellipse box areas surrounding the tumors. In the proposed method, the deep network is trained by using a large number of unannotated tumor images with foreground (FG) and background (BG) ellipse box areas surrounding the tumor and background, and a small number of patients (<20) with annotated tumors. The training is conducted by initial training on two ellipse boxes on unannotated MRIs, followed by refined training on a small number of annotated MRIs. We use a multi-stream U-Net for conducting our experiments, which is an extension of the conventional U-Net. This enables the use of complementary information from multi-modality (e.g., T1, T1ce, T2, and FLAIR) MRIs. To test the feasibility of the proposed approach, experiments and evaluation were conducted on two datasets for glioma segmentation. Segmentation performance on the test sets is then compared with those used on the same network but trained entirely by annotated MRIs. Our experiments show that the proposed method has obtained good tumor segmentation results on the test sets, wherein the dice score on tumor areas is (0.8407, 0.9104), and segmentation accuracy on tumor areas is (83.88%, 88.47%) for the MICCAI BraTS'17 and US datasets, respectively. Comparing the segmented results by using the network trained by all annotated tumors, the drop in the segmentation performance from the proposed approach is (0.0594, 0.0159) in the dice score, and (8.78%, 2.61%) in segmented tumor accuracy for MICCAI and US test sets, which is relatively small. Our case studies have demonstrated that training the network for segmentation by using ellipse box areas in place of all annotated tumors is feasible, and can be considered as an alternative, which is a trade-off between saving medical experts' time annotating tumors and a small drop in segmentation performance.
|
|
| 2. |
- Ali, Muhaddisa Barat, 1986, et al.
(författare)
-
A novel federated deep learning scheme for glioma and its subtype classification
- 2023
-
Ingår i: Frontiers in Neuroscience. - 1662-4548 .- 1662-453X. ; 17
-
Tidskriftsartikel (refereegranskat)abstract
- Background: Deep learning (DL) has shown promising results in molecular-based classification of glioma subtypes from MR images. DL requires a large number of training data for achieving good generalization performance. Since brain tumor datasets are usually small in size, combination of such datasets from different hospitals are needed. Data privacy issue from hospitals often poses a constraint on such a practice. Federated learning (FL) has gained much attention lately as it trains a central DL model without requiring data sharing from different hospitals. Method: We propose a novel 3D FL scheme for glioma and its molecular subtype classification. In the scheme, a slice-based DL classifier, EtFedDyn, is exploited which is an extension of FedDyn, with the key differences on using focal loss cost function to tackle severe class imbalances in the datasets, and on multi-stream network to exploit MRIs in different modalities. By combining EtFedDyn with domain mapping as the pre-processing and 3D scan-based post-processing, the proposed scheme makes 3D brain scan-based classification on datasets from different dataset owners. To examine whether the FL scheme could replace the central learning (CL) one, we then compare the classification performance between the proposed FL and the corresponding CL schemes. Furthermore, detailed empirical-based analysis were also conducted to exam the effect of using domain mapping, 3D scan-based post-processing, different cost functions and different FL schemes. Results: Experiments were done on two case studies: classification of glioma subtypes (IDH mutation and wild-type on TCGA and US datasets in case A) and glioma grades (high/low grade glioma HGG and LGG on MICCAI dataset in case B). The proposed FL scheme has obtained good performance on the test sets (85.46%, 75.56%) for IDH subtypes and (89.28%, 90.72%) for glioma LGG/HGG all averaged on five runs. Comparing with the corresponding CL scheme, the drop in test accuracy from the proposed FL scheme is small (−1.17%, −0.83%), indicating its good potential to replace the CL scheme. Furthermore, the empirically tests have shown that an increased classification test accuracy by applying: domain mapping (0.4%, 1.85%) in case A; focal loss function (1.66%, 3.25%) in case A and (1.19%, 1.85%) in case B; 3D post-processing (2.11%, 2.23%) in case A and (1.81%, 2.39%) in case B and EtFedDyn over FedAvg classifier (1.05%, 1.55%) in case A and (1.23%, 1.81%) in case B with fast convergence, which all contributed to the improvement of overall performance in the proposed FL scheme. Conclusion: The proposed FL scheme is shown to be effective in predicting glioma and its subtypes by using MR images from test sets, with great potential of replacing the conventional CL approaches for training deep networks. This could help hospitals to maintain their data privacy, while using a federated trained classifier with nearly similar performance as that from a centrally trained one. Further detailed experiments have shown that different parts in the proposed 3D FL scheme, such as domain mapping (make datasets more uniform) and post-processing (scan-based classification), are essential.
|
|
| 3. |
- Ali, Muhaddisa Barat, 1986
(författare)
-
Deep Learning Methods for Classification of Glioma and its Molecular Subtypes
- 2021
-
Licentiatavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Diagnosis and timely treatment play an important role in preventing brain tumor growth. Clinicians are unable to reliably predict LGG molecular subtypes from magnetic resonance imaging (MRI) without taking biopsy. Accurate diagnosis prior to surgery would be important. Recently, non-invasive classification methods such as deep learning have shown promising outcome in prediction of glioma-subtypes based upon pre-operative brain scans. However, it needs large amount of annotated medical data on tumors. This thesis investigates methods on the problem of data scarcity, specifically for molecular LGG-subtypes. The focus of this thesis is on two challenges for improving the classification performance of gliomas and its molecular subtypes using MRIs; data augmentation and domain mapping to overcome the lack of data and using data with unavailable GT annotation to tackle the issue of tedious task of manually marking tumor boundaries. Data augmentation includes generating synthetic MR images to enlarge the training data using Generative Adversarial Networks (GANs). Another type of GAN, CycleGAN, is used to enlarge the data size by mapping data from different domains to a target domain. A multi-stream Convolutional Autoencoder (CAE) classifier is proposed with a 2-stage training strategy. To enable MRI data to be used without tumor annotation, ellipse bounding box is proposed that gives comparable classification performance. The thesis comprises of papers addressing the challenging problems of data scarcity and lacking of tumor annotation. These proposed methods can benefit the future research in bringing machine learning tools into clinical practice for non-invasive diagnostics that would assist surgeons and patients in the shared decision making process.
|
|
| 4. |
- Ali, Muhaddisa Barat, 1986
(författare)
-
Deep Learning Methods for Classification of Gliomas and Their Molecular Subtypes, From Central Learning to Federated Learning
- 2023
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- The most common type of brain cancer in adults are gliomas. Under the updated 2016 World Health Organization (WHO) tumor classification in central nervous system (CNS), identification of molecular subtypes of gliomas is important. For low grade gliomas (LGGs), prediction of molecular subtypes by observing magnetic resonance imaging (MRI) scans might be difficult without taking biopsy. With the development of machine learning (ML) methods such as deep learning (DL), molecular based classification methods have shown promising results from MRI scans that may assist clinicians for prognosis and deciding on a treatment strategy. However, DL requires large amount of training datasets with tumor class labels and tumor boundary annotations. Manual annotation of tumor boundary is a time consuming and expensive process. The thesis is based on the work developed in five papers on gliomas and their molecular subtypes. We propose novel methods that provide improved performance. The proposed methods consist of a multi-stream convolutional autoencoder (CAE)-based classifier, a deep convolutional generative adversarial network (DCGAN) to enlarge the training dataset, a CycleGAN to handle domain shift, a novel federated learning (FL) scheme to allow local client-based training with dataset protection, and employing bounding boxes to MRIs when tumor boundary annotations are not available. Experimental results showed that DCGAN generated MRIs have enlarged the original training dataset size and have improved the classification performance on test sets. CycleGAN showed good domain adaptation on multiple source datasets and improved the classification performance. The proposed FL scheme showed a slightly degraded performance as compare to that of central learning (CL) approach while protecting dataset privacy. Using tumor bounding boxes showed to be an alternative approach to tumor boundary annotation for tumor classification and segmentation, with a trade-off between a slight decrease in performance and saving time in manual marking by clinicians. The proposed methods may benefit the future research in bringing DL tools into clinical practice for assisting tumor diagnosis and help the decision making process.
|
|
| 5. |
- Ali, Muhaddisa Barat, 1986, et al.
(författare)
-
Domain Mapping and Deep Learning from Multiple MRI Clinical Datasets for Prediction of Molecular Subtypes in Low Grade Gliomas
- 2020
-
Ingår i: Brain Sciences. - : MDPI AG. - 2076-3425. ; 10:7, s. 1-20
-
Tidskriftsartikel (refereegranskat)abstract
- Brain tumors, such as low grade gliomas (LGG), are molecularly classified which require the surgical collection of tissue samples. The pre-surgical or non-operative identification of LGG molecular type could improve patient counseling and treatment decisions. However, radiographic approaches to LGG molecular classification are currently lacking, as clinicians are unable to reliably predict LGG molecular type using magnetic resonance imaging (MRI) studies. Machine learning approaches may improve the prediction of LGG molecular classification through MRI, however, the development of these techniques requires large annotated data sets. Merging clinical data from different hospitals to increase case numbers is needed, but the use of different scanners and settings can affect the results and simply combining them into a large dataset often have a significant negative impact on performance. This calls for efficient domain adaption methods. Despite some previous studies on domain adaptations, mapping MR images from different datasets to a common domain without affecting subtitle molecular-biomarker information has not been reported yet. In this paper, we propose an effective domain adaptation method based on Cycle Generative Adversarial Network (CycleGAN). The dataset is further enlarged by augmenting more MRIs using another GAN approach. Further, to tackle the issue of brain tumor segmentation that requires time and anatomical expertise to put exact boundary around the tumor, we have used a tight bounding box as a strategy. Finally, an efficient deep feature learning method, multi-stream convolutional autoencoder (CAE) and feature fusion, is proposed for the prediction of molecular subtypes (1p/19q-codeletion and IDH mutation). The experiments were conducted on a total of 161 patients consisting of FLAIR and T1 weighted with contrast enhanced (T1ce) MRIs from two different institutions in the USA and France. The proposed scheme is shown to achieve the test accuracy of 74.81% on 1p/19q codeletion and 81.19% on IDH mutation, with marked improvement over the results obtained without domain mapping. This approach is also shown to have comparable performance to several state-of-the-art methods.
|
|
| 6. |
- Ali, Muhaddisa Barat, 1986, et al.
(författare)
-
Multi-stream Convolutional Autoencoder and 2D Generative Adversarial Network for Glioma Classification
- 2019
-
Ingår i: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). - Cham : Springer International Publishing. - 1611-3349 .- 0302-9743. ; 11678 LNCS, s. 234-245
-
Konferensbidrag (refereegranskat)abstract
- Diagnosis and timely treatment play an important role in preventing brain tumor growth. Deep learning methods have gained much attention lately. Obtaining a large amount of annotated medical data remains a challenging issue. Furthermore, high dimensional features of brain images could lead to over-fitting. In this paper, we address the above issues. Firstly, we propose an architecture for Generative Adversarial Networks to generate good quality synthetic 2D MRIs from multi-modality MRIs (T1 contrast-enhanced, T2, FLAIR). Secondly, we propose a deep learning scheme based on 3-streams of Convolutional Autoencoders (CAEs) followed by sensor information fusion. The rational behind using CAEs is that it may improve glioma classification performance (as comparing with conventional CNNs), since CAEs offer noise robustness and also efficient feature reduction hence possibly reduce the over-fitting. A two-round training strategy is also applied by pre-training on GAN augmented synthetic MRIs followed by refined-training on original MRIs. Experiments on BraTS 2017 dataset have demonstrated the effectiveness of the proposed scheme (test accuracy 92.04%). Comparison with several exiting schemes has provided further support to the proposed scheme.
|
|
| 7. |
- Ali, Muhaddisa Barat, 1986, et al.
(författare)
-
Prediction of glioma‑subtypes: comparison of performance on a DL classifier using bounding box areas versus annotated tumors
- 2022
-
Ingår i: BioMedical Engineering Online. - : Springer Science and Business Media LLC. - 1475-925X .- 2524-4426. ; 4
-
Tidskriftsartikel (refereegranskat)abstract
- Background: For brain tumors, identifying the molecular subtypes from magnetic resonance imaging (MRI) isdesirable, but remains a challenging task. Recent machine learning and deep learning (DL) approaches may help theclassification/prediction of tumor subtypes through MRIs. However, most of these methods require annotated datawith ground truth (GT) tumor areas manually drawn by medical experts. The manual annotation is a time consumingprocess with high demand on medical personnel. As an alternative automatic segmentation is often used. However, itdoes not guarantee the quality and could lead to improper or failed segmented boundaries due to differences in MRIacquisition parameters across imaging centers, as segmentation is an ill‑defined problem. Analogous to visual objecttracking and classification, this paper shifts the paradigm by training a classifier using tumor bounding box areas inMR images. The aim of our study is to see whether it is possible to replace GT tumor areas by tumor bounding boxareas (e.g. ellipse shaped boxes) for classification without a significant drop in performance.Method: In patients with diffuse gliomas, training a deep learning classifier for subtype prediction by employ‑ing tumor regions of interest (ROIs) using ellipse bounding box versus manual annotated data. Experiments wereconducted on two datasets (US and TCGA) consisting of multi‑modality MRI scans where the US dataset containedpatients with diffuse low‑grade gliomas (dLGG) exclusively.Results: Prediction rates were obtained on 2 test datasets: 69.86% for 1p/19q codeletion status on US dataset and79.50% for IDH mutation/wild‑type on TCGA dataset. Comparisons with that of using annotated GT tumor data fortraining showed an average of 3.0% degradation (2.92% for 1p/19q codeletion status and 3.23% for IDH genotype).Conclusion: Using tumor ROIs, i.e., ellipse bounding box tumor areas to replace annotated GT tumor areas for train‑ing a deep learning scheme, cause only a modest decline in performance in terms of subtype prediction. With moredata that can be made available, this may be a reasonable trade‑off where decline in performance may be counter‑acted with more data.
|
|
| 8. |
- de Dios, Eddie, et al.
(författare)
-
Introduction to Deep Learning in Clinical Neuroscience
- 2022
-
Ingår i: Acta Neurochirurgica, Supplement. - Cham : Springer International Publishing. - 2197-8395 .- 0065-1419. ; 134, s. 79-89
-
Bokkapitel (övrigt vetenskapligt/konstnärligt)abstract
- The use of deep learning (DL) is rapidly increasing in clinical neuroscience. The term denotes models with multiple sequential layers of learning algorithms, architecturally similar to neural networks of the brain. We provide examples of DL in analyzing MRI data and discuss potential applications and methodological caveats. Important aspects are data pre-processing, volumetric segmentation, and specific task-performing DL methods, such as CNNs and AEs. Additionally, GAN-expansion and domain mapping are useful DL techniques for generating artificial data and combining several smaller datasets. We present results of DL-based segmentation and accuracy in predicting glioma subtypes based on MRI features. Dice scores range from 0.77 to 0.89. In mixed glioma cohorts, IDH mutation can be predicted with a sensitivity of 0.98 and specificity of 0.97. Results in test cohorts have shown improvements of 5–7% in accuracy, following GAN-expansion of data and domain mapping of smaller datasets. The provided DL examples are promising, although not yet in clinical practice. DL has demonstrated usefulness in data augmentation and for overcoming data variability. DL methods should be further studied, developed, and validated for broader clinical use. Ultimately, DL models can serve as effective decision support systems, and are especially well-suited for time-consuming, detail-focused, and data-ample tasks.
|
|
