| 1. |
- Dong, Mengjin, et al.
(författare)
-
DeepAtrophy : Teaching a neural network to detect progressive changes in longitudinal MRI of the hippocampal region in Alzheimer's disease
- 2021
-
Ingår i: NeuroImage. - : Elsevier BV. - 1053-8119. ; 243
-
Tidskriftsartikel (refereegranskat)abstract
- Measures of change in hippocampal volume derived from longitudinal MRI are a well-studied biomarker of disease progression in Alzheimer's disease (AD) and are used in clinical trials to track therapeutic efficacy of disease-modifying treatments. However, longitudinal MRI change measures based on deformable registration can be confounded by MRI artifacts, resulting in over-estimation or underestimation of hippocampal atrophy. For example, the deformation-based-morphometry method ALOHA (Das et al., 2012) finds an increase in hippocampal volume in a substantial proportion of longitudinal scan pairs from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study, unexpected, given that the hippocampal gray matter is lost with age and disease progression. We propose an alternative approach to quantify disease progression in the hippocampal region: to train a deep learning network (called DeepAtrophy) to infer temporal information from longitudinal scan pairs. The underlying assumption is that by learning to derive time-related information from scan pairs, the network implicitly learns to detect progressive changes that are related to aging and disease progression. Our network is trained using two categorical loss functions: one that measures the network's ability to correctly order two scans from the same subject, input in arbitrary order; and another that measures the ability to correctly infer the ratio of inter-scan intervals between two pairs of same-subject input scans. When applied to longitudinal MRI scan pairs from subjects unseen during training, DeepAtrophy achieves greater accuracy in scan temporal ordering and interscan interval inference tasks than ALOHA (88.5% vs. 75.5% and 81.1% vs. 75.0%, respectively). A scalar measure of time-related change in a subject level derived from DeepAtrophy is then examined as a biomarker of disease progression in the context of AD clinical trials. We find that this measure performs on par with ALOHA in discriminating groups of individuals at different stages of the AD continuum. Overall, our results suggest that using deep learning to infer temporal information from longitudinal MRI of the hippocampal region has good potential as a biomarker of disease progression, and hints that combining this approach with conventional deformation-based morphometry algorithms may lead to improved biomarkers in the future.
|
|
| 2. |
- Xie, Long, et al.
(författare)
-
Deep Label Fusion : A 3D End-To-End Hybrid Multi-atlas Segmentation and Deep Learning Pipeline
- 2021
-
Ingår i: Information Processing in Medical Imaging - 27th International Conference, IPMI 2021, Proceedings. - Cham : Springer International Publishing. - 0302-9743 .- 1611-3349. - 9783030781903 ; 12729 LNCS, s. 428-439
-
Konferensbidrag (refereegranskat)abstract
- Deep learning (DL) is the state-of-the-art methodology in various medical image segmentation tasks. However, it requires relatively large amounts of manually labeled training data, which may be infeasible to generate in some applications. In addition, DL methods have relatively poor generalizability to out-of-sample data. Multi-atlas segmentation (MAS), on the other hand, has promising performance using limited amounts of training data and good generalizability. A hybrid method that integrates the high accuracy of DL and good generalizability of MAS is highly desired and could play an important role in segmentation problems where manually labeled data is hard to generate. Most of the prior work focuses on improving single components of MAS using DL rather than directly optimizing the final segmentation accuracy via an end-to-end pipeline. Only one study explored this idea in binary segmentation of 2D images, but it remains unknown whether it generalizes well to multi-class 3D segmentation problems. In this study, we propose a 3D end-to-end hybrid pipeline, named deep label fusion (DLF), that takes advantage of the strengths of MAS and DL. Experimental results demonstrate that DLF yields significant improvements over conventional label fusion methods and U-Net, a direct DL approach, in the context of segmenting medial temporal lobe subregions using 3T T1-weighted and T2-weighted MRI. Further, when applied to an unseen similar dataset acquired in 7T, DLF maintains its superior performance, which demonstrates its good generalizability.
|
|
| 3. |
- Xie, Long, et al.
(författare)
-
Deep label fusion : A generalizable hybrid multi-atlas and deep convolutional neural network for medical image segmentation
- 2023
-
Ingår i: Medical Image Analysis. - : Elsevier BV. - 1361-8415. ; 83
-
Tidskriftsartikel (refereegranskat)abstract
- Deep convolutional neural networks (DCNN) achieve very high accuracy in segmenting various anatomical structures in medical images but often suffer from relatively poor generalizability. Multi-atlas segmentation (MAS), while less accurate than DCNN in many applications, tends to generalize well to unseen datasets with different characteristics from the training dataset. Several groups have attempted to integrate the power of DCNN to learn complex data representations and the robustness of MAS to changes in image characteristics. However, these studies primarily focused on replacing individual components of MAS with DCNN models and reported marginal improvements in accuracy. In this study we describe and evaluate a 3D end-to-end hybrid MAS and DCNN segmentation pipeline, called Deep Label Fusion (DLF). The DLF pipeline consists of two main components with learnable weights, including a weighted voting subnet that mimics the MAS algorithm and a fine-tuning subnet that corrects residual segmentation errors to improve final segmentation accuracy. We evaluate DLF on five datasets that represent a diversity of anatomical structures (medial temporal lobe subregions and lumbar vertebrae) and imaging modalities (multi-modality, multi-field-strength MRI and Computational Tomography). These experiments show that DLF achieves comparable segmentation accuracy to nnU-Net (Isensee et al., 2020), the state-of-the-art DCNN pipeline, when evaluated on a dataset with similar characteristics to the training datasets, while outperforming nnU-Net on tasks that involve generalization to datasets with different characteristics (different MRI field strength or different patient population). DLF is also shown to consistently improve upon conventional MAS methods. In addition, a modality augmentation strategy tailored for multimodal imaging is proposed and demonstrated to be beneficial in improving the segmentation accuracy of learning-based methods, including DLF and DCNN, in missing data scenarios in test time as well as increasing the interpretability of the contribution of each individual modality.
|
|
| 4. |
- Yushkevich, Paul A., et al.
(författare)
-
Three-dimensional mapping of neurofibrillary tangle burden in the human medial temporal lobe
- 2021
-
Ingår i: Brain. - : Oxford University Press (OUP). - 0006-8950 .- 1460-2156. ; 144:9, s. 2784-2797
-
Tidskriftsartikel (refereegranskat)abstract
- Tau protein neurofibrillary tangles are closely linked to neuronal/synaptic loss and cognitive decline in Alzheimer's disease and related dementias. Our knowledge of the pattern of neurofibrillary tangle progression in the human brain, critical to the development of imaging biomarkers and interpretation of in vivo imaging studies in Alzheimer's disease, is based on conventional two-dimensional histology studies that only sample the brain sparsely. To address this limitation, ex vivo MRI and dense serial histological imaging in 18 human medial temporal lobe specimens (age 75.3 ± 11.4 years, range 45 to 93) were used to construct three-dimensional quantitative maps of neurofibrillary tangle burden in the medial temporal lobe at individual and group levels. Group-level maps were obtained in the space of an in vivo brain template, and neurofibrillary tangles were measured in specific anatomical regions defined in this template. Three-dimensional maps of neurofibrillary tangle burden revealed significant variation along the anterior-posterior axis. While early neurofibrillary tangle pathology is thought to be confined to the transentorhinal region, we found similar levels of burden in this region and other medial temporal lobe subregions, including amygdala, temporopolar cortex, and subiculum/cornu ammonis 1 hippocampal subfields. Overall, the three-dimensional maps of neurofibrillary tangle burden presented here provide more complete information about the distribution of this neurodegenerative pathology in the region of the cortex where it first emerges in Alzheimer's disease, and may help inform the field about the patterns of pathology spread, as well as support development and validation of neuroimaging biomarkers.
|
|
