1. |
|
|
2. |
|
|
3. |
|
|
4. |
|
|
5. |
- Amgad, M, et al.
(author)
-
Report on computational assessment of Tumor Infiltrating Lymphocytes from the International Immuno-Oncology Biomarker Working Group
- 2020
-
In: NPJ breast cancer. - : Springer Science and Business Media LLC. - 2374-4677. ; 6:1, s. 16-
-
Journal article (peer-reviewed)abstract
- Assessment of tumor-infiltrating lymphocytes (TILs) is increasingly recognized as an integral part of the prognostic workflow in triple-negative (TNBC) and HER2-positive breast cancer, as well as many other solid tumors. This recognition has come about thanks to standardized visual reporting guidelines, which helped to reduce inter-reader variability. Now, there are ripe opportunities to employ computational methods that extract spatio-morphologic predictive features, enabling computer-aided diagnostics. We detail the benefits of computational TILs assessment, the readiness of TILs scoring for computational assessment, and outline considerations for overcoming key barriers to clinical translation in this arena. Specifically, we discuss: 1. ensuring computational workflows closely capture visual guidelines and standards; 2. challenges and thoughts standards for assessment of algorithms including training, preanalytical, analytical, and clinical validation; 3. perspectives on how to realize the potential of machine learning models and to overcome the perceptual and practical limits of visual scoring.
|
|
6. |
- Smit, Marloes A., et al.
(author)
-
Deep learning based tumor–stroma ratio scoring in colon cancer correlates with microscopic assessment
- 2023
-
In: Journal of Pathology Informatics. - : Elsevier B.V.. - 2229-5089 .- 2153-3539. ; 14
-
Journal article (peer-reviewed)abstract
- Background: The amount of stroma within the primary tumor is a prognostic parameter for colon cancer patients. This phenomenon can be assessed using the tumor–stroma ratio (TSR), which classifies tumors in stroma-low (≤50% stroma) and stroma-high (>50% stroma). Although the reproducibility for TSR determination is good, improvement might be expected from automation. The aim of this study was to investigate whether the scoring of the TSR in a semi- and fully automated method using deep learning algorithms is feasible. Methods: A series of 75 colon cancer slides were selected from a trial series of the UNITED study. For the standard determination of the TSR, 3 observers scored the histological slides. Next, the slides were digitized, color normalized, and the stroma percentages were scored using semi- and fully automated deep learning algorithms. Correlations were determined using intraclass correlation coefficients (ICCs) and Spearman rank correlations. Results: 37 (49%) cases were classified as stroma-low and 38 (51%) as stroma-high by visual estimation. A high level of concordance between the 3 observers was reached, with ICCs of 0.91, 0.89, and 0.94 (all P < .001). Between visual and semi-automated assessment the ICC was 0.78 (95% CI 0.23–0.91, P-value 0.005), with a Spearman correlation of 0.88 (P < .001). Spearman correlation coefficients above 0.70 (N=3) were observed for visual estimation versus the fully automated scoring procedures. Conclusion: Good correlations were observed between standard visual TSR determination and semi- and fully automated TSR scores. At this point, visual examination has the highest observer agreement, but semi-automated scoring could be helpful to support pathologists. © 2023 The Authors
|
|
7. |
- van der Kamp, Ananda, et al.
(author)
-
Artificial Intelligence in Pediatric Pathology: The Extinction of a Medical Profession or the Key to a Bright Future?
- 2022
-
In: Pediatric and Developmental Pathology. - : SAGE PUBLICATIONS INC. - 1093-5266 .- 1615-5742. ; 25:4, s. 380-387
-
Research review (peer-reviewed)abstract
- Artificial Intelligence (AI) has become of increasing interest over the past decade. While digital image analysis (DIA) is already being used in radiology, it is still in its infancy in pathology. One of the reasons is that large-scale digitization of glass slides has only recently become available. With the advent of digital slide scanners, that digitize glass slides into whole slide images, many labs are now in a transition phase towards digital pathology. However, only few departments worldwide are currently fully digital. Digital pathology provides the ability to annotate large datasets and train computers to develop and validate robust algorithms, similar to radiology. In this opinionated overview, we will give a brief introduction into AI in pathology, discuss the potential positive and negative implications and speculate about the future role of AI in the field of pediatric pathology.
|
|
8. |
|
|
9. |
|
|
10. |
- Farris, Alton B., et al.
(author)
-
Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments
- 2023
-
In: Transplant International. - : FRONTIERS MEDIA SA. - 0934-0874 .- 1432-2277. ; 36
-
Journal article (peer-reviewed)abstract
- The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.
|
|
11. |
- Ogony, Joshua, et al.
(author)
-
Towards defining morphologic parameters of normal parous and nulliparous breast tissues by artificial intelligence
- 2022
-
In: Breast Cancer Research. - : BMC. - 1465-5411 .- 1465-542X. ; 24:1
-
Journal article (peer-reviewed)abstract
- Background Breast terminal duct lobular units (TDLUs), the source of most breast cancer (BC) precursors, are shaped by age-related involution, a gradual process, and postpartum involution (PPI), a dramatic inflammatory process that restores baseline microanatomy after weaning. Dysregulated PPI is implicated in the pathogenesis of postpartum BCs. We propose that assessment of TDLUs in the postpartum period may have value in risk estimation, but characteristics of these tissues in relation to epidemiological factors are incompletely described. Methods Using validated Artificial Intelligence and morphometric methods, we analyzed digitized images of tissue sections of normal breast tissues stained with hematoxylin and eosin from donors <= 45 years from the Komen Tissue Bank (180 parous and 545 nulliparous). Metrics assessed by AI, included: TDLU count; adipose tissue fraction; mean acini count/TDLU; mean dilated acini; mean average acini area; mean "capillary" area; mean epithelial area; mean ratio of epithelial area versus intralobular stroma; mean mononuclear cell count (surrogate of immune cells); mean fat area proximate to TDLUs and TDLU area. We compared epidemiologic characteristics collected via questionnaire by parity status and race, using a Wilcoxon rank sum test or Fishers exact test. Histologic features were compared between nulliparous and parous women (overall and by time between last birth and donation [recent birth: <= 5 years versus remote birth: > 5 years]) using multivariable regression models. Results Normal breast tissues of parous women contained significantly higher TDLU counts and acini counts, more frequent dilated acini, higher mononuclear cell counts in TDLUs and smaller acini area per TDLU than nulliparas (all multivariable analyses p < 0.001). Differences in TDLU counts and average acini size persisted for > 5 years postpartum, whereas increases in immune cells were most marked <= 5 years of a birth. Relationships were suggestively modified by several other factors, including demographic and reproductive characteristics, ethanol consumption and breastfeeding duration. Conclusions Our study identified sustained expansion of TDLU numbers and reduced average acini area among parous versus nulliparous women and notable increases in immune responses within five years following childbirth. Further, we show that quantitative characteristics of normal breast samples vary with demographic features and BC risk factors.
|
|
12. |
- Balkenhol, Maschenka C. A., et al.
(author)
-
Histological subtypes in triple negative breast cancer are associated with specific information on survival
- 2020
-
In: Annals of Diagnostic Pathology. - : ELSEVIER SCIENCE INC. - 1092-9134 .- 1532-8198. ; 46
-
Journal article (peer-reviewed)abstract
- Much research has focused on finding novel prognostic biomarkers for triple negative breast cancer (TNBC), whereas only scattered information about the relation between histopathological features and survival in TNBC is available. This study aims to explore the prognostic value of histological subtypes in TNBC. A multicenter retrospective TNBC cohort was established from five Dutch hospitals. All non-neoadjuvantly treated, stage I-III patients with estrogen receptor, progesterone receptor and human epidermal growth factor receptor 2 negative breast cancer diagnosed between 2006 and 2014 were included. Clinical and follow-up data (overall survival; OS, relapse free survival; RFS) were retrieved and a central histopathological review was performed. Of 597 patients included (median follow up 62.8 months, median age at diagnosis 56.0 years), 19.4% developed a recurrence. The most prevalent histological subtypes were carcinoma of no special type (NST) (88.4%), metaplastic carcinoma (4.4%) and lobular carcinoma (3.4%). Collectively, tumors of special type were associated with a worse RFS and OS compared to carcinoma NST (RFS HR 1.89; 95% CI 1.18-3.03; p = 0.008; OS HR 1.94; 95% CI 1.28-2.92; p = 0.002). Substantial differences in survival, however, were present between the different histological subtypes. In the presented TNBC cohort, special histological subtype was in general associated with less favorable survival. However, within the group of tumors of special type there were differences in survival between the different subtypes. Accurate histological examination can provide specific prognostic information that may potentially enable more personalized treatment and surveillance regimes for TNBC patients.
|
|
13. |
- Bokhorst, J. M., et al.
(author)
-
Assessment of individual tumor buds using keratin immunohistochemistry: moderate interobserver agreement suggests a role for machine learning
- 2020
-
In: Modern Pathology. - : NATURE PUBLISHING GROUP. - 0893-3952 .- 1530-0285. ; 33:5, s. 825-833
-
Journal article (peer-reviewed)abstract
- Tumor budding is a promising and cost-effective biomarker with strong prognostic value in colorectal cancer. However, challenges related to interobserver variability persist. Such variability may be reduced by immunohistochemistry and computer-aided tumor bud selection. Development of computer algorithms for this purpose requires unequivocal examples of individual tumor buds. As such, we undertook a large-scale, international, and digital observer study on individual tumor bud assessment. From a pool of 46 colorectal cancer cases with tumor budding, 3000 tumor bud candidates were selected, largely based on digital image analysis algorithms. For each candidate bud, an image patch (size 256 x 256 mu m) was extracted from a pan cytokeratin-stained whole-slide image. Members of an International Tumor Budding Consortium (n = 7) were asked to categorize each candidate as either (1) tumor bud, (2) poorly differentiated cluster, or (3) neither, based on current definitions. Agreement was assessed with Cohens and Fleiss Kappa statistics. Fleiss Kappa showed moderate overall agreement between observers (0.42 and 0.51), while Cohens Kappas ranged from 0.25 to 0.63. Complete agreement by all seven observers was present for only 34% of the 3000 tumor bud candidates, while 59% of the candidates were agreed on by at least five of the seven observers. Despite reports of moderate-to-substantial agreement with respect to tumor budding grade, agreement with respect to individual pan cytokeratin-stained tumor buds is moderate at most. A machine learning approach may prove especially useful for a more robust assessment of individual tumor buds.
|
|
14. |
|
|
15. |
- Geessink, Oscar G. F., et al.
(author)
-
Computer aided quantification of intratumoral stroma yields an independent prognosticator in rectal cancer
- 2019
-
In: Cellular Oncology. - : SPRINGER. - 2211-3428 .- 2211-3436. ; 42:3, s. 331-341
-
Journal article (peer-reviewed)abstract
- PurposeTumor-stroma ratio (TSR) serves as an independent prognostic factor in colorectal cancer and other solid malignancies. The recent introduction of digital pathology in routine tissue diagnostics holds opportunities for automated TSR analysis. We investigated the potential of computer-aided quantification of intratumoral stroma in rectal cancer whole-slide images.MethodsHistological slides from 129 rectal adenocarcinoma patients were analyzed by two experts who selected a suitable stroma hot-spot and visually assessed TSR. A semi-automatic method based on deep learning was trained to segment all relevant tissue types in rectal cancer histology and subsequently applied to the hot-spots provided by the experts. Patients were assigned to a stroma-high or stroma-low group by both TSR methods (visual and automated). This allowed for prognostic comparison between the two methods in terms of disease-specific and disease-free survival times.ResultsWith stroma-low as baseline, automated TSR was found to be prognostic independent of age, gender, pT-stage, lymph node status, tumor grade, and whether adjuvant therapy was given, both for disease-specific survival (hazard ratio=2.48 (95% confidence interval 1.29-4.78)) and for disease-free survival (hazard ratio=2.05 (95% confidence interval 1.11-3.78)). Visually assessed TSR did not serve as an independent prognostic factor in multivariate analysis.ConclusionsThis work shows that TSR is an independent prognosticator in rectal cancer when assessed automatically in user-provided stroma hot-spots. The deep learning-based technology presented here may be a significant aid to pathologists in routine diagnostics.
|
|
16. |
- Hermsen, Meyke, et al.
(author)
-
Deep Learning-Based Histopathologic Assessment of Kidney Tissue
- 2019
-
In: Journal of the American Society of Nephrology. - : AMER SOC NEPHROLOGY. - 1046-6673 .- 1533-3450. ; 30:10, s. 1968-1979
-
Journal article (peer-reviewed)abstract
- Background The development of deep neural networks is facilitating more advanced digital analysis of histopathologic images. We trained a convolutional neural network for multiclass segmentation of digitized kidney tissue sections stained with periodic acid-Schiff (PAS). Methods We trained the network using multiclass annotations from 40 whole-slide images of stained kidney transplant biopsies and applied it to four independent data sets. We assessed multiclass segmentation performance by calculating Dice coefficients for ten tissue classes on ten transplant biopsies from the Radboud University Medical Center in Nijmegen, The Netherlands, and on ten transplant biopsies from an external center for validation. We also fully segmented 15 nephrectomy samples and calculated the networks glomerular detection rates and compared network-based measures with visually scored histologic components (Banff classification) in 82 kidney transplant biopsies. Results The weighted mean Dice coefficients of all classes were 0.80 and 0.84 in ten kidney transplant biopsies from the Radboud center and the external center, respectively. The best segmented class was "glomeruli" in both data sets (Dice coefficients, 0.95 and 0.94, respectively), followed by "tubuli combined" and "interstitium." The network detected 92.7% of all glomeruli in nephrectomy samples, with 10.4% false positives. In whole transplant biopsies, the mean intraclass correlation coefficient for glomerular counting performed by pathologists versus the network was 0.94. We found significant correlations between visually scored histologic components and network-based measures. Conclusions This study presents the first convolutional neural network for multiclass segmentation of PAS-stained nephrectomy samples and transplant biopsies. Our network may have utility for quantitative studies involving kidney histopathology across centers and provide opportunities for deep learning applications in routine diagnostics.
|
|
17. |
- Hermsen, Meyke, et al.
(author)
-
Quantitative assessment of inflammatory infiltrates in kidney transplant biopsies using multiplex tyramide signal amplification and deep learning
- 2021
-
In: Laboratory Investigation. - : Springer Nature. - 0023-6837 .- 1530-0307. ; 101:8, s. 970-982
-
Journal article (peer-reviewed)abstract
- Delayed graft function (DGF) is a strong risk factor for development of interstitial fibrosis and tubular atrophy (IFTA) in kidney transplants. Quantitative assessment of inflammatory infiltrates in kidney biopsies of DGF patients can reveal predictive markers for IFTA development. In this study, we combined multiplex tyramide signal amplification (mTSA) and convolutional neural networks (CNNs) to assess the inflammatory microenvironment in kidney biopsies of DGF patients (n = 22) taken at 6 weeks post-transplantation. Patients were stratified for IFTA development (<10% versus >= 10%) from 6 weeks to 6 months post-transplantation, based on histopathological assessment by three kidney pathologists. One mTSA panel was developed for visualization of capillaries, T- and B-lymphocytes and macrophages and a second mTSA panel for T-helper cell and macrophage subsets. The slides were multi spectrally imaged and custom-made python scripts enabled conversion to artificial brightfield whole-slide images (WSI). We used an existing CNN for the detection of lymphocytes with cytoplasmatic staining patterns in immunohistochemistry and developed two new CNNs for the detection of macrophages and nuclear-stained lymphocytes. F1-scores were 0.77 (nuclear-stained lymphocytes), 0.81 (cytoplasmatic-stained lymphocytes), and 0.82 (macrophages) on a test set of artificial brightfield WSI. The CNNs were used to detect inflammatory cells, after which we assessed the peritubular capillary extent, cell density, cell ratios, and cell distance in the two patient groups. In this cohort, distance of macrophages to other immune cells and peritubular capillary extent did not vary significantly at 6 weeks post-transplantation between patient groups. CD163(+) cell density was higher in patients with >= 10% IFTA development 6 months post-transplantation (p < 0.05). CD3(+)CD8(-)/CD3(+)CD8(+) ratios were higher in patients with <10% IFTA development (p < 0.05). We observed a high correlation between CD163(+) and CD4(+)GATA3(+) cell density (R = 0.74, p < 0.001). Our study demonstrates that CNNs can be used to leverage reliable, quantitative results from mTSA-stained, multi spectrally imaged slides of kidney transplant biopsies. This study describes a methodology to assess the microenvironment in sparse tissue samples. Deep learning, multiplex immunohistochemistry, and mathematical image processing techniques were incorporated to quantify lymphocytes, macrophages, and capillaries in kidney transplant biopsies of delayed graft function patients. The quantitative results were used to assess correlations with development of interstitial fibrosis and tubular atrophy.
|
|
18. |
- Leon-Ferre, Roberto A., et al.
(author)
-
Automated mitotic spindle hotspot counts are highly associated with clinical outcomes in systemically untreated early-stage triple-negative breast cancer
- 2024
-
In: npj Breast Cancer. - : NATURE PORTFOLIO. - 2374-4677. ; 10:1
-
Journal article (peer-reviewed)abstract
- Operable triple-negative breast cancer (TNBC) has a higher risk of recurrence and death compared to other subtypes. Tumor size and nodal status are the primary clinical factors used to guide systemic treatment, while biomarkers of proliferation have not demonstrated value. Recent studies suggest that subsets of TNBC have a favorable prognosis, even without systemic therapy. We evaluated the association of fully automated mitotic spindle hotspot (AMSH) counts with recurrence-free (RFS) and overall survival (OS) in two separate cohorts of patients with early-stage TNBC who did not receive systemic therapy. AMSH counts were obtained from areas with the highest mitotic density in digitized whole slide images processed with a convolutional neural network trained to detect mitoses. In 140 patients from the Mayo Clinic TNBC cohort, AMSH counts were significantly associated with RFS and OS in a multivariable model controlling for nodal status, tumor size, and tumor-infiltrating lymphocytes (TILs) (p < 0.0001). For every 10-point increase in AMSH counts, there was a 16% increase in the risk of an RFS event (HR 1.16, 95% CI 1.08-1.25), and a 7% increase in the risk of death (HR 1.07, 95% CI 1.00-1.14). We corroborated these findings in a separate cohort of systemically untreated TNBC patients from Radboud UMC in the Netherlands. Our findings suggest that AMSH counts offer valuable prognostic information in patients with early-stage TNBC who did not receive systemic therapy, independent of tumor size, nodal status, and TILs. If further validated, AMSH counts could help inform future systemic therapy de-escalation strategies.
|
|
19. |
- Sherman, Mark E., et al.
(author)
-
Serum hormone levels and normal breast histology among premenopausal women
- 2022
-
In: Breast Cancer Research and Treatment. - New York, NY, United States : Springer. - 0167-6806 .- 1573-7217. ; 194, s. 149-158
-
Journal article (peer-reviewed)abstract
- Purpose Breast terminal duct lobular units (TDLUs) are the main source of breast cancer (BC) precursors. Higher serum concentrations of hormones and growth factors have been linked to increased TDLU numbers and to elevated BC risk, with variable effects by menopausal status. We assessed associations of circulating factors with breast histology among premenopausal women using artificial intelligence (AI) and preliminarily tested whether parity modifies associations.Methods Pathology AI analysis was performed on 316 digital images of H&E-stained sections of normal breast tissues from Komen Tissue Bank donors ages ≤ 45 years to assess 11 quantitative metrics. Associations of circulating factors with AI metrics were assessed using regression analyses, with inclusion of interaction terms to assess effect modification.Results Higher prolactin levels were related to larger TDLU area (p<0.001) and increased presence of adipose tissue proximate to TDLUs (p<0.001), with less significant positive associations for acini counts (p = 0.012), dilated acini (p = 0.043), capillary area (p = 0.014), epithelial area (p = 0.007), and mononuclear cell counts (p = 0.017). Testosterone levels were associated with increased TDLU counts (p<0.001), irrespective of parity, but associations differed by adipose tissue content. AI data for TDLU counts generally agreed with prior visual assessments.Conclusion Among premenopausal women, serum hormone levels linked to BC risk were also associated with quantitative features of normal breast tissue. These relationships were suggestively modified by parity status and tissue composition. We conclude that the microanatomic features of normal breast tissue may represent a marker of BC risk.
|
|
20. |
- Wasmann, Jan-Willem A., et al.
(author)
-
Computational Audiology: New Approaches to Advance Hearing Health Care in the Digital Age
- 2021
-
In: Ear and Hearing. - : LIPPINCOTT WILLIAMS & WILKINS. - 0196-0202 .- 1538-4667. ; 42:6, s. 1499-1507
-
Journal article (peer-reviewed)abstract
- The global digital transformation enables computational audiology for advanced clinical applications that can reduce the global burden of hearing loss. In this article, we describe emerging hearing-related artificial intelligence applications and argue for their potential to improve access, precision, and efficiency of hearing health care services. Also, we raise awareness of risks that must be addressed to enable a safe digital transformation in audiology. We envision a future where computational audiology is implemented via interoperable systems using shared data and where health care providers adopt expanded roles within a network of distributed expertise. This effort should take place in a health care system where privacy, responsibility of each stakeholder, and patients safety and autonomy are all guarded by design.
|
|
21. |
- de Bel, Thomas, et al.
(author)
-
Automated quantification of levels of breast terminal duct lobular (TDLU) involution using deep learning
- 2022
-
In: npj Breast Cancer. - : Nature Portfolio. - 2374-4677. ; 8:1
-
Journal article (peer-reviewed)abstract
- Convolutional neural networks (CNNs) offer the potential to generate comprehensive quantitative analysis of histologic features. Diagnostic reporting of benign breast disease (BBD) biopsies is usually limited to subjective assessment of the most severe lesion in a sample, while ignoring the vast majority of tissue features, including involution of background terminal duct lobular units (TDLUs), the structures from which breast cancers arise. Studies indicate that increased levels of age-related TDLU involution in BBD biopsies predict lower breast cancer risk, and therefore its assessment may have potential value in risk assessment and management. However, assessment of TDLU involution is time-consuming and difficult to standardize and quantitate. Accordingly, we developed a CNN to enable automated quantitative measurement of TDLU involution and tested its performance in 174 specimens selected from the pathology archives at Mayo Clinic, Rochester, MN. The CNN was trained and tested on a subset of 33 biopsies, delineating important tissue types. Nine quantitative features were extracted from delineated TDLU regions. Our CNN reached an overall dice-score of 0.871 (+/- 0.049) for tissue classes versus reference standard annotation. Consensus of four reviewers scoring 705 images for TDLU involution demonstrated substantial agreement with the CNN method (unweighted kappa = 0.747 +/- 0.01). Quantitative involution measures showed anticipated associations with BBD histology, breast cancer risk, breast density, menopausal status, and breast cancer risk prediction scores (p < 0.05). Our work demonstrates the potential to improve risk prediction for women with BBD biopsies by applying CNN approaches to generate automated quantitative evaluation of TDLU involution.
|
|