SwePub
Sök i LIBRIS databas

  Extended search

id:"swepub:oai:lup.lub.lu.se:4eac308b-8e3d-4754-a8fd-8fe072b34b4b"
 

Search: id:"swepub:oai:lup.lub.lu.se:4eac308b-8e3d-4754-a8fd-8fe072b34b4b" > Pilot study to eval...

  • 1 of 1
  • Previous record
  • Next record
  •    To hitlist
  • Elfer, KatherineUnited States Food and Drug Administration (author)

Pilot study to evaluate tools to collect pathologist annotations for validating machine learning algorithms

  • Article/chapterEnglish2022

Publisher, publication year, extent ...

  • 2022

Numbers

  • LIBRIS-ID:oai:lup.lub.lu.se:4eac308b-8e3d-4754-a8fd-8fe072b34b4b
  • https://lup.lub.lu.se/record/4eac308b-8e3d-4754-a8fd-8fe072b34b4bURI
  • https://doi.org/10.1117/1.JMI.9.4.047501DOI

Supplementary language notes

  • Language:English
  • Summary in:English

Part of subdatabase

Classification

  • Subject category:art swepub-publicationtype
  • Subject category:ref swepub-contenttype

Notes

  • Purpose: Validation of artificial intelligence (AI) algorithms in digital pathology with a reference standard is necessary before widespread clinical use, but few examples focus on creating a reference standard based on pathologist annotations. This work assesses the results of a pilot study that collects density estimates of stromal tumor-infiltrating lymphocytes (sTILs) in breast cancer biopsy specimens. This work will inform the creation of a validation dataset for the evaluation of AI algorithms fit for a regulatory purpose. Approach: Collaborators and crowdsourced pathologists contributed glass slides, digital images, and annotations. Here, "annotations" refer to any marks, segmentations, measurements, or labels a pathologist adds to a report, image, region of interest (ROI), or biological feature. Pathologists estimated sTILs density in 640 ROIs from hematoxylin and eosin stained slides of 64 patients via two modalities: an optical light microscope and two digital image viewing platforms. Results: The pilot study generated 7373 sTILs density estimates from 29 pathologists. Analysis of annotations found the variability of density estimates per ROI increases with the mean; the root mean square differences were 4.46, 14.25, and 26.25 as the mean density ranged from 0% to 10%, 11% to 40%, and 41% to 100%, respectively. The pilot study informs three areas of improvement for future work: technical workflows, annotation platforms, and agreement analysis methods. Upgrades to the workflows and platforms will improve operability and increase annotation speed and consistency. Conclusions: Exploratory data analysis demonstrates the need to develop new statistical approaches for agreement. The pilot study dataset and analysis methods are publicly available to allow community feedback. The development and results of the validation dataset will be publicly available to serve as an instructive tool that can be replicated by developers and researchers.

Subject headings and genre

Added entries (persons, corporate bodies, meetings, titles ...)

  • Dudgeon, SarahYale University (author)
  • Garcia, VictorUnited States Food and Drug Administration (author)
  • Blenman, KimYale University (author)
  • Hytopoulos, EvangelosiRhythm Technologies Inc. (author)
  • Wen, SiUnited States Food and Drug Administration (author)
  • Li, XiaoxianEmory University (author)
  • Ly, AmyMassachusetts General Hospital (author)
  • Werness, BruceInova Health System (author)
  • Sheth, Manasi SUnited States Food and Drug Administration (author)
  • Amgad, Mohamed (author)
  • Gupta, Rajarsi (author)
  • Saltz, Joel (author)
  • Hanna, Matthew G (author)
  • Ehinger, AnnaLund University,Lunds universitet,LUCC: Lunds universitets cancercentrum,Övriga starka forskningsmiljöer,Patologi, Lund,Sektion V,Institutionen för kliniska vetenskaper, Lund,Medicinska fakulteten,LUCC: Lund University Cancer Centre,Other Strong Research Environments,Pathology, Lund,Section V,Department of Clinical Sciences, Lund,Faculty of Medicine,Region Skåne(Swepub:lu)pat-amm (author)
  • Peeters, Dieter (author)
  • Salgado, Roberto (author)
  • Gallas, Brandon D (author)
  • United States Food and Drug AdministrationYale University (creator_code:org_t)

Related titles

  • In:Journal of Medical Imaging9:4, s. 1-142329-4302

Internet link

Find in a library

To the university's database

  • 1 of 1
  • Previous record
  • Next record
  •    To hitlist

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

 
pil uppåt Close

Copy and save the link in order to return to this view