Human-computer collaboration for skin cancer recognition

• The rapid increase in telemedicine coupled with recent advances in diagnostic artificial intelligence (AI) create the imperative to consider the opportunities and risks of inserting AI-based support into new paradigms of care. Here we build on recent achievements in the accuracy of image-based AI for skin cancer diagnosis to address the effects of varied representations of AI-based support across different levels of clinical expertise and multiple clinical workflows. We find that good quality AI-based support of clinical decision-making improves diagnostic accuracy over that of either AI or physicians alone, and that the least experienced clinicians gain the most from AI-based support. We further find that AI-based multiclass probabilities outperformed content-based image retrieval (CBIR) representations of AI in the mobile technology environment, and AI-based support had utility in simulations of second opinions and of telemedicine triage. In addition to demonstrating the potential benefits associated with good quality AI in the hands of non-expert clinicians, we find that faulty AI can mislead the entire spectrum of clinicians, including experts. Lastly, we show that insights derived from AI class-activation maps can inform improvements in human diagnosis. Together, our approach and findings offer a framework for future studies across the spectrum of image-based diagnostics to improve human-computer collaboration in clinical practice. A systematic evaluation of the value of AI-based decision support in skin tumor diagnosis demonstrates the superiority of human-computer collaboration over each individual approach and supports the potential of automated approaches in diagnostic medicine.

Subject headings

NATURVETENSKAP  -- Biologi -- Biokemi och molekylärbiologi (hsv//swe)

NATURAL SCIENCES  -- Biological Sciences -- Biochemistry and Molecular Biology (hsv//eng)

Keyword

classification

accuracy

Biochemistry & Molecular Biology

Cell Biology

Research & Experimental

Medicine

Publication and Content Type

ref (subject category)

art (subject category)