The Effect of Within-Bag Sampling on End-to-End Multiple Instance Learning

Koriakina, Nadezhda,1991-Uppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion,MIDA (författare)

End-to-end multiple instance learning (MIL) is an important concept with a wide range of applications. It is gaining increased popularity in the (bio)medical imaging community since it may provide a possibility to, while relying only on weak labels assigned to large regions, obtain more fine-grained information. However, processing very large bags in end-to-end MIL is problematic due to computer memory constraints. We propose within-bag sampling as one way of applying end-to-end MIL methods on very large data. We explore how different levels of sampling affect the performance of a well-known high-performing end-to-end attention-based MIL method, to understand the conditions when sampling can be utilized. We compose two new datasets tailored for the purpose of the study, and propose a strategy for sampling during MIL inference to arrive at reliable bag labels as well as instance level attention weights. We perform experiments without and with different levels of sampling, on the two publicly available datasets, and for a range of learning settings. We observe that in most situations the proposed bag-level sampling can be applied to end-to-end MIL without performance loss, supporting its confident usage to enable end-to-end MIL also in scenarios with very large bags. We share the code as open source at https://github.com/MIDA-group/SampledABMIL

Sladoje, NatasaUppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion(Swepub:uu)namat934 (författare)
Lindblad, JoakimUppsala universitet,Bildanalys och människa-datorinteraktion,Avdelningen för visuell information och interaktion(Swepub:uu)joali534 (författare)
Uppsala universitetAvdelningen för visuell information och interaktion (creator_code:org_t)

Ingår i:Proceedings of the 12th International Symposium on Image and Signal Processing and Analysis (ISPA): Institute of Electrical and Electronics Engineers (IEEE), s. 183-18897816654264049781665426398

Av författaren/redakt...: Koriakina, Nadez ...; Sladoje, Natasa; Lindblad, Joakim

Om ämnet

TEKNIK OCH TEKNOLOGIER: TEKNIK OCH TEKNO ...; och Annan teknik; och Övrig annan tekn ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.