Sökning: onr:"swepub:oai:DiVA.org:uu-447807" >
Fast computation of...
Fast computation of mutual information in the frequency domain with applications to global multimodal image alignment
-
- Öfverstedt, Johan (författare)
- Uppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion
-
- Lindblad, Joakim (författare)
- Uppsala universitet,Bildanalys och människa-datorinteraktion,Avdelningen för visuell information och interaktion
-
- Sladoje, Natasa (författare)
- Uppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion
-
(creator_code:org_t)
- Elsevier, 2022
- 2022
- Engelska.
-
Ingår i: Pattern Recognition Letters. - : Elsevier. - 0167-8655 .- 1872-7344. ; 159, s. 196-203
- Relaterad länk:
-
https://doi.org/10.1...
-
visa fler...
-
https://arxiv.org/ab...
-
https://uu.diva-port... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- Multimodal image alignment is the process of finding spatial correspondences between images formed by different imaging techniques or under different conditions, to facilitate heterogeneous data fusion and correlative analysis. The information-theoretic concept of mutual information (MI) is widely used as a similarity measure to guide multimodal alignment processes, where most works have focused on local maximization of MI, which typically works well only for small displacements. This points to a need for global maximization of MI, which has previously been computationally infeasible due to the high run-time complexity of existing algorithms. We propose an efficient algorithm for computing MI for all discrete displacements (formalized as the cross-mutual information function (CMIF)), which is based on cross-correlation computed in the frequency domain. We show that the algorithm is equivalent to a direct method while superior in terms of run-time. Furthermore, we propose a method for multimodal image alignment for transformation models with few degrees of freedom (e.g., rigid) based on the proposed CMIF-algorithm. We evaluate the efficacy of the proposed method on three distinct benchmark datasets, containing remote sensing images, cytological images, and histological images, and we observe excellent success-rates (in recovering known rigid transformations), overall outperforming alternative methods, including local optimization of MI, as well as several recent deep learning-based approaches. We also evaluate the run-times of a GPU implementation of the proposed algorithm and observe speed-ups from 100 to more than 10,000 times for realistic image sizes compared to a GPU implementation of a direct method. Code is shared as open-source at github.com/MIDA-group/globalign.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Medicinteknik -- Medicinsk bildbehandling (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Medical Engineering -- Medical Image Processing (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)
Nyckelord
- Mutual information
- Image alignment
- Global optimization
- Multimodal
- Entropy
- Datoriserad bildbehandling
- Computerized Image Processing
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas