Sökning: onr:"swepub:oai:DiVA.org:liu-153489" >
Synthetic Data Gene...
Synthetic Data Generation for End-to-End Thermal Infrared Tracking
-
- Zhang, Lichao (författare)
- Univ Autonoma Barcelona, Spain
-
- Gonzalez-Garcia, Abel (författare)
- Univ Autonoma Barcelona, Spain
-
- van de Weijer, Joost (författare)
- Univ Autonoma Barcelona, Spain
-
visa fler...
-
- Danelljan, Martin (författare)
- Linköpings universitet,Datorseende,Tekniska fakulteten
-
- Khan, Fahad (författare)
- Linköpings universitet,Datorseende,Tekniska fakulteten,Incept Inst Artificial Intelligence, U Arab Emirates
-
visa färre...
-
(creator_code:org_t)
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2019
- 2019
- Engelska.
-
Ingår i: IEEE Transactions on Image Processing. - : IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC. - 1057-7149 .- 1941-0042. ; 28:4, s. 1837-1850
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- The usage of both off-the-shelf and end-to-end trained deep networks have significantly improved the performance of visual tracking on RGB videos. However, the lack of large labeled datasets hampers the usage of convolutional neural networks for tracking in thermal infrared (TIR) images. Therefore, most state-of-the-art methods on tracking for TIR data are still based on handcrafted features. To address this problem, we propose to use image-to-image translation models. These models allow us to translate the abundantly available labeled RGB data to synthetic TIR data. We explore both the usage of paired and unpaired image translation models for this purpose. These methods provide us with a large labeled dataset of synthetic TIR sequences, on which we can train end-to-end optimal features for tracking. To the best of our knowledge, we are the first to train end-to-end features for TIR tracking. We perform extensive experiments on the VOT-TIR2017 dataset. We show that a network trained on a large dataset of synthetic TIR data obtains better performance than one trained on the available real TIR data. Combining both data sources leads to further improvement. In addition, when we combine the network with motion features, we outperform the state of the art with a relative gain of over 10%, clearly showing the efficiency of using synthetic data to train end-to-end TIR trackers.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)
Nyckelord
- Visual tracking; thermal infrared; deep learning; generative networks
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas