Sökning: onr:"swepub:oai:research.chalmers.se:2f20480c-9595-435e-9243-7eaec9945f80" >
LIDAR-Camera Fusion...
-
Caltagirone, Luca,1983Chalmers tekniska högskola,Chalmers University of Technology
(författare)
LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks
- Artikel/kapitelEngelska2019
Förlag, utgivningsår, omfång ...
Nummerbeteckningar
-
LIBRIS-ID:oai:research.chalmers.se:2f20480c-9595-435e-9243-7eaec9945f80
-
https://research.chalmers.se/publication/505931URI
-
https://doi.org/10.1016/j.robot.2018.11.002DOI
-
https://research.chalmers.se/publication/506694URI
Kompletterande språkuppgifter
-
Språk:engelska
-
Sammanfattning på:engelska
Ingår i deldatabas
Klassifikation
-
Ämneskategori:art swepub-publicationtype
-
Ämneskategori:ref swepub-contenttype
Anmärkningar
-
In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled to obtain a set of dense 2D images encoding spatial information. Several fully convolutional neural networks (FCNs) are then trained to carry out road detection, either by using data from a single sensor, or by using three fusion strategies: early, late, and the newly proposed cross fusion. Whereas in the former two fusion approaches, the integration of multimodal information is carried out at a predefined depth level, the cross fusion FCN is designed to directly learn from data where to integrate information; this is accomplished by using trainable cross connections between the LIDAR and the camera processing branches. To further highlight the benefits of using a multimodal system for road detection, a data set consisting of visually challenging scenes was extracted from driving sequences of the KITTI raw data set. It was then demonstrated that, as expected, a purely camera-based FCN severely underperforms on this data set. A multimodal system, on the other hand, is still able to provide high accuracy. Finally, the proposed cross fusion FCN was evaluated on the KITTI road benchmark where it achieved excellent performance, with a MaxF score of 96.03%, ranking it among the top-performing approaches.
Ämnesord och genrebeteckningar
Biuppslag (personer, institutioner, konferenser, titlar ...)
-
Bellone, Mauro,1982Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)bellone
(författare)
-
Svensson, Lennart,1976Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)pale
(författare)
-
Wahde, Mattias,1969Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)mwahde
(författare)
-
Chalmers tekniska högskola
(creator_code:org_t)
Sammanhörande titlar
-
Ingår i:Robotics and Autonomous Systems: Elsevier BV111, s. 125-1310921-8890
Internetlänk
Hitta via bibliotek
Till lärosätets databas