Conditional Random Fields Meet Deep Neural Networks for Semantic Segmentation: Combining Probabilistic Graphical Models with Deep Learning for Structured Prediction

Semantic segmentation is the task of labeling every pixel in an image with a predefined object category. It has numerous applications in scenarios where the detailed understanding of an image is required, such as in autonomous vehicles and medical diagnosis. This problem has traditionally been solved with probabilistic models known as conditional random fields (CRFs) due to their ability to model the relationships between the pixels being predicted. However, deep neural networks (DNNs) recently have been shown to excel at a wide range of computer vision problems due to their ability to automatically learn rich feature representations from data, as opposed to traditional handcrafted features. The idea of combining CRFs and DNNs have achieved state-of-the-art results in a number of domains. We review the literature on combining the modeling power of CRFs with the representation-learning ability of DNNs, ranging from early work that combines these two techniques as independent stages of a common pipeline to recent approaches that embed inference of probabilistic models directly in the neural network itself. Finally, we summarize future research directions.

Zheng, ShuaiUniversity Of Oxford (författare)
Jayasumana, Sadeep (författare)
Romera-Paredes, BernardinoGoogle DeepMind (författare)
Larsson, Måns,1989Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)lmans (författare)
Kirillov, AlexanderRuprecht-Karls-Universität Heidelberg,Heidelberg University (författare)
Savchynskyy, BogdanRuprecht-Karls-Universität Heidelberg,Heidelberg University (författare)
Rother, CarstenRuprecht-Karls-Universität Heidelberg,Heidelberg University (författare)
Kahl, Fredrik,1972Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)kahlf (författare)
Torr, Philip H.S.University Of Oxford (författare)
University Of OxfordGoogle DeepMind (creator_code:org_t)

Av författaren/redakt...: Arnab, Anurag; Zheng, Shuai; Jayasumana, Sade ...; Romera-Paredes, ...; Larsson, Måns, 1 ...; Kirillov, Alexan ...; visa fler...; Savchynskyy, Bog ...; Rother, Carsten; Kahl, Fredrik, 1 ...; Torr, Philip H.S ...; visa färre...

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Datorseende och ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.