Search: id:"swepub:oai:DiVA.org:miun-50066" >
LFSphereNet :
-
Gond, Manu,1997-Mittuniversitetet,Institutionen för data- och elektroteknik (2023-),Realistic3D
(author)
LFSphereNet : Real Time Spherical Light Field Reconstruction from a Single Omnidirectional Image
- Article/chapterEnglish2023
Publisher, publication year, extent ...
-
New York, NY, United States :Association for Computing Machinery (ACM),2023
-
printrdacarrier
Numbers
-
LIBRIS-ID:oai:DiVA.org:miun-50066
-
https://urn.kb.se/resolve?urn=urn:nbn:se:miun:diva-50066URI
-
https://doi.org/10.1145/3626495.3626500DOI
Supplementary language notes
-
Language:English
-
Summary in:English
Part of subdatabase
Classification
-
Subject category:ref swepub-contenttype
-
Subject category:kon swepub-publicationtype
Notes
-
Recent developments in immersive imaging technologies have enabled improved telepresence applications. Being fully matured in the commercial sense, omnidirectional (360-degree) content provides full vision around the camera with three degrees of freedom (3DoF). Considering the applications in real-time immersive telepresence, this paper investigates how a single omnidirectional image (ODI) can be used to extend 3DoF to 6DoF. To achieve this, we propose a fully learning-based method for spherical light field reconstruction from a single omnidirectional image. The proposed LFSphereNet utilizes two different networks: The first network learns to reconstruct the light field in cubemap projection (CMP) format given the six cube faces of an omnidirectional image and the corresponding cube face positions as input. The cubemap format implies a linear re-projection, which is more appropriate for a neural network. The second network refines the reconstructed cubemaps in equirectangular projection (ERP) format by removing cubemap border artifacts. The network learns the geometric features implicitly for both translation and zooming when an appropriate cost function is employed. Furthermore, it runs with very low inference time, which enables real-time applications. We demonstrate that LFSphereNet outperforms state-of-the-art approaches in terms of quality and speed when tested on different synthetic and real world scenes. The proposed method represents a significant step towards achieving real-time immersive remote telepresence experiences.
Subject headings and genre
Added entries (persons, corporate bodies, meetings, titles ...)
-
Zerman, Emin,1989-Mittuniversitetet,Institutionen för data- och elektroteknik (2023-),Realistic3D(Swepub:miun)emizer
(author)
-
Knorr, SebastianErnst-Abbe University of Applied Sciences
(author)
-
Sjöström, Mårten,1967-Mittuniversitetet,Institutionen för data- och elektroteknik (2023-)(Swepub:miun)marsjo
(author)
-
MittuniversitetetInstitutionen för data- och elektroteknik (2023-)
(creator_code:org_t)
Related titles
-
In:Proceedings of the 20th ACM SIGGRAPH European Conference on Visual Media ProductionNew York, NY, United States : Association for Computing Machinery (ACM), s. 1-109798400704260
Internet link
Find in a library
To the university's database