Interactive Streaming of 3D Scenes to Mobile Devices using Dual-Layer Image Warping and Loop-based Depth Reconstruction

dc.contributor.authorKoenen, Jens
dc.contributor.authorOehrl, Simon
dc.contributor.authorKuhlen, Torsten W.
dc.contributor.authorGerrits, Tim
dc.date.accessioned2025-07-30T07:00:55Z
dc.date.available2025-07-30T07:00:55Z
dc.date.issued2025
dc.description.abstract-translatedWhile mobile devices have developed into hardware with advanced capabilities for rendering 3D graphics, they commonly lack the computational power to render large 3D scenes with complex lighting interactively. A prominent approach to tackle this is rendering required views on a remote server and streaming them to the mobile client. However, the rate at which servers can supply data is limited, e.g., by the available network speed, requiring image-based rendering techniques like image warping to compensate for the latency and allow a smooth user experience, especially in scenes where rapid user movement is essential. In this paper, we present a novel streaming approach designed to minimize artifacts during the warping process by including an additional visibility layer that keeps track of occluded surfaces while allowing access to 360◦ views. In addition, we propose a novel mesh generation technique based on the detection of loops to reliably create a mesh that encodes the depth information required for the image warping process. We demonstrate our approach in a number of complex scenes and compare it against existing works using two layers and one layer alone. The results indicate a significant reduction in computation time while achieving comparable or even better visual results when using our dual-layer approach.en
dc.description.sponsorshipThe authors gratefully acknowledge the German Federal Ministry of Education and Research (BMBF) and the state government of NRW for supporting this work/project as part of the NHR funding.en
dc.format10 s.cs
dc.format.mimetypeapplication/pdf
dc.identifier.doihttp://www.doi.org/10.24132/JWSCG.2025-1
dc.identifier.issn1213-6972 (print)
dc.identifier.issn1213-6964 (online)
dc.identifier.urihttp://hdl.handle.net/11025/62195
dc.language.isoenen
dc.publisherVáclav Skala - UNION Agencycs
dc.rights© Václav Skala - UNION Agencyen
dc.rights.accessopenAccessen
dc.subjectbezdrátová zařízenícs
dc.subjectvykreslování na základě obrazucs
dc.subjectmodely síťové geometriecs
dc.subject.translatedwireless devicesen
dc.subject.translatedimage-based renderingen
dc.subject.translatedmesh geometry modelsen
dc.titleInteractive Streaming of 3D Scenes to Mobile Devices using Dual-Layer Image Warping and Loop-based Depth Reconstructionen
dc.typearticleen
dc.typečlánekcs
dc.type.statusPeer-revieweden
dc.type.versionpublishedVersionen
local.files.count1*
local.files.size1777073*
local.has.filesyes*

Files

Original bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
A05.pdf
Size:
1.69 MB
Format:
Adobe Portable Document Format
License bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: