Reflection probe interpolation for fast and accurate rendering of reflective materials

dc.contributor.authorGojoković, Katarina
dc.contributor.authorLesar, Žiga
dc.contributor.authorMarolt, Matija
dc.contributor.editorSkala, Václav
dc.date.accessioned2024-07-21T08:56:33Z
dc.date.available2024-07-21T08:56:33Z
dc.date.issued2024
dc.description.abstract-translatedIn this paper, we aim to improve rendering reflections using environment maps on moving reflective objects. Such scenarios require multiple reflection probes to be positioned at various locations in a scene. During rendering, the closest reflection probe is typically chosen as the environment map of a specific object, resulting in sharp transitions between the rendered reflections when the object moves around the scene. To solve this problem, we developed two convolutional neural networks that dynamically synthesize the best possible environment map at a given point in the scene. The first network generates an environment map from the coordinates of a given point through a decoder architecture. In the second approach, we triangulated the scene and captured environment maps at the triangle vertices – these represent reflection probes. The second network receives at the input three environment maps captured at the vertices of the triangle containing the query point, along with the distances between the query point and the vertices. Through an encoder-decoder architecture, the second network performs smart interpolation of the three environment maps. Both approaches are based on the phenomenon of overfitting, which made it necessary to train each network individually for specific scenes. Both networks are successful at predicting environment maps at arbitrary locations in the scene, even if these locations were not part of the training set. The accuracy of the predictions strongly depends on the complexity of the scene itself.en
dc.format10 s.cs_CZ
dc.format10 s.cs
dc.format.mimetypeapplication/pdf
dc.identifier.citationJournal of WSCG. 2024, vol. 32, no. 1-2, p. 81-70.en
dc.identifier.doihttps://www.doi.org/10.24132/JWSCG.2024.7
dc.identifier.issn1213 – 6972
dc.identifier.issn1213 – 6980 (CD-ROM)
dc.identifier.issn1213 – 6964 (on-line)
dc.identifier.urihttp://hdl.handle.net/11025/57345
dc.language.isoenen
dc.publisherVáclav Skala - UNION Agencycs
dc.rights© Václav Skala - UNION Agencycs_CZ
dc.rights© Václav Skala - UNION Agencyen
dc.rights.accessopenAccessen
dc.subjectodrazové sondycs
dc.subjectinterpolacecs
dc.subjectkonvoluční neuronové sítěcs
dc.subject.translatedreflection probesen
dc.subject.translatedinterpolationen
dc.subject.translatedconvolutional neural networksen
dc.titleReflection probe interpolation for fast and accurate rendering of reflective materialsen
dc.typečlánekcs
dc.typearticleen
dc.type.statusPeer-revieweden
dc.type.versionpublishedVersion

Files

Original bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
B13-2024.pdf
Size:
6.76 MB
Format:
Adobe Portable Document Format
Description:
Plný text
License bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: