Spectral Upsampling Approaches for RGB Illumination
Eurographics Symposium on Rendering (EGSR) 2022
Giuseppe Claudio Guarnera ¹ ˆ ˜ Yuliya Gitlina ² Valentin Deschaintre ² ³ Abhijeet Ghosh ¹ ²
Lumirithmic ¹
University of York ˆ
NTNU ˜
Imperial College London ²
Adobe Research ³
Patent Pending
Fig. 1: Comparison of toy figurines photographed in an outdoor lighting environment (b), and corresponding lighting reproduction inside a multispectral LED sphere using RGB LEDs (a), vs spectral lighting reproduction inside the LED sphere using our proposed spectral upsampling method (c). As can be seen, our RGB-to-spectral upsampling of the input RGB lightprobe achieves a closer qualitative lighting reproduction on the figurines compared to simply driving the LED sphere with RGB values.
Abstract:
We present two practical approaches for high fidelity spectral upsampling of previously recorded RGB illumination in the form of an image-based representation such as an RGB light probe. Unlike previous approaches that require multiple measurements with a spectrometer or a reference color chart under a target illumination environment, our method requires no additional information for the spectral upsampling step. Instead, we construct a data-driven basis of spectral distributions for incident illumination from a set of six RGBW LEDs (three narrowband and three broadband) that we employ to represent a given RGB color using a convex combination of the six basis spectra. We propose two different approaches for estimating the weights of the convex combination using — (a) genetic algorithm, and (b) neural networks. We additionally propose a theoretical basis consisting of a set of narrow and broad Gaussians as a generalization of the approach, and also evaluate an alternate LED basis for spectral upsampling. We achieve good qualitative matches of the predicted illumination spectrum using our spectral upsampling approach to ground truth illumination spectrum while achieving near perfect matching of the RGB color of the given illumination in the vast majority of cases. We demonstrate that the spectrally upsampled RGB illumination can be employed for various applications including improved lighting reproduction as well as more accurate spectral rendering.
Publication: Spectral Upsampling Approaches for RGB Illumination. Giuseppe Claudio Guarnera, Yuliya Gitlina, Valentin Deschaintre, and Abhijeet Ghosh. Proc. of Eurographics Symposium on Rendering (EGSR), July 2022. (Patent Pending)
