Eurographics Symposium on Rendering (EGSR) 2024
Arvin Lin ¹ ² Yiming Lin ² Xiaohui Li ¹ ² Abhijeet Ghosh ¹ ²
Imperial College London ¹
Lumirithmic ²
Figure 1: Given an image of a face lit with uniform frontal illumination, our method generates smooth OLAT images extending beyond the zonal illumination field of the capture setup, achieving light-stage quality relighting with a practical consumer-available hardware setup.
Abstract:
We present a method for high-quality image-based relighting using a practical limited zonal illumination field. Our setup can be implemented with commodity components with no dedicated hardware. We employ a set of desktop monitors to illuminate a subject from a near-hemispherical zone and record One-Light-At-A-Time (OLAT) images from multiple viewpoints. We further extrapolate sampling of incident illumination directions beyond the frontal coverage of the monitors by repeating OLAT captures with the subject rotation in relation to the capture setup. Finally, we train our proposed skip-assisted autoencoder and latent diffusion based generative method to learn a high-quality continuous representation of the reflectance function without requiring explicit alignment of the data captured from various viewpoints. This method enables smooth lighting animation for high-frequency reflectance functions and effectively manages to extend incident lighting beyond the practical capture setup’s illumination zone. Compared to state-of-the-art methods, our approach achieves superior image-based relighting results, capturing finer skin pore details and extending to passive performance video relighting.
Video Demonstrating Our Rendering Results:
Coming soon…
Publication: High Quality Neural Relighting using Practical Zonal Illumination. Arvin Lin, Yiming Lin, Xiaohui Li, and Abhijeet Ghosh. Proc. of Eurographics Symposium on Rendering (EGSR), July 2024
