European Conference on Visual Media Production (CVMP) 2024
Arvin Lin Abhijeet Ghosh
Imperial College London
Figure 1: Our proposed color-multiplexing strategy for OLAT captures provides optimal alignment and allows sharper rendering results compared to traditional OLAT capture methods with tracking frames.
Abstract:
We present two color-multiplexed illumination sequences for optimally aligned one-light-at-a-time (OLAT) captures. We leverage color-multiplexing strategies to embed tracking frames within the OLAT photographs to correct for subject motion. Our method allows better motion estimation via optical flow than traditional methods, which interleaves tracking frames between OLATs. Comparison between rendered results and user study on comfortability both demonstrate that color- multiplexed sequences give better-aligned OLATs and are more comfortable for the subject during data capture. Our proposed sequences can replace traditional OLAT sequences for better data acquisition, which would benefit both light-stage rendering results and any state-of-the-art relighting methods that are trained on OLAT-generated data.
Publication: Optimal OLAT Alignment for Image Based Relighting with Color-Multiplexed OLAT Sequence. Arvin Lin, Abhijeet Ghosh. Proc. of European Conference on Visual Media Production (CVMP), Nov 2024.
