International Conference on 3D Vision (3DV) 2024
Xiaohui Li ¹ ² Giuseppe Claudio Guarnera ² ³ Arvin Lin ¹ ² Abhijeet Ghosh ¹ ²
Imperial College London ¹
Lumirithmic Ltd ²
University of York ³
Patent Pending
Fig. 1: Reconstructions of acquired faces of subject 1 (Mediterranean skin type, top row) and subject 2 (Caucasian skin type, bottom row) under uniform white illumination (a), estimated skin chromophore maps (b–f), and predicted UVA and NIR responses (g, h) using our proposed practical spectral measurement and modeling approach.
Abstract: We propose a practical method to measure spectral skin reflectance as well as a spectral BSSRDF model spanning a wide spectral range from 300nm to 1000nm. We employ a practical capture setup consisting of desktop monitors to illuminate human faces in the visible domain to estimate five parameters of spectral chromophore concentrations including melanin, hemoglobin, and β carotene concentration, melanin blend-type fraction, and epidermal hemoglobin fraction. The estimated parameters make use of a novel three-stage lookup table search for faster parameter fitting, and drive our skin model for accurate reconstruction of facial skin reflectance response in both the visible domain as well as in the UVA and near-infrared range. We also propose a novel neural network architecture that given our measurements, predicts the five chromophore parameters of our model at the encoder stage and full hyperspectral reflectance response as the output of the decoder stage.
Publication: Practical Measurement and Neural Encoding of Hyperspectral Skin Reflectance. Xiaohui Li, Giuseppe Claudio Guarnera, Arvin Lin, Abhijeet Ghosh. International Conference on 3D Vision (3DV), March 2024.
