Multiview SVBRDF capture from unified shape and illumination

Published by Issei FUJISHIRO on

Liang Yuan, Issei Fujishiro

Visual Informatics, July 2023.

[doi: 10.1016/j.visinf.2023.06.006]
This paper proposes a stable method for reconstructing spatially varying appearances (SVBRDFs) from multiview images captured under casual lighting conditions. Unlike flat surface capture methods, ours can be applied to surfaces with complex silhouettes. The proposed method takes multiview images as inputs and outputs a unified SVBRDF estimation. We generated a large-scale dataset containing the multiview images, SVBRDFs, and lighting appearance of vast synthetic objects to train a two-stream hierarchical U-Net for SVBRDF estimation that is integrated into a differentiable rendering network for surface appearance reconstruction. In comparison with state-of-the-art approaches, our method produces SVBRDFs with lower biases for more casually captured images.

Publication page in 2023 is here


Leave a Reply

Avatar placeholder

Your email address will not be published. Required fields are marked *