echoinside

Total Relighting:
Learning to Relight Portraits for Background Replacement
[Google Research]
* youtube
* project page
* pdf
We propose a novel system for portrait relighting and background replacement. Our technique includes alpha matting, relighting, and compositing. We demonstrate that each of these stages can be tackled in a sequential pipeline without the use of priors (e.g. background or illumination) and with no specialized acquisition techniques, using only a single RGB portrait image and a novel, target HDR lighting environment as inputs. We train our model using relit portraits of subjects captured in a light stage computational illumination system, which records multiple lighting conditions, high quality geometry, and accurate alpha mattes. To perform realistic relighting for compositing, we introduce a novel per-pixel lighting representation in a deep learning framework, which explicitly models the diffuse and the specular components of appearance.
#single_image #relighting #matting

www.tg-me.com/us/echoinside/com.echoinside/1874

137 viewsedited  May 1, 2021 at 10:48

Total Relighting:
Learning to Relight Portraits for Background Replacement
[Google Research]
* youtube
* project page
* pdf
We propose a novel system for portrait relighting and background replacement. Our technique includes alpha matting, relighting, and compositing. We demonstrate that each of these stages can be tackled in a sequential pipeline without the use of priors (e.g. background or illumination) and with no specialized acquisition techniques, using only a single RGB portrait image and a novel, target HDR lighting environment as inputs. We train our model using relit portraits of subjects captured in a light stage computational illumination system, which records multiple lighting conditions, high quality geometry, and accurate alpha mattes. To perform realistic relighting for compositing, we introduce a novel per-pixel lighting representation in a deep learning framework, which explicitly models the diffuse and the specular components of appearance.
#single_image #relighting #matting

BY echoinside