Inventors
Sean Ryan Francesco Fanello, TSAI Yun-Ta, Rohit Kumar Pandey, Paul Debevec, Michael Milne, Chloe Legendre, Jonathan Tilton Barron, Christoph Rhemann, Sofien Bouaziz, Navin Padman Sarma
Publication date
2023/11/9
Patent office
US
Application number
18028930
Description
Apparatus and methods related to applying lighting models to images of objects are provided. An example method includes applying a geometry model to an input image to determine a surface orientation map indicative of a distribution of lighting on an object based on a surface geometry. The method further includes applying an environmental light estimation model to the input image to determine a direction of synthetic lighting to be applied to the input image. The method also includes applying, based on the surface orientation map and the direction of synthetic lighting, a light energy model to determine a quotient image indicative of an amount of light energy to be applied to each pixel of the input image. The method additionally includes enhancing, based on the quotient image, a portion of the input image. One or more neural networks can be trained to perform one or more of the aforementioned aspects.
Total citations
Scholar articles
SRF Fanello, T Yun-Ta, RK Pandey, P Debevec… - US Patent App. 18/028,930, 2023