Skip to main content
SpringerLink
Log in

Illumination Estimation, Illuminant Estimation

  • Living reference work entry
  • First Online:
Computer Vision

  • 25 Accesses

Related Concepts

Definition

The purpose of illumination estimation is to determine the direction and intensity of the lighting in a scene. In contrast to direct measurement of lighting, the illumination information is inferred from visual cues within the scene, without the use of a special probe.

Estimating the illumination color of a scene may also be referred to as illumination estimation. This research problem is commonly termed as color constancy, which is described in another entry of this encyclopedia.

Background

The appearance of objects and scenes can vary considerably with respect to illumination conditions. In [1], differences in face appearance due to lighting were found to be greater than those due to identity. Since such appearance variations can affect the performance of certain computer vision algorithms, much research has focused on illumination estimation, so that lighting can be accounted for in image understanding.

To...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Moses Y, Adini Y, Ullman S (1994) Face recognition: the problem of compensating for changes in illumination direction. In: Proceedings of European Conference on Computer Vision (ECCV). Springer, Heidelberg/Berlin, pp 286–296

    Google Scholar 

  2. Zheng Q, Chellappa R (1991) Estimation of illuminant direction, albedo, and shape from shading. IEEE Trans Pattern Anal Mach Intell 13:680–702

    Article  Google Scholar 

  3. Samaras D, Metaxas D (1999) Coupled lighting direction and shape estimation from single images. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 868–874

    Google Scholar 

  4. Hougen DR, Ahuja N (1993) Estimation of the light source distribution and its use in integrated shape recovery from stereo and shading. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 148–155

    Google Scholar 

  5. Yang Y, Yuille AL (1991) Sources from shading. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Washington, DC, pp 534–539

    Google Scholar 

  6. Ramamoorthi R, Hanrahan P (2001) A signal-processing framework for inverse rendering. In: Proceedings of ACM SIGGRAPH. ACM, New York, pp 117–128

    Google Scholar 

  7. Zhang Y, Yang YH (2001) Multiple illuminant direction detection with application to image synthesis. IEEE Trans Pattern Anal Mach Intell 23:915–920

    Article  Google Scholar 

  8. Wang Y, Samaras D (2002) Estimation of multiple illuminants from a single image of arbitrary known geometry. In: Proceedings of European Conference on Computer Vision (ECCV). Lecture notes in computer science, vol 2352. Springer, Berlin/Heidelberg, pp 272–288

    Google Scholar 

  9. Basri R, Jacobs D, Kemelmacher I (2007) Photometric stereo with general, unknown lighting. Int J Comput Vis 72:239–257

    Article  Google Scholar 

  10. Sato I, Sato Y, Ikeuchi K (1999) Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 875–883

    Google Scholar 

  11. Sato I, Sato Y, Ikeuchi K (1999) Illumination distribution from shadows. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Washington, DC, pp 306–312

    Google Scholar 

  12. Sato I, Sato Y, Ikeuchi K (2001) Stability issues in recovering illumination distribution from brightness in shadows. Proc IEEE Conf Comput Vis Pattern Recogn (CVPR) II:400–407

    Google Scholar 

  13. Sato I, Sato Y, Ikeuchi K (2003) Illumination from shadows. IEEE Trans Pattern Anal Mach Intell 25:290–300

    Article  Google Scholar 

  14. Okabe T, Sato I, Sato Y (2004) Spherical harmonics vs. haar wavelets: basis for recovering illumination from cast shadows. Proc IEEE Conf Comput Vis Pattern Recogn (CVPR) I:50–57

    Google Scholar 

  15. Kim T, Hong K (2005) A practical single image based approach for estimating illumination distribution from shadows. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 266–271

    Google Scholar 

  16. Nishino K, Zhang Z, Ikeuchi K (2001) Determining reflectance parameters and illumination distribution from sparse set of images for view-dependent image synthesis. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 599–606

    Google Scholar 

  17. Li Y, Lin S, Lu H, Shum HY (2003) Multiple-cue illumination estimation in textured scenes. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 1366–1373

    Google Scholar 

  18. Nishino K, Belhumeur P, Nayar S (2005) Using eye reflections for face recognition under varying illumination. Proc Int Conf Comput Vis I:519–526

    Google Scholar 

  19. Wang H, Lin S, Liu X, Kang SB (2005) Separating reflections in human iris images for illumination estimation. In: Proceedings of the International Conference on Computer Vision. IEEE Computer Society, Washington, DC, pp 1691–1698

    Google Scholar 

  20. Lombardi S, Nishino K (2012) Reflectance and natural illumination from a single image. In: Proceedings of the European Conference on Computer Vision (ECCV)

    Google Scholar 

  21. Lombardi S, Nishino K (2016) Reflectance and illumination recovery in the wild. IEEE Trans Pattern Anal Mach Intell 38(1):129–141

    Article  Google Scholar 

  22. Barron J, Malik J (2013) Shape, illumination, and reflectance from shading. IEEE Trans Pattern Anal Mach Intell 37(8):1670–1687

    Article  Google Scholar 

  23. Calian DA, Lalonde JF, Gotardo PFU, Simon T, Matthews IA, Mitchell K (2018) From faces to outdoor light probes. Comput Graph Forum 37:51–61

    Article  Google Scholar 

  24. Nestmeyer T, Matthews I, Lalonde JF, Lehrmann A (2020) Learning physics-guided face relighting under directional light. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  25. Zhou H, Sun J, Yacoob Y, Jacobs DW (2018) Label denoising adversarial network (LDAN) for inverse lighting of faces. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  26. Sengupta S, Kanazawa A, Castillo CD, Jacobs DW (2018) SfSNet: learning shape, reflectance and illuminance of faces ‘in the wild’. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  27. Zhou H, Hadap S, Sunkavalli K, Jacobs DW (2019) Deep single-image portrait relighting. In: Proceedings of the International Conference on Computer Vision (ICCV)

    Google Scholar 

  28. Yi R, Zhu C, Tan P, Lin S (2018) Faces as lighting probes via unsupervised deep highlight extraction. In: Proceedings of the European Conference on Computer Vision (ECCV)

    Google Scholar 

  29. Sun T, Barron JT, Tsai YT, Xu Z, Yu X, Fyffe G, Rhemann C, Busch J, Debevec P, Ramamoorthi R (2019) Single image portrait relighting. ACM Trans Graph 38:1–12

    Google Scholar 

  30. Georgoulis S, Rematas K, Ritschel T, Gavves E, Fritz M, van Gool L, Tuytelaars T (2017) Reflectance and natural illumination from single-material specular objects using deep learning. IEEE Trans Pattern Anal Mach Intell 40(8):1932–1947

    Article  Google Scholar 

  31. Georgoulis S, Rematas K, Ritschel T, Fritz M, Tuytelaars T, van Gool L (2017) What is around the camera? In: Proceedings of the International Conference on Computer Vision (ICCV)

    Google Scholar 

  32. Weber H, Prevost D, Lalonde JF (2018) Learning to estimate indoor lighting from 3D objects. In: Proceedings of International Conference on 3D Vision (I3D)

    Google Scholar 

  33. Wei X, Chen G, Dong Y, Lin S, Tong X (2020) Object-based illumination estimation with rendering-aware neural networks. In: European Conference on Computer Vision (ECCV)

    Google Scholar 

  34. Lalonde JF, Efros AA, Narasimhan SG (2012) Estimating natural illumination from a single outdoor image. Int J Comput Vis 98(2):123–145

    Article  MathSciNet  Google Scholar 

  35. Hold-Geoffroy Y, Sunkavalli K, Hadap S, Gambaretto E, Lalonde JF (2017) Deep outdoor illumination estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  36. Zhang J, Sunkavalli K, Hold-Geoffroy Y, Hadap S, Eisenman J, Lalonde JF (2019) All-weather deep outdoor illumination estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  37. Hold-Geoffroy Y, Athawale A, Lalonde JF (2019) Deep sky modeling for single image outdoor lighting estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  38. Gardner MA, Sunkavalli K, Yumer E, Shen X, Gambaretto E, Gagne C, Lalonde JF (2017) Learning to predict indoor illumination from a single image. ACM SIGGRAPH Asia

    Book  Google Scholar 

  39. Gardner MA, Hold-Geoffroy Y, Sunkavalli K, Gagne C, Lalonde JF (2019) Deep parametric indoor lighting estimation. In: Proceedings of International Conference on Computer Vision (ICCV)

    Google Scholar 

  40. Garon M, Sunkavalli K, Hadap S, Carr N, Lalonde JF (2019) Fast spatially-varying indoor lighting estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  41. Song S, Funkhouser T (2019) Neural illumination: lighting prediction for indoor environments. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  42. Srinivasan PP, Mildenhall B, Tancik M, Barron JT, Tucker R, Snavely N (2020) Lighthouse: predicting lighting volumes for spatially-coherent illumination. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  43. Azinovic D, Li TM, Kaplanyan A, Nießner M (2019) Inverse path tracing for joint material and lighting estimation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  44. Sengupta S, Gu J, Kim K, Liu G, Jacobs DW, Kautz J (2019) Neural inverse rendering of an indoor scene from a single image. In: Proceedings of International Conference on Computer Vision (ICCV)

    Google Scholar 

  45. Li Z, Shafiei M, Ramamoorthi R, Sunkavalli K, Chandraker M (2020) Inverse rendering for complex indoor scenes: shape, spatially-varying lighting and svbrdf from a single image. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  46. Cheng D, Shi J, Chen Y, Deng X, Zhang X (2018) Learning scene illumination by pairwise photos from rear and front mobile cameras. Comput Graph Forum 37(7):213–221

    Article  Google Scholar 

  47. LeGendre C, Ma WC, Fyffe G, Flynn J, Charbonnel L, Busch J, Debevec P (2019) Deeplight: learning illumination for unconstrained mobile mixed reality. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

  48. Sato I, Sato Y, Ikeuchi K (1999) Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans Vis Comput Graph 5:1–12

    Article  Google Scholar 

  49. Karsch K, Sunkavalli K, Hadap S, Carr N, Jin H, Fonte R, Sittig M, Forsyth D (2014) Automatic scene inference for 3D object compositing. ACM Trans Graph 33:3

    MATH  Google Scholar 

  50. Barron JT, Malik J (2013) Intrinsic scene properties from a single RGB-D image. In: Proceedings of Computer Vision and Pattern Recognition (CVPR)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Microsoft Research Asia, Beijing, China

    Stephen Lin

Authors
  1. Stephen Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephen Lin .

Section Editor information

  1. Osaka University, Suita, Japan

    Yasuyuki Matsushita

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Lin, S. (2020). Illumination Estimation, Illuminant Estimation. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_516-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_516-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation