Skip to main content

Image Descriptors and Similarity Measures

  • Living reference work entry
  • First Online:
Computer Vision
  • 281 Accesses

Definition

An image descriptor is a vector representing concisely the content of an image. A similarity measure is a function estimating the similarity between two objects, usually represented by vectors.

Background

Image descriptors are an ubiquitous tool in computer vision. By representing the content of an image or an image region in a compact and robust way, they make matching problems more efficient, as shown in Figs. 1 and 2. Typically, a descriptor is used to query a set of descriptors, looking for the most similar descriptor in the set. Efficient algorithms, such as hashing, can be used to make this search extremely fast, even for large databases, when the Euclidean distance can be used as similarity measure. Applications range from simultaneous localization and mapping (SLAM) and Structure from Motion (SfM) to image retrieval and object recognition.

Fig. 1
figure 1

Affine regions represented as ellipses matched across two images using their local descriptors. (Images from [1])

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60:63–86

    Article  Google Scholar 

  2. Arandjelović R, Gronat P, Torii A, Pajdla T, Sivic J (2016) NetVLAD: CNN architecture for weakly supervised place recognition. In: Proceedings of the conference on computer vision and pattern recognition

    Google Scholar 

  3. Lindeberg T (1998) Principles for automatic scale selection. Technical Report ISRN KTH NA/P–98/14–SE, KTH (Royal Institute of Technology)

    Google Scholar 

  4. Schmid C, Mohr R (1997) Local grayvalue invariants for image retrieval. IEEE Trans Pattern Anal Mach Intell 19(5):530–534

    Article  Google Scholar 

  5. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 20(2): 91–110

    Article  Google Scholar 

  6. Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 10(27):1615–1630

    Article  Google Scholar 

  7. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) SURF: speeded up robust features. Comput Vis Image Underst 10(3):346–359

    Article  Google Scholar 

  8. Tola E, Lepetit V, Fua P (2010) Daisy: an efficient dense descriptor applied to wide baseline stereo. IEEE Trans Pattern Anal Mach Intell 32(5):815–830

    Article  Google Scholar 

  9. Lindeberg T, Garding J (1997) Shape-adapted smoothing in estimation of 3-D shape cues from affine deformations of local 2-D brightness structure. Image Vis Comput 15(6):415–434

    Article  Google Scholar 

  10. Baumberg A (2000) Reliable feature matching across widely separated views. In: Proceedings of the conference on computer vision and pattern recognition, pp 774–781

    Google Scholar 

  11. Zabih R, Woodfill J (1994) Non parametric local transforms for computing visual correspondences. In: Proceedings of the European conference on computer vision, pp 151–158, May 1994

    Google Scholar 

  12. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  13. Calonder M, Lepetit V, Ozuysal M, Trzcinski T, Strecha C, Fua P (2012) BRIEF: computing a local binary descriptor very fast. IEEE Trans Pattern Anal Mach Intell 34(7):1281–1298

    Article  Google Scholar 

  14. Rublee E, Rabaud V, Konolidge K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In: Proceedings of the international conference on computer vision

    Google Scholar 

  15. Balntas V, Lenc K, Vedaldi A, Mikolajczyk K (2017) HPatches: a benchmark and evaluation of handcrafted and learned local descriptors. In: Proceedings of the conference on computer vision and pattern recognition

    Google Scholar 

  16. Sivic J, Zisserman A (2003) Video Google: a text retrieval approach to object matching in videos. In: Proceedings of the international conference on computer vision

    Google Scholar 

  17. Jégou H, Perronnin F, Douze M, Sanchez J, Pérez P, Schmid C (2012) VLAD: aggregating local image descriptors into compact codes. IEEE Trans Pattern Anal Mach Intell 34(9):1704–1716

    Article  Google Scholar 

  18. Arandjelović R, Zisserman A (2012) Three things everyone should know to improve object retrieval. In: Proceedings of the conference on computer vision and pattern recognition

    Book  Google Scholar 

  19. Strecha C, Bronstein A, Bronstein M, Fua P (2012) LDAHash: improved matching with smaller descriptors. IEEE Trans Pattern Anal Mach Intell 34(1): 66–78

    Article  Google Scholar 

  20. Bellet A, Habrard A, Sebban M (2013) A survey on metric learning for feature vectors and structured data. arXiv Preprint

    Google Scholar 

  21. Bromley J, Guyon I, LeCun Y, Säckinger E, Shah R (1993) Signature verification using a siamese time delay neural network. In: Advances in neural information processing systems. Morgan Kaufmann, San Mateo, pp 737–744

    Google Scholar 

  22. Zagoruyko S, Komodakis N (2015) Learning to compare image patches via convolutional neural networks. In: Proceedings of the conference on computer vision and pattern recognition

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vincent Lepetit .

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Lepetit, V. (2020). Image Descriptors and Similarity Measures. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_797-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_797-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics