Skip to main content
SpringerLink
Log in

Video-Based Face Recognition

  • Living reference work entry
  • First Online:
Computer Vision

Related Concepts

Definition

Video-based face recognition is a type of face recognition where the test data are videos rather than still images. Similar to traditional face recognition, approaches for video-based face recognition attempt to identify a person in a video (identification) or decide whether two subjects in two different videos have same identity (verification).

Background

In computer vision and biometrics, video-based face recognition has received significant amount of attention in recent years. It has a wide range of applications including visual surveillance, access control, video content analysis, etc. Large amounts of video data are becoming available everyday since millions of cameras have been installed in buildings, streets, and airports around the world and people are using billions of handheld devices that are capable of capturing videos.

An example of video-based face identification from...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Kalka ND, Maze B, Duncan JA, O’Connor KJ, Elliott S, Hebert K, Bryan J, Jain AK (2018) IJB-S: IARPA Janus surveillance video benchmark

    Google Scholar 

  2. Zheng J, Ranjan R, Chen C, Chen J, Castillo CD, Chellappa R (2018) An automatic system for unconstrained video-based face recognition. CoRR, abs/1812.04058

    Google Scholar 

  3. Najibi M, Samangouei P, Chellappa R, Davis L (2017) SSH: single stage headless face detector. In: ICCV

    Google Scholar 

  4. Chen J-C, Lin W-A, Zheng J, Chellappa R (2018) A real-time multi-task single shot face detector. In: ICIP

    Book  Google Scholar 

  5. Ranjan R, Bansal A, Zheng J, Xu H, Gleason J, Lu B, Nanduri A, Chen J-C, Castillo C, Chellappa R (2018) A fast and accurate system for face detection, identification, and verification. CoRR, abs/1809.07586

    Google Scholar 

  6. Ranjan R, Patel VM, Chellappa R (2017) HyperFace: A deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. TPAMI 41, 121–135

    Article  Google Scholar 

  7. Ranjan R, Sankaranarayanan S, Castillo CD, Chellappa R (2017) An all-in-one convolutional neural network for face analysis. In: 12th IEEE FG, pp 17–24

    Google Scholar 

  8. Kumar A, Chellappa R (2018) Disentangling 3D pose in a dendritic cnn for unconstrained 2D face alignment. In: The IEEE conference on computer vision and pattern recognition (CVPR)

    Google Scholar 

  9. Taigman Y, Yang M, Ranzato M, Wolf L (2014) DeepFace: closing the gap to human-level performance in face verification. In: CVPR

    Google Scholar 

  10. Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: NIPS

    Google Scholar 

  11. Sun Y, Wang X, Tang X (2015) Deeply learned face representations are sparse, selective, and robust. In: CVPR

    Book  Google Scholar 

  12. Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report, University of Massachusetts, Amherst

    Google Scholar 

  13. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: CVPR

    Google Scholar 

  14. Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. In: BMVC

    Book  Google Scholar 

  15. Chen JC, Patel VM, Chellappa R (2016) Unconstrained face verification using deep CNN features. In: WACV

    Book  Google Scholar 

  16. Chen J-C, Ranjan R, Sankaranarayanan S, Kumar A, Chen C-H, Patel VM, Castillo CD, Chellappa R (2018) Unconstrained still/video-based face verification with deep convolutional neural networks. IJCV 126(2):272–291

    Article  MathSciNet  Google Scholar 

  17. Klare BF, Klein B, Taborsky E, Blanton A, Cheney J, Allen K, Grother P, Mah A, Jain AK (2015) Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A. In: CVPR

    Google Scholar 

  18. Wolf L, Hassner T, Maoz I (2011) Face recognition in unconstrained videos with matched background similarity. In: CVPR, pp 529–534

    Google Scholar 

  19. Maze B, Adams J, Duncan JA, Kalka N, Miller T, Otto C, Jain AK, Niggel WT, Anderson J, Cheney J, Grother P (2018) IARPA Janus Benchmark – C: Face dataset and protocol. In: 2018 International conference on biometrics (ICB), pp 158–165

    Google Scholar 

  20. Deng J, Guo J, Niannan X, Zafeiriou S (2019) ArcFace: additive angular margin loss for deep face recognition. In: CVPR

    Google Scholar 

  21. Zhou SK, Chellappa R, Moghaddam B (2004) Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE TIP 13(11):1491–1506

    Google Scholar 

  22. Roth M, Bäuml M, Nevatia R, Stiefelhagen R (2012) Robust multi-pose face tracking by multi-stage tracklet association. In: ICPR

    Google Scholar 

  23. Comaschi F, Stuijk S, Basten T, Corporaal H (2015) Online multi-face detection and tracking using detector confidence and structured SVMs. In: 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp 1–6

    Google Scholar 

  24. Bewley A, Ge Z, Ott L, Ramos F, Upcroft B (2016) Simple online and realtime tracking. In: ICIP, pp 3464–3468

    Google Scholar 

  25. Du M, Chellappa R (2016) Face association for videos using conditional random fields and max-margin markov networks. IEEE Trans Pattern Anal Mach Intell 38(9):1762–1773

    Article  Google Scholar 

  26. Chen C-H, Chen J-C, Castillo CD, Chellappa R (2017) Video-based face association and identification. In: 12th FG, pp 149–156

    Google Scholar 

  27. Wang R, Chen X (2009) Manifold discriminant analysis. In: CVPRW, pp 429–436

    Google Scholar 

  28. Wang R, Shan S, Chen X, Dai Q, Gao W (2012) Manifold-manifold distance and its application to face recognition with image sets. IEEE TIP 21(10):4466–4479

    MathSciNet  MATH  Google Scholar 

  29. Wang R, Guo H, Davis LS, Dai Q (2012) Covariance discriminative learning: a natural and efficient approach to image set classification. In: CVPR, pp 2496–2503

    Google Scholar 

  30. Chen Y-C, Patel VM, Phillips PJ, Chellappa R (2012) Dictionary-based face recognition from video. In: ECCV

    Book  Google Scholar 

  31. Chen YC, Patel VM, Phillips PJ, Chellappa R (2015) Dictionary-based face and person recognition from unconstrained video. IEEE Access 3:1783–1798

    Article  Google Scholar 

  32. Liu Y, Junjie Y, Ouyang W (2017) Quality aware network for set to set recognition. In: CVPR

    Book  Google Scholar 

  33. Yang J, Ren P, Zhang D, Chen D, Wen F, Li H, Hua G (2017) Neural aggregation network for video face recognition. In: CVPR, pp 4362–4371

    Google Scholar 

  34. Gong S, Shi Y, Kalka ND, Jain AK (2019) Video face recognition: Component-wise feature aggregation network (C-FAN). CoRR, abs/1902.07327

    Google Scholar 

  35. Gong S, Shi Y, Jain AK, Kalka ND (2019) Recurrent embedding aggregation network for video face recognition. CoRR, abs/1904.12019

    Google Scholar 

  36. Zheng J, Chen J-C, Patel VM, Castillo CD, Chellappa R (2019) Hybrid dictionary learning and matching for video-based face verification. In: BTAS

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Maryland, College Park, MD, USA

    Jingxiao Zheng

  2. Johns Hopkins University, Baltimore, MD, USA

    Rama Chellappa

Authors
  1. Jingxiao Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rama Chellappa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rama Chellappa .

Section Editor information

  1. University of Maryland, College Park, MD, USA

    Rama Chellappa

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Zheng, J., Chellappa, R. (2020). Video-Based Face Recognition. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_816-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_816-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation