Face Recognition Vendor Test
The Face Recognition Vendor Test (FRVT) was a series of large scale independent evaluations for face recognition systems realized by the National Institute of Standards and Technology in 2000, 2002 and 2006. Previous evaluations in the series were the Face Recognition Technology (FERET) evaluations in 1994, 1995 and 1996.
Face Recognition Vendor Test 2006
The primary goal of the FRVT 2006 was to measure progress of prototype systems/algorithms and commercial face recognition systems since FRVT 2002. FRVT 2006 evaluated performance on:
- High resolution still imagery (5 to 6 mega-pixels)
- 3D facial scans
- Multi-sample still facial imagery
- Pre-processing algorithms that compensate for pose and illumination
To guarantee an accurate assessment, the FRVT 2006 measured performance with sequestered data (data not previously seen by the researchers or developers). A standard dataset and test methodology was employed so that all participants were evenly evaluated. The government provided both the test data and the test environment to participants. The test environment was called the Biometric Experimentation Environment (BEE). The BEE was the FRVT 2006 infrastructure. It allowed the experimenter to focus on the experiment by simplifying test data management, experiment configuration, and the processing of results.
The FRVT 2006 was sponsored by multiple U.S. Government agencies and was conducted and managed by the National Institute of Standards and Technology (NIST).
One of the goals of the FRVT 2006 was to independently determine if the objectives of the Face Recognition Grand Challenge (FRGC) were achieved. The FRGC was a separate algorithm development project designed to promote and advance face recognition technology that supports existing face recognition efforts in the U.S. Government. One of the objectives of the FRGC was to develop face recognition algorithms capable of performance an order of magnitude better than FRVT 2002. The FRGC was conducted from May 2004 through March 2006. FRGC data is still available to face recognition researchers. To obtain FRGC data, potential participants must sign the required licenses and follow FRGC data release rules. To request a FRGC data set, please follow directions found on the "FRGC Webpage."
FRVT 2006 Protocol
FRVT 2006 Protocol
FRVT 2006 Executable Calling Signatures
FRVT 2006 Executable Naming Convention
FRVT 2006 Results
The FRVT 2006 large-scale results are available in the combined FRVT 2006 and ICE 2006 Large-Scale Results evaluation report. We received algorithms from 22 organizations in 10 different countries, with many submitting multiple algorithms. However, only those who successfully completed the large-scale tests are documented in this report. The following organizations submitted algorithms to be evaluated:
- Animetrics, Inc.
- Carnegie Mellon University
- Cognitec Systems GmbH
- Diamond Information Systems (DIS)
- Geometrix, Inc.
- Guardia
- Identix, Inc.
- Neven Vision
- New Jersey Institute of Technology (NJIT)
- Nivis, LLC
- Old Dominion University
- Panvista Limited
- Peking University, Center for Information Science
- PeopleSpot Inc.
- Rafael Armament Development Authority Ltd.
- SAGEM SA
- Samsung Advanced Institute of Technology (SAIT)
- Tsinghua University
- Tili Technology Limited
- Toshiba Corporation
- University of Houston
- Viisage
Sponsors
- Intelligence Advanced Research Projects Agency (IARPA)
- Department of Homeland Security (DHS)
- FBI Criminal Justice Information Services Division
- Technical Support Working Group (TSWG)
- National Institute of Justice
External links
- MBGC Website
- MBGC Blog
- FRGC Website
- FRVT Website
- FRVT 2006 and ICE 2006 Large-Scale Results
- ICE Website
- National Institute of Standards and Technology
- Intelligence Advanced Research Projects Agency
- Department of Homeland Security
- FBI Criminal Justice Information Services Division
- Technical Support Working Group (TSWG)
- National Institute of Justice