Evaluation Criteria and Evaluations for Biometric Authentication SystemsInternational Statushttp://www.bromba.com/contacte.htm Actual status: 2008-02-14 |
Evaluation CriteriaNational Physical Laboratory - EnglandMansfield, A. J.; Wayman, J. L.Best Practices in Testing and Reporting Performance of Biometric Devices Version 2.01 August 2002 Internet: http://www.cesg.gov.uk/site/ast/biometrics/media/BestPractice.pdf Comment: Focusses on all aspects of testing FAR, FER, and FRR. Version 2 is a greatly improved and extended version. UK Government Biometrics Working Group - EnglandBiometric Device Protection Profile (BDPP)Draft Issue 0.82 5 September 2001 Internet: http://www.cesg.gov.uk/site/ast/biometrics/media/bdpp082.pdf Comment: Describes all kind of attacks on biometrics authentication systems Use of Biometrics for Identification
and Authentication - Advice on Product Selection
Common CriteriaU.S. Government Biometric Verification Mode Protection Profile for Medium Robustness Environments (MRE);Version 1.0 November 2003 Internet: http://www.commoncriteriaportal.org/public/files/ppfiles/pp_vid1022-pp.pdf Comment: Describes all kind of attacks on biometrics authentication systems TeleTrusT - GermanyLaßmann, G. (Ed.)Bewertungskriterien zur Vergleichbarkeit biometrischer Verfahren ("Kriterienkatalog"); Version 2.0 07/2002 Version 3.0 2006-08-18 Internet: http://www.teletrust.de/index.php?id=248 Comment: The most comprehensive catalog for all kind of evaluation criteria Laßmann, G. (Ed.)
Electronic Warfare Associates - CanadaBiometric Technology Security Evaluation under the Common CriteriaVersion 1.2 September 2001 Internet: http://www.cse-cst.gc.ca/en/documents/services/ccs/ccs_biometrics121.pdf Comment: CC Biometric Evaluation Methodology Working Group - United KingdomCommon Criteria - Common Methodology for Information Technology Security Evaluation - Biometric Evaluation Methodology Supplement [BEM]Version 1.0 August 2002 Internet: http://www.cesg.gov.uk/site/ast/biometrics/media/BEM_10.pdf Comment: Bundesamt für Sicherheit in der Informationstechnik (BSI) - GermanyMunde, A.Evaluation biometrischer Systeme Internet: http://www.sit.fhg.de/smartcard-ws/WS_01/Beitrag_Munde.pdf (dead link) Comment: Short description of BSI activities with respect to evaluation and certification; good introduction Technical Evaluation Criteria for the
Assessment and Classification of Biometric Systems
Technische Evaluierungskriterien zur
Bewertung und Klassifizierung biometrischer Systeme
International Biometric Group - USAComparative Biometric Testing - Official Test Plan2002 Internet: http://www.ibgweb.com/reports/public/reports/Comparative_biometric_test_plan.htm (dead link) Comment: Delivers examples of exact definitions for FAR, FER, and FRR EvaluationsNational Physical Laboratory - EnglandBiometric Product Testing Final ReportIssue 1.0 19 March 2001 Internet: http://www.cesg.gov.uk/site/ast/biometrics/media/BiometricTestReportpt1.pdf Comment: Compares different biometric systems. Does not reflect the state-of-the-art. Bundesamt für Sicherheit in der Informationstechnik (BSI) - GermanyBioIS StudyInternet: withdrawn, contact M. Bromba Comment: "first trial", based on technology demonstrators and prototypes rather than on products. Not to be used to compare different biometric features. BioFace I & II Study
BioP I - Untersuchung der Leistungsfähigkeit
von Gesichtserkennungssystemen zum geplanten Einsatz in Lichtbilddokumenten
BioP I - An investigation into the performance
of facial recognition systems relative to their planned use in photo identification
documents
BioP II - Untersuchung der Leistungsfähigkeit
von biometrischen Verifikationssystemen
Evaluation of
Fingerprint Recognition Technologies - BioFinger
Bundeskriminalamt - Germany Gesichtserkennung
als Fahndungshilfsmittel "Fotofahndung" - Abschlussbericht
Biometric Systems Lab (University of Bologna), U.S. National Biometric Test Center (San Jose State University), and Pattern Recognition and Image Processing Laboratory of Michigan State University.FVC2002 (Second International Competition for Fingerprint Verification Algorithms)Internet: http://bias.csr.unibo.it/fvc2002/ Comment: Methodology only suitable for algorithm comparisons, not for real-life scenarios. FVC2004 (Third International Competition
for Fingerprint Verification Algorithms)
FVC2006 (Fourth
International Competition for Fingerprint Verification Algorithms)
National Institute of Standards (NIST) - USAFRVT 2002 (Face Recognition Vendor Test 2002)Internet: http://www.frvt.org/FERET/default.htm Comment: FpVTE 2003 (Fingerprint Vendor Technology
Evaluation 2003)
The Myth of Goats:
How many people have fingerprints that are hard to match? September
2005. NISTIR 7271 [892K].
MINEX - Performance
and Interoperability of the INCITS 378 Fingerprint Template
FRVT 2006 (Face Recognition Vendor Test
2006) & ICE2006 (Iris Challenge Evaluation)
MINEX II - An
assessment of Match-on-Card technology (Performance of Fingerprint Match-on-Card
Algorithms Phase II Report)
UK Passport Service - United KingdomBiometrics Enrolment TrialMay 2005 Internet: http://www.homeoffice.gov.uk/docs4/UKPS_Biometrics_Enrolment_summary.pdf (dead link), http://www.homeoffice.gov.uk/docs4/UKPS_Biometrics_Enrolment_Trial_Report.pdf (dead link) Still available here: http://www.biometricscatalog.org/evaluation/default.asp Comment: Results only valid for specific realization. No generalization possible, especially with respect to failure-to-enroll rates (FER)! International Biometrics Group - USAIndependent Testing of Iris Recognition TechnologyMay 2005 Internet: http://www.biometricscatalog.org/evaluation/default.asp Comment: "Explanation" for the surprisingly week results for iris in the "Biometrics Enrolment Trial". Other private organizationsIRIS06 Draft Final ReportVersion 0.4 March 2007 Internet: http://www.authenti-corp.com/iris06/report/ Comment: Evaluation of 3 iris recognition systems Other link collections for evaluationsBiometrics Catalog - Evaluation ReportsInternet: http://www.biometricscatalog.org/evaluation/default.asp Comment: Partially needs Javascript http://www.bromba.com/contacte.htm |