Information technology — Scenario evaluation methodology for user interaction influence in biometric system performance
Introduction: This document describes a methodology for testing and reporting user interaction influence on the performance of biometric recognition systems. Specifically, it describes a methodology for testing and reporting that influence. The performance of biometric systems can vary or can be influenced by user interaction influence factors. According to ISO/IEC 19795-1:2021, C.2, user physiology, user behaviour, sensors and hardware (all user interaction influence factors) are some factors that can influence the performance of a biometric system. This methodology is a scenario test in which a set of test subjects interacts with a biometric system to execute transactions when one or more of the following factors is controlled: — Factors related to the design, position or condition of the capture system. — Factors depending on the users and their attributes. — Factors depending on the user interaction with the biometric system. Testing user interaction influence can be subjective and is not necessarily straightforward. Therefore, this document is intended to address the main conflicts that arise in such cases. Within the context of this document, it is important to differentiate between “usability testing” and “user interaction influence in performance”. Usability testing relates to “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use” (ISO/IEC 9241-11:2018). Usability testin
Scope: This document addresses: — requirements for planning, executing and reporting the influence of user interaction on biometric system performance based on scenario test methodologies, considering three kinds of factors: a) factors related to the design, position or condition of the capture device, b) factors depending on users and user attributes, c) factors depending on the interaction of users with the biometric system; — specifications for the definition, establishment and measurement of conditions needed for evaluation, including those relating to equipment; — requirements for establishing a reference evaluation condition (REC) and target evaluation condition(s) (TEC) to compare the influence of user interaction factors; — a specification of the biometric evaluation including requirements for test population, test protocols, data to record, test results; and — procedures for carrying out the overall evaluation. This document does not: — determine which parameters ought to be analysed for a specific biometric modality. This is currently covered in ISO/IEC TR 19795-3; — specify requirements for performing a vulnerability analysis modifying user interaction influence factors; — include procedures for performing usability testing.