ISO/IEC 21472:2021 情報技術—生体認証システムのパフォーマンスにおけるユーザーインタラクションの影響に関するシナリオ評価方法 | ページ 2

Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work.

The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, 1. In particular, the different approval criteria needed for the different types of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, 2 (see www.iso.org/directives or www.iec.ch/members_experts/refdocs ).

Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents ) or the IEC list of patent declarations received (see patents.iec.ch ).

Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions related to conformity assessment, as well as information about ISO's adherence to the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www.iso.org/iso/foreword.html . In the IEC, see www.iec.ch/understanding-standards .

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 37, Biometrics.

Introduction

This document describes a methodology for testing and reporting user interaction influence on the performance of biometric recognition systems. Specifically, it describes a methodology for testing and reporting that influence.

The performance of biometric systems can vary or can be influenced by user interaction influence factors. According to ISO/IEC 19795-1:2021, C.2, user physiology, user behaviour, sensors and hardware (all user interaction influence factors) are some factors that can influence the performance of a biometric system.

This methodology is a scenario test in which a set of test subjects interacts with a biometric system to execute transactions when one or more of the following factors is controlled:

• Factors related to the design, position or condition of the capture system.
• Factors depending on the users and their attributes.
• Factors depending on the user interaction with the biometric system.

Testing user interaction influence can be subjective and is not necessarily straightforward. Therefore, this document is intended to address the main conflicts that arise in such cases.

Within the context of this document, it is important to differentiate between “usability testing” and “user interaction influence in performance”. Usability testing relates to “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use” (ISO/IEC 9241-11:2018). Usability testing involves the measurement of “how usable” a specific system or product is. Usability testing is addressed in documents including ISO/IEC TR 25060. On the other hand,"user interaction influence in performance" deals with measuring how the performance of a biometric system can differ from a reference evaluation, based on subjects using the system in operational or scenario conditions.

1 Scope

This document addresses:

• requirements for planning, executing and reporting the influence of user interaction on biometric system performance based on scenario test methodologies, considering three kinds of factors:
  • a) factors related to the design, position or condition of the capture device,
  • b) factors depending on users and user attributes,
  • c) factors depending on the interaction of users with the biometric system;

• specifications for the definition, establishment and measurement of conditions needed for evaluation, including those relating to equipment;

• requirements for establishing a reference evaluation condition (REC) and target evaluation condition(s) (TEC) to compare the influence of user interaction factors;

• a specification of the biometric evaluation including requirements for test population, test protocols, data to record, test results; and

• procedures for carrying out the overall evaluation.

2 Normative references

The following documents are referred to in the text in such a way that some or all of their content constitutes requirements of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies.

3 Terms and definitions

For the purposes of this document, the terms and definitions given in ISO/IEC 19795-1, ISO/IEC 2382-37 and the following apply.

ISO and IEC maintain terminology databases for use in standardization at the following addresses:

Bibliography