ISO/IEC TS 25058:2024 システムおよびソフトウェアエンジニアリング | ページ 2

Foreword

ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each member body interested in a subject for which a technical committee has been established has the right to be represented on that committee. International organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of electrotechnical standardization.

The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the different types of ISO document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives ).

ISO draws attention to the possibility that the implementation of this document may involve the use of (a) patent(s). ISO takes no position concerning the evidence, validity or applicability of any claimed patent rights in respect thereof. As of the date of publication of this document, ISO had not received notice of (a) patent(s) which may be required to implement this document. However, implementers are cautioned that this may not represent the latest information, which may be obtained from the patent database available at www.iso.org/patents . ISO shall not be held responsible for identifying any or all such patent rights.

Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions related to conformity assessment, as well as information about ISO's adherence to the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www.iso.org/iso/foreword.html .

This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 42, Artificial intelligence.

Introduction

An artificial intelligence (AI) system can be challenging to evaluate. Consequently, the impact of an AI system with poor quality can be considerable since it can be developed to facilitate the automation of critical actions and decisions.

The purpose of this document is to guide AI developers performing a quality evaluation of their AI systems. This document does not state exact measurements and thresholds, as these vary depending on the nature of each system. Instead, it specifies comprehensive guidance that covers the relevant facets of an AI system’s quality for successful quality evaluation.

Testing is within the scope as far as each characteristic and sub-characteristic is verified by testing strategies, but details of testing methods and measurements are covered elsewhere, for example in the ISO/IEC/IEEE 29119 series.

1 Scope

This document provides guidance for evaluation of artificial intelligence (AI) systems using an AI system quality model.

The document is applicable to all types of organizations engaged in the development and use of AI.

2 Normative references

The following documents are referred to in the text in such a way that some or all of their content constitutes requirements of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies.

3 Terms and definitions

For the purposes of this document, the terms and definitions given in ISO/IEC TS 4213, ISO/IEC 22989, ISO/IEC 23053, ISO/IEC 25059, ISO/IEC/IEEE 29119-1 and ISO/IEC/IEEE 29148 apply.

ISO and IEC maintain terminology databases for use in standardization at the following addresses:

Bibliography