ISO/TS 8000-81:2021 データ品質—パート81：データ品質評価：プロファイリング | ページ 2

Foreword

ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each member body interested in a subject for which a technical committee has been established has the right to be represented on that committee. International organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of electrotechnical standardization.

The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, 1. In particular, the different approval criteria needed for the different types of ISO documents should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, 2 (see www.iso.org/directives ).

Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents ).

Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions related to conformity assessment, as well as information about ISO's adherence to the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www.iso.org/iso/foreword.html .

This document was prepared by Technical Committee ISO/TC 184, Automation systems and integration, Subcommittee SC 4, Industrial data.

A list of all parts in the ISO 8000 series can be found on the ISO website.

Introduction

Digital data delivers value by enhancing all aspects of organizational performance including:

• operational effectiveness and efficiency;
• safety;
• reputation with customers and the wider public;
• compliance with statutory regulations;
• consumer costs, revenues and stock prices.

The influence on performance originates from data being the formalized representation of information; this information enables organizations to make reliable decisions. This decision making can be performed by human beings directly and also by automated data processing including artificial intelligence systems.

Through widespread adoption of digital computing and associated communication technologies, organizations become dependent on digital data. This dependency amplifies the negative consequences of lack of quality in this data. These consequences are the decrease of organizational performance.

The biggest impact of digital data comes from the data having a structure that reflects the nature of the subject matter and from the data also being computer processable (machine readable) rather than just being for a person to read and understand.

The content of ISO 9000 explains that quality is not an abstract concept of absolute perfection. Quality is actually the conformance of characteristics to requirements and, thus, any item of data can be of high quality for one use but not for another use that has differing requirements.

The nature of digital data is fundamental to establishing requirements that are relevant to the specific decisions that are made by each organization.

To support the delivery of high‑quality data, the ISO 8000 series addresses:

• data governance, data quality management and maturity assessment;

  EXAMPLE 3

  ISO 8000-61 specifies a process reference model for data quality management.
• creating and applying requirements for data and information;

  EXAMPLE 4

  ISO 8000-110 specifies how to exchange characteristic data that is master data.
• monitoring and measuring data and information quality;

  EXAMPLE 5

  ISO 8000-8 specifies approaches to measuring data and information quality.
• improving data and, consequently, information quality;

  EXAMPLE 6

  This document specifies an approach to data profiling, which identifies opportunities to improve data quality.
• issues that are specific to the type of content in a data set.

  EXAMPLE 7

  ISO/TS 8000-311 specifies how to address quality considerations for product shape data.

Data quality management covers all aspects of data processing, including creating, collecting, storing, maintaining, transferring, exploiting and presenting data to deliver information.

Effective data quality management is systemic and systematic, requiring an understanding of the root causes of data quality issues. This understanding is the basis for not just correcting existing nonconformities but also implementing solutions that prevent future reoccurrence of those nonconformities.

As a contribution to this overall capability of the ISO 8000 series, this document specifies an approach to data profiling, which involves applying analysis techniques to data in actual use. This analysis generates a profile consisting of the structure, columns and relationships of the data. The profile provides the basis for identifying opportunities to improve data quality by establishing new explicit rules for the data. The approach also typically produces greater effect from repeated application to uncover issues progressively.

Organizations can use this document on its own or in conjunction with other parts of the ISO 8000 series.

This document supports activities that affect:

• one or more information systems;
• data flows within the organization and with external organizations;
• any phase of the data life cycle.

By implementing parts of the ISO 8000 series, an organization achieves the following benefits:

• establishing reliable foundations for digital transformation;
• recognizing how data in digital form has become a fundamental asset class that organizations rely on to deliver value;
• securing evidence‑based trustworthiness of data and information for all stakeholders;
• creating portable data that protects against the loss of intellectual property and that is reusable across the organization and applications;
• achieving traceability of data back to original sources;
• ensuring all stakeholders work with common understanding of explicit data requirements.

ISO/TS 8000-1 provides a detailed explanation of the structure and scope of the ISO 8000 series.

Annex A contains an identifier that unambiguously identifies this document in an open information system.

1 Scope

This document specifies a procedure for data profiling to generate the foundation for performing data quality assessment. This profiling is applicable to data sets that are either originally in a structure of tables and columns or are the output from a transformation to create such a structure.

The following are within the scope of this document:

• performing structure analysis to determine data element concepts;
• performing column analysis to identify relevant data elements, including statistics about a data set;
• performing relationship analysis to identify dependencies in a data set.

The following are outside the scope of this document:

• methods for extracting and sampling data to be profiled from a data set;
• deriving data rules;
• measuring the extent of nonconformities in a data set.

This document can be used in conjunction with, or independently of, quality management systems standards.

2 Normative references

The following documents are referred to in the text in such a way that some or all of their content constitutes requirements of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies.

3 Terms and definitions

For the purposes of this document, the terms and definitions given in ISO 8000-2 apply.

ISO and IEC maintain terminological databases for use in standardization at the following addresses:

Bibliography