Artificial intelligence — Testing of AI — Part 2: Overview of testing AI systems
Introduction: This document facilitates understanding of how ISO/IEC/IEEE 29119-1, ISO/IEC/IEEE 29119-2, ISO/IEC/IEEE 29119-3, ISO/IEC/IEEE 29119-4 and ISO/IEC 20246 apply to the testing of AI systems. The purpose of ISO/IEC/IEEE 29119 (all parts) is to define an internationally agreed set of standards for software testing that can be used by any organization when performing any form of software testing. ISO/IEC/IEEE 29119-1 introduces software testing concepts, which can be applied to any AI system. ISO/IEC/IEEE 29119-2 comprises test process descriptions that define the software test processes at the organizational level, test management level and dynamic test levels. It supports dynamic testing, functional and non-functional testing, manual and automated testing and scripted and unscripted testing, and can be utilized for the testing of any software-based system, including AI systems. ISO/IEC/IEEE 29119-3 defines software test documentation. The requirements specified for templates and examples of test documentation defined in ISO/IEC/IEEE 29119-3 can be met in the test documentation for any AI system. ISO/IEC/IEEE 29119-4 defines test design techniques, which can be utilized for the testing of AI systems and their components. ISO/IEC 20246 defines processes and templates for work product reviews, including inspections, walkthroughs and technical reviews. This document explains how ISO/IEC/IEEE 29119-2 can be adopted for the testing of AI systems and their components and how the test do
Scope: This document provides requirements and guidance on the application of the ISO/IEC/IEEE 29119 series to the testing of AI systems. This document follows a risk-based approach and uses risks associated with AI systems, and their development and maintenance, to identify suitable test practices, approaches and techniques applicable to AI systems and their components. When the test practices, approaches and techniques are already specified in the ISO/IEC/IEEE 29119 series, this document provides additional detail and describes their application in the context of AI systems.