Software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Quality model for AI systems
Introduction: High-quality software products and computer systems are crucial to stakeholders. Quality models, quality requirements, quality measurement, and quality evaluation are standardized within the International Standards on SQuaRE, see Annex A for further information. AI systems require additional properties and characteristics of systems to be considered, and stakeholders have varied needs. AI systems have different properties and characteristics. For example, AI systems can: — replace human decision-making; — be based on noisy, or incomplete data; — be probabilistic; — adapt during operation. According to ISO/IEC TR 24028,[2] trustworthiness has been understood and treated as both an ongoing organizational process as well as a non-functional requirement specifying emergent properties of a system — that is, a set of inherent characteristics with their attributes — within the context of quality of use as indicated in ISO/IEC 25010. ISO/IEC TR 24028 discusses the applicability to AI systems of that have been developed for conventional software. According to ISO/IEC TR 24028, does not sufficiently address the data-driven unpredictable nature of AI systems. While considering the existing body of work, ISO/IEC TR 24028 identifies the need for developing new International Standards for AI systems that can go beyond the characteristics and requirements of conventional software development. ISO/IEC TR 24028 contains a related discussion on different approaches to testing and evaluation of
Scope: This document outlines a quality model for AI systems and is an application-specific extension to the standards on SQuaRE. The characteristics and sub-characteristics detailed in the model provide consistent terminology for specifying, measuring and evaluating AI system quality. The characteristics and sub-characteristics detailed in the model also provide a set of quality characteristics against which stated quality requirements can be compared for completeness.