Information technology — Artificial intelligence — Overview of machine learning computing devices
Introduction: As an important approach for realizing artificial intelligence (AI), machine learning (ML) has been applied to and has improved productivity in multiple domains (e.g. education, finance, environment protection). ML computing devices can be essential to the development and deployment of many types of AI systems. An ML computing device can have a set of characteristics, including supported datatypes, ML operators, buffer settings, access and share mechanisms, memory access and addressing mechanisms, virtualization and sharing mechanisms, job scheduling mechanisms, topologies, data exchange mechanisms and memory interoperability mechanisms. Use and setting of these characteristics can affect the overall performance of an ML computing device. The performance of an ML computing device used to develop and deploy an AI system can be crucial to business effectiveness and efficiency. This document surveys and provides information to AI stakeholders to assist them in understanding the representative characteristics of ML computing devices. In Clause 5, ML computing device-related concepts are discussed. Clause 6 summarizes ML computing device characteristics. In Clause 7, existing approaches for optimizing ML computing devices’ performance are discussed. © ISO/IEC 2024 – All rights reserved
Scope: This document surveys machine learning (ML) computing devices, including the following: — ML computing device terminology and characteristics; — existing approaches to the setting and use of characteristics for optimizing ML computing device performance. The information provided in this document is relevant for organizations of all types and sizes.