Information technology — Artificial intelligence — Environmental sustainability aspects of AI systems
Introduction: Unprecedentedly large and ever-growing deep learning models, large language models, natural language understanding networks and generative AI applications require vast data storage capacities, take weeks to train, are running continuously and require a lot of compute power as well as memory to load the models. And once completed they consume substantial amounts of network connectivity bandwidth in operation. Sixty per cent of IT industry carbon emissions come from the downstream use of products by customers. The use of power intensive GPUs to run machine learning training (and non-AI uses such as crypto currency mining) has already been cited as contributing to increased carbon dioxide emissions.[1] Many machine learning packages have been modified to take advantage of the extensive parallelism available inside the average graphics processing unit. Often this resource intensity is used to exemplify environmental concerns with AI systems. According to the World Economic Forum and experts in the field, AI has “the potential to accelerate environmental degradation, and is already doing so” [1,2]. In 2022, the OECD’s Policy Observatory [3] that provided input into basic framework for understanding, measuring and benchmarking domestic AI computing capacity by country and region, did not consider environmental sustainability in its charter [4]. The AI system life cycle does provide opportunities to consider and positively influence the environmental sustainability aspects of the sy
Scope: This document provides an overview of the environmental sustainability aspects (e.g. workload, resource and asset utilization, carbon impact, pollution, waste, transportation, location) of AI systems during their life cycle, and related potential metrics. NOTE 1 This document does not identify opportunities on how AI, AI applications and AI systems can improve environmental, social or economic sustainability outcomes. NOTE 2 This document can help other projects related to AI system environmental sustainability.