Systems and software engineering - Information technology project performance benchmarking framework - Part 4: Guidance for data collection and maintenance
Introduction: Benchmarking is an activity of comparing “objects of interest” to each other or against a benchmark to evaluate characteristic(s). In the context of the ISO/IEC 29155 series, the “object of interest” is the performance of information technology (IT) project, and the characteristic is a particular aspect of an IT project such as productivity. Benchmarking is one of the fastest-growing techniques in the area of IT project management. Instances of IT project performance benchmarking are initiated and conducted for various reasons. Among the most common reasons are the following: a) the need to compare project productivity between similar industries; b) the need to compare productivity between different project types and technologies; c) the need to find the most effective targets for IT development process improvement; d) the need to compare productivity between different suppliers; e) the need to improve project management maturity; f) the need to improve project estimation capability. Much has been written regarding the trials of establishing IT project performance benchmarking, and statistics bear witness to the high failure rate of measurement and benchmarking programs. The most probable causes for failure have been disappointment in the benchmarking outcomes due to a lack of alignment between the selected measurements and business goals, and the misunderstanding of project level measurements in relation to program and portfolio management levels. When there is no alignment
Scope: This document provides general requirements and guidance for collecting and maintaining data of information technology (IT) projects and for delivering the benchmarking repository within benchmarking activities of “the IT project performance benchmarking framework” by prescribing the following: a) requirements and guidance for data element definitions; b) requirements and guidance for the data collection and maintenance processes within the benchmarking framework; c) requirements and guidance for maintaining benchmarking repository product and issued benchmarks. This document mainly focuses on three major activities, which are “maintain repository”, “submit IT project data”, and “measure IT project” activities. This document is intended for use by stakeholder(s) of IT project performance benchmarking (e.g. benchmarking user, benchmark provider, benchmarking service provider, and IT project team). NOTE The following are examples of how this document can be used: — by a benchmark provider, to define data elements, collect and maintain IT project data, and provide benchmarking repository product or issued benchmarks; — by a benchmarking analyst, to use benchmarking repository product and/or benchmarks for executing an instance of benchmarking; — by a benchmarking service provider, to utilize benchmarking repository product and/or benchmarks for providing benchmarking services; — by an IT service provider, to define data elements to be measured and/or to be submitted to repository owner. It is out of the scope of this document to prescribe a particular set of data element definitions, formats or contents of the benchmarking repository.