Systems and software engineering - Information technology project performance benchmarking framework - Part 3: Guidance for reporting
Introduction: Benchmarking is an activity of comparing objects of interest to each other or against a benchmark to evaluate characteristic(s). In the context of the ISO/IEC 29155 series, the “object of interest” is the performance of information technology (IT) project, and the characteristic is a particular aspect of an IT project such as productivity. The benchmarking is one of the fastest-growing techniques in the area of IT project management. Instances of IT project performance benchmarking are initiated and conducted for various reasons. Among the most common reasons are a) the need to compare project productivity between similar industries, b) the need to compare productivity between different project types and technologies, c) the need to find the most effective targets for IT development process improvement, d) the need to compare productivity between different suppliers, e) the need to improve project management maturity, f) the need to improve project estimation capability. Much has been written regarding the trials of establishing IT project performance benchmarking, and statistics bear witness to the high failure rate of measurement and benchmarking programs. The most probable causes for failure have been disappointment in the benchmarking outcomes due to a lack of alignment between the selected measurements and business goals, and the misunderstanding of project level measurements in relation to program and portfolio management levels. When there is no alignment between execu
Scope: This part of ISO/IEC 29155 provides general requirements and guidance for reporting processes and contents of typical reports within benchmarking activities of “the information technology (IT) project performance benchmarking framework” by prescribing: — requirements and guidance for the reporting processes within the benchmarking framework; — requirements and guidance for the contents of reports. This part of ISO/IEC 29155 focuses on three major activities, i.e. “conduct benchmarking”, “maintain repository”, and “issue benchmarks” activities. NOTE 1 These activities are selected, not only because the importance of the outcomes of these activities, but also the outcomes of these activities are the direct input for benchmarking users who execute “core benchmarking” activities. In addition, benchmarking users are not usually so deeply involved to these activities even though they need in-deep information to understand the benchmarking results or to select appropriate data (i.e. benchmarking repository and benchmarks). This part of ISO/IEC 29155 also focuses on two types of reports in the benchmarking framework: a) the benchmarking report, that describes the results of an instance of benchmarking; b) the explanatory report, that provides complementary information about the released benchmarking repository or benchmark(s). This part of ISO/IEC 29155 is intended for use by stakeholder(s) of IT project performance benchmarking (e.g. benchmarking user, benchmark provider, and benchmarking service provider). NOTE 2 The following are examples of how this part of ISO/IEC 29155 can be used: — by a systems and software acquirer (or a third-party agent), to define, order, obtain and evaluate an acceptable and creditable benchmarking report; — by a benchmarking service provider, to produce a high-quality benchmarking report; — by a benchmark provider, to provide complementary information about the released benchmarking repository or issued benchmarks. It is out of the scope of this part of ISO/IEC 29115 to prescribe the particular names, formats, or explicit contents of the reports of the benchmarking activities.