Information technology - Scalable compression and coding of continuous-tone still images - Part 4: Conformance testing
Introduction: The ISO/IEC 18477 series, also known under the term JPEG XT, specifies lossy and lossless codestream formats for storage of continous-tone high and low dynamic range photographic content. All parts of the ISO/IEC 18477 series are compatible to the Recommendation ITU-T T.81 | ISO/IEC 10918, also commonly known as JPEG. That is, any decoder conforming to the latter standard will be able to reconstruct codestreams from the ISO/IEC 18477 series to an 8 bits/sample image. Additional features offered by ISO/IEC 18477, such as representation of intermediate or high-dynamic range images, or lossless reconstruction require an extended decoder that implements, in addition to the Rec. ITU-T T.81 | ISO/IEC 10918-1, also one or multiple members of ISO/IEC 18477. This document provides the framework, concepts and methodology for testing codestreams and implementations, and the criteria to be achieved to claim conformance to the parts and profiles of ISO/IEC 18477. The objective of this document is to promote interoperability between JPEG XT decoders, and to test these systems for conformance to one or multiple specifications that are part of the JPEG XT. Conformance testing is the testing of a candidate implementation for the existence of specific characteristics required by a standard. It involves testing the capabilities of an implementation against the conformance requirements in the relevant standard. The purpose of this document is to define a common test methodology, to provide a fra
Scope: This document specifies the framework, concepts, methodology for testing, and criteria to be achieved to claim conformance to one or multiple parts of ISO/IEC 18477 as listed below. It provides a framework for specifying abstract test suites and for defining the procedures to be followed during conformance testing. This document — specifies conformance testing procedures for decoding of ISO/IEC 18477-1, 18477-2, ISO/IEC 18477- 6, ISO/IEC 18477-7, ISO/IEC 18477-8 and ISO/IEC 18477-9, — specifies conformance testing procedures for codestreams to the above International Standards, — specifies codestreams, decoded images, and error metrics to be used within the decoder testing procedures, and — specifies abstract test suites. This document does not include the following tests: — testing decoders for conformance to ISO/IEC 18477-3 only. ISO/IEC 18477-6, ISO/IEC 18477- 7, ISO/IEC 18477-8 and ISO/IEC 18477-9 are extensions of ISO/IEC 18477-3 and the required functionality of ISO/IEC 18477-3 is tested as part of the former standards. Testing codestreams for conformance to ISO/IEC 18477-3 is specified in C.2; — testing codestreams for conformance to ISO/IEC 18477-7 beyond testing them for conformance to individual profiles of this document. Testing such codestreams ("full profile codestreams") for syntactical correctness is, however, covered by testing them for conformance to ISO/IEC 18477-3; — testing of the composition of background and foreground for images reconstructed from ISO/IEC 18477-9 codestreams as this operation is application dependent; — acceptance testing: the process of determining whether an implementation satisfies acceptance criteria and enables the user to determine whether or not to accept the implementation. This includes the planning and execution of several kinds of tests (e.g. functionality, quality, and speed performance testing) that demonstrate that the implementation satisfies the user requirements; — performance testing: measures the performance characteristics of an implementation under test (IUT) such as its throughput, responsiveness, etc. under various conditions. — robustness testing: the process of determining how well an implementatio