Information technology - Software and systems engineering - Tools and methods for product line testing
Introduction: The main purpose of this document is to deal with the capabilities of methods and tools of software and systems product line (SSPL) testing. This document defines how methods and tools can support the software and systems product line-specific testing processes. Product line engineering sets up a common product line platform including identified key variability and develops individual systems on top of the platform. Variability realizes flexibility among member products, and it is closely related to the purpose of the product line reuse. In addition to the verification and validation of commonalities, domain testing generates reusable test artefacts, so as to minimize test efforts in application testing. However, variability continues throughout the product line life cycle, and its resolution phase is diverse. Thus, the complexity of product line testing becomes high. Testing in product line engineering differs from testing in the single system development in the following aspects: — there are two testing life cycles, domain testing and application testing; — test cases generated during domain testing can be incomplete due to unresolved variability; — integration and system testing should be executed in the absence of non-functioning components because even complete test cases can interact with components or subsystems that include unresolved variability; — application testing should be performed by reusing domain test assets and avoid retesting what has been tested during do
Scope: This document, within the methods and tools of testing for software and systems product lines: — provides the terms and definitions specific to testing for software and systems product lines; — defines processes performed during product line testing (those processes are described in terms of purpose, inputs, tasks and outcomes); — defines method capabilities to support the defined tasks of each process; and — defines tool capabilities to automate/semi-automate tasks or defined method capabilities. This document concerns processes and capabilities of testing methods and tools for a family of products, not for a single system.