Information technology — Genomic information representation — Part 3: Metadata and application programming interfaces (APIs)
Introduction: The advent of high-throughput sequencing (HTS) technologies has the potential to boost the adoption of genomic information in everyday practice, ranging from biological research to personalized genomic medicine in the clinic. As a consequence, the volume of generated data has increased dramatically during the last few years, and an even more pronounced growth is expected in the near future. At the moment, genomic information is mostly exchanged through a variety of data formats, such as FASTA/FASTQ for unaligned sequencing reads and SAM/BAM/CRAM for aligned reads. With respect to such formats, the ISO/IEC 23092 series provides a new solution for the representation and compression of genome sequencing information by: — specifying an abstract representation of the sequencing data rather than a specific format with its direct implementation; — being designed at a time point when technologies and use cases are more mature. This permits the addressing of one limitation of the textual SAM format, for which incremental ad-hoc addition of features followed along the years, resulting in an overall redundant and suboptimal format which at the same time results not general and unnecessarily complicated; — normatively separating free-field user-defined information with no clear semantics from the normative genomic data representation. This allows a fully interoperable and automatic exchange of information between different data producers; — allowing multiplexing of relevant metadata info
Scope: This document specifies information metadata, metrics metadata, clinical data linkage metadata, auxiliary fields, SAM interoperability, protection metadata and programming interfaces of genomic information. It defines: — metadata storage and interpretation for the different encapsulation levels as specified in ISO/IEC 23092-1 (in Clause 6); — metrics metadata containing sequencing data metrics at the dataset and access unit levels as specified in ISO/IEC 23092-1 (in Clause 7); — clinical data linkage metadata stored at the dataset group, dataset and annotation table levels as specified in ISO/IEC 23092-1 (in Clause 8); — protection elements providing confidentiality, integrity and privacy rules at the different encapsulation levels as specified in ISO/IEC 23092-1 (in Clause 9); — how to associate auxiliary fields to encoded reads (in Clause 10); — interfaces to access genomic information coded in compliance with ISO/IEC 23092-1 and ISO/IEC 23092-2 (in Clause 12); — mechanisms for backward compatibility with existing SAM content, and exportation to this format (in Annex E).