Information technology — Coded representation of immersive media — Part 8: Network based media processing
Introduction: This document defines a framework that enables initializing and controlling media processing in a network. A network-based media processing (NBMP) source describes the requested media processing and provides information about the nature and format of the media data. Based on that, an NBMP workflow manager establishes the media processing workflow and informs the NBMP client that the workflow is ready, and that media processing can start. The media source(s) can then start transmitting their media to the network for processing. An NBMP workflow can be understood as a connected graph of media processing tasks, each of which performs a well-defined media processing operation. The workflow manager ensures the correct operation of the workflow by configuring and monitoring each task as well as the workflow output. The workflow manager is responsible for the selection of the media processing functions and instantiating them as tasks based on the workflow description that is received from the NBMP client. NBMP abstracts the underlying computing platform interactions to establish, load, instantiate and monitor the media processing entities that will run the media processing tasks. NBMP defines application programming interfaces (APIs) between an NBMP client and workflow manager; workflow manager and task(s); and an API to discover appropriate function(s). NBMP is media format and protocol agnostic. However, it identifies and signals the media, metadata and auxiliary information forma
Scope: The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.