Information technology — Media context and control — Part 3: Sensory information
Introduction: The ISO/IEC 23005 series provides an architecture and specifies information representation of data flowing in and out of the real world and virtual worlds. The data for the real world are communicated through sensors and actuators. The data for virtual worlds consist of properties of virtual objects and multi-sensorial data embedded in audio-visual content. MPEG-V specifies data formats for sensors, actuators, virtual objects, and audio-visual content. Data captured from the real world could need to be adapted for use in a virtual world and data from virtual worlds could also need to be adapted for use in the real world. This document does not specify how the adaptation is carried out but only specifies the interfaces. Data for sensors are sensor capabilities, sensed data, and sensor adaptation preferences. Data for actuators are sensory device capabilities, sensory device commands, and sensory effect preferences. Data for virtual objects are characteristics of avatars and virtual world objects. Sensory effect could be needed to enrich audio-visual contents. The system architecture is depicted in Figure 1 and the scope of this document is highlighted. That is only the information representation that acts as an input to the possible Adaptation VR – as defined in ISO/IEC 23005-1 – is specified in this document. Figure 1 — Scope of ISO/IEC 23005-3 marked with a yellow box © ISO/IEC 2019 – All rights reserved
Scope: The technologies specified in this document are description languages and vocabularies which describe sensorial effects. The adaptation engine is not within the scope of this document (or the ISO/IEC 23005 series). This document specifies syntax and semantics of the tools describing sensory information to enrich audio-visual contents: — Sensory Effect Description Language (SEDL) as an XML schema-based language which enables one to describe a basic structure of sensory information; — Sensory Effect Vocabulary (SEV), an XML representation for describing sensorial effects such as light, wind, fog, vibration, etc. that trigger human senses.