Information technology — Coded representation of immersive media — Part 4: MPEG-I immersive audio
Introduction: 0.1 General MPEG-I Immersive audio reproduction with six degrees of freedom (6DoF) movement of the listener in an audio scene enables the experience of virtual acoustics in a Virtual Reality (VR) or Augmented Reality (AR) simulation. Audio effects and phenomena known from real-world acoustics like, for example, localization, distance attenuation, reflections, reverberation, occlusion, diffraction and the Doppler effect are modelled by a renderer that is controlled through metadata transmitted in a bitstream with additional input of interactive listener position data. Along with other parts of MPEG-I (i.e. ISO/IEC 23090-12, “Immersive Video”, ISO/IEC 23090-5, “Visual Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression” and ISO/IEC 23090-2, “Systems Support”), the ISO/IEC 23090 series of standards supports a complete audio-visual VR or AR presentation in which the user can navigate and interact with the simulated environment using 6DoF, that being spatial navigation (x, y, z) and user head orientation (yaw, pitch, roll). While VR presentations impart the feeling that the user is actually present in the virtual world, AR enables the enrichment of the real world by virtual elements that are perceived seamlessly as being part of the real world. The user can interact with the virtual scene or virtual elements and, in response, cause sounds that are perceived as realistic and matching the users’ experience in the real world. This document provides means for r
Scope: This document specifies technology that supports the real-time interactive rendering of an immersive virtual or augmented reality audio presentation while permitting the user to have 6DoF movement in the audio scene. It defines metadata to support this rendering and a bitstream syntax that enables efficient storage and streaming of immersive audio content.
Contents:
- Foreword
- Introduction
- Scope
- 3.1 Terms and definitions
- 3.2 Mnemonics
- 3.3 Abbreviated terms
- 5.1 Overview
- 5.2 Definitions
- 5.3 MHAS syntax
- 5.4 Semantics
- 6.1 Definitions
- 6.2 Syntax
- 6.2.10 Dispersion payload syntax
- 6.2.11 Scene plus payload syntax
- 6.2.12 Airflow payload syntax
- 6.2.13 Granular payload syntax
- 6.2.14 RasterMap payload syntax
- 6.2.15 Support elements
- 6.3 Data structure
- 6.4 Renderer framework
- 6.5 Geometry data decompression
- 6.6 Renderer stages