Information technology - Computer graphics, image processing and environmental data representation - Benchmarking of vision-based spatial registration and tracking methods for mixed and augmented reality (MAR)
Introduction: In the development of mixed and augmented reality (MAR) applications, one of the most important technologies involves spatial registration and spatial tracking methods, especially vision-based methods. The research and development on registration and tracking based on computer vision technologies is flourishing and many new algorithms have been proposed every year. Therefore, this document aims at fostering objective evaluation and comparison of diverse registration and tracking methods, in order to facilitate fairer competition among small and major companies/ institutes involved in MAR technologies, applications and services. Moreover, this document can be the baseline to standardize spatial registration and tracking methods which not only utilize a video camera but combine a video camera with other sensors such as another video camera, a depth camera, inertial sensors and infrastructure-based positioning technologies, and which utilize technologies such as IoT (Internet of Things) and GNSS (Global Navigation Satellite System). The target audience of this document includes stakeholders of benchmarking activities. The following are examples of how this document can be used directly or indirectly: — by a benchmarking service provider, a benchmark provider or a benchmarking competition organizer who wishes to align their benchmarking activities including self-benchmarking and open/closed competitions to be consistent with this document; — by a technology developer/supplier who
Scope: This document identifies the reference framework for the benchmarking of vision-based spatial registration and tracking (vSRT) methods for mixed and augmented reality (MAR). The framework provides typical benchmarking processes, benchmark indicators and trial set elements that are necessary to successfully identify, define, design, select and apply benchmarking of vSRT methods for MAR. It also provides definitions for terms on benchmarking of vSRT methods for MAR. In addition, this document provides a conformance checklist as a tool to clarify how each benchmarking activity conforms to this document in a compact form by declaring which benchmarking processes and benchmark indicators are included and what types of trial sets are used in each benchmarking activity.