Evaluation of indoor localisation systems: comments on the ISO/IEC 18305 standard

Potortì F., Crivello A., Barsocchi P., Palumbo F.

Performance evaluation  IPIN-ISC  Indoor localisation systems  2016 [ISO/IEC 18305]  ISO/IEC 18305:2016 

Indoor localisation systems have been studied in the literature for more than ten years and are starting to approach the market. The absence of standard evaluation methods is one of the obstacles to their adoption outside of customised environments. Specifically, the definition of benchmarking methodologies, common evaluation criteria, standardised methodologies useful to developers, testers, and end users is an open challenge. The need for common benchmarks has been tackled by some initiatives in recent years: EvAAL, EVARILOS, the Microsoft competition and the IPIN competition. The first formal attempt at defining a standard methodology to evaluate indoor localisation systems is the ISO/IEC\,18305:2016 International Standard, which defines a complete framework for performing Test&Evaluation of localisation and tracking systems. This work is a first critical reading of the standard, intended to be a key contribution to the activities of the International Standards Committee of IPIN.

Source: IPIN 2018 - International Conference on Indoor Positioning and Indoor Navigation, Nantes, France, 24-27 September 2018

Metrics