Remind me of something? Zero-Shot learning for trustworthy image comparison in rolling stock

Papini Oscar, Del Corso Giulio, Bulotta Davide, Carboni Andrea, Gravili Silvia, Leone Giuseppe Riccardo, Pascali Maria Antonietta, Moroni Davide, Colantonio Sara

Trustworthy AI, Posthoc UQ method, Reliability measure 

This paper discusses the need for trustworthy AI in urban mobility, focusing on high-stakes security applications such as anomaly detection in public transportation. Because the accuracy required to identify potentially dangerous objects often surpasses the capabilities of current models, there is an unavoidable incidence of false positives. We suggest a "learning to defer" approach as a solution. Our technique uses the deep features and label relative importance of a pre-trained classifier (DenseNet/ImageNET-1k) to create a unique item "fingerprint". We then employ a zero-shot meta-learning approach to calibrate the system, enabling it to distinguish between normal background items and genuine anomalies by assigning a similarity score. This method significantly reduces the false "new object" alarms that would otherwise overwhelm human operators. Our proof-of-concept demonstrates that the system is computationally light and can be easily adapted to specific environments and integrated into existing classification modules.

Source: LECTURE NOTES IN COMPUTER SCIENCE, vol. 16170, pp. 323-334. Roma, Italy, 15-19/09/2025

Publisher: Springer

Metrics