Multisensor data fusion for activity recognition based on reservoir computing

Palumbo F, Barsocchi P, Gallicchio C, Chessa S, Micheli A

AAL  Activity Recognition  Neural Networks  Sensor Data Fusion  WSN  C.2 COMPUTER-COMMUNICATION NETWORKS 

Ambient Assisted Living facilities provide assistance and care for the elderly, where it is useful to infer their daily activity for ensuring their safety and successful ageing. In this work, we present an Activity Recognition system that classifies a set of common daily activities exploiting both the data sampled by accelerometer sensors carried out by the user and the reciprocal Received Signal Strength (RSS) values coming from worn wireless sensor devices and from sensors deployed in the environment. To this end, we model the accelerometer and the RSS stream, obtained from a Wireless Sensor Network (WSN), using Recurrent Neural Networks implemented as efficient Echo State Networks (ESNs), within the Reser- voir Computing paradigm. Our results show that, with an appropriate configuration of the ESN, the system reaches a good accuracy with a low deployment cost.