Towards adaptation of humanoid robot behaviour in serious game scenarios using reinforcement learning

Zedda E., Manca M., Paternò F.

Social robot  Adaptive robot behaviour  Reinforcement learning 

Repetitive cognitive training can be seen as tedious by older adults and cause participants to drop out. Humanoid robots can be exploited to reduce boredom and the cognitive burden in playing serious games as part of cognitive training. In this paper, an adaptive technique to select the best actions for a robot is proposed to maintain the attention level of elderly users during a serious game. The goal is to create a strategy to adapt the robot's behaviour to stimulate the user to remain attentive through reinforcement learning. Specifically, a learning algorithm (QL) has been applied to obtain the best adaptation strategy for the selection of the robot's actions. The robot's actions consist of a combination of verbal and nonverbal interaction aspects. We have applied this approach to the behaviour of a Pepper robot for which two possible personalities have been defined. Each personality is exhibited by performing specific actions in the various modalities supported. Simulation results indicate learning convergence and seem promising to validate the effectiveness of the obtained strategy. Preliminary test results with three participants suggest that the adaption in the robot is perceived.

Source: ALTRUIST 2022 - 2nd Workshop on sociAL roboTs for peRsonalized, continUous and adaptIve aSsisTance, pp. 93–99, Florence, Italy, 16/12/2022