Requirements classification for smart allocation: a case study in the railway industry

Bashir S., Abbas M., Ferrari A., Saadatmand M., Lindberg P.

Requirements classification  Natural Language Processing  Requirements allocation  Language models 

Allocation of requirements to different teams is a typical preliminary task in large-scale system development projects. This critical activity is often performed manually and can benefit from automated requirements classification techniques. To date, limited evidence is available about the effectiveness of existing machine learning (ML) approaches for requirements classification in industrial cases. This paper aims to fill this gap by evaluating state-of-the-art language models and ML algorithms for classification in the railway industry. Since the interpretation of the results of ML systems is particularly relevant in the studied context, we also provide an information augmentation approach to complement the output of the ML-based classification. Our results show that the BERT uncased language model with the softmax classifier can allocate the requirements to different teams with a 76% F1 score when considering requirements allocation to the most frequent teams. Information augmentation provides potentially useful indications in 76% of the cases. The results confirm that currently available techniques can be applied to real-world cases, thus enabling the first step for technology transfer of automated requirements classification. The study can be useful to practitioners operating in requirements-centered contexts such as railways, where accurate requirements classification becomes crucial for better allocation of requirements to various teams.

Source: RE 2023 - 31st IEEE International Requirements Engineering Conference, pp. 201–211, Hannover, Germany, 4-8/09/2023

Publisher: IEEE Computer Society, Los Alamitos, CA, USA

Metrics