Encoding ordinal features into binary features for text classification

Esuli A., Sebastiani F.

Design Methodology. Classifier design and evaluation  Supervised learning  Ordinal features  Integer-valued features  Segmentation of ordinal features 

We propose a method by means of which supervised learning algorithms that only accept binary input can be extended to use ordinal (i.e., integer-valued) input. This is much needed in text classification, since it becomes thus possible to endow these learning devices with term frequency information, rather than just information on the presence/absence of the term in the document. We test two different learners based on ``boosting'', and show that the use of our method allows them to obtain effectiveness gains. We also show that one of these boosting methods, once endowed with the representations generated by our method, outperforms an SVM learner with tfidf-weighted input.

Source: 31st European Conference on Information Retrieval - ECIR'09, pp. 771–775, Toulouse, FR, 7-9 April 2009