2021
Journal article  Open Access

Lost in transduction: transductive transfer learning in text classification

Moreo A., Esuli A., Sebastiani F.

Transduction  Induction  Transfer learning  Text classification  Distributional hypothesis 

Obtaining high-quality labelled data for training a classifier in a new application domain is often costly. Transfer Learning(a.k.a. "Inductive Transfer") tries to alleviate these costs by transferring, to the "target"domain of interest, knowledge available from a different "source"domain. In transfer learning the lack of labelled information from the target domain is compensated by the availability at training time of a set of unlabelled examples from the target distribution. Transductive Transfer Learning denotes the transfer learning setting in which the only set of target documents that we are interested in classifying is known and available at training time. Although this definition is indeed in line with Vapnik's original definition of "transduction", current terminology in the field is confused. In this article, we discuss how the term "transduction"has been misused in the transfer learning literature, and propose a clarification consistent with the original characterization of this term given by Vapnik. We go on to observe that the above terminology misuse has brought about misleading experimental comparisons, with inductive transfer learning methods that have been incorrectly compared with transductive transfer learning methods. We then, give empirical evidence that the difference in performance between the inductive version and the transductive version of a transfer learning method can indeed be statistically significant (i.e., that knowing at training time the only data one needs to classify indeed gives an advantage). Our clarification allows a reassessment of the field, and of the relative merits of the major, state-of-The-Art algorithms for transfer learning in text classification.

Source: ACM transactions on knowledge discovery from data 16 (2021). doi:10.1145/3453146

Publisher: Association for Computing Machinery,, New York, NY , Stati Uniti d'America


Metrics



Back to previous page
BibTeX entry
@article{oai:it.cnr:prodotti:456427,
	title = {Lost in transduction: transductive transfer learning in text classification},
	author = {Moreo A. and Esuli A. and Sebastiani F.},
	publisher = {Association for Computing Machinery,, New York, NY , Stati Uniti d'America},
	doi = {10.1145/3453146},
	journal = {ACM transactions on knowledge discovery from data},
	volume = {16},
	year = {2021}
}
CNR ExploRA

Bibliographic record

ISTI Repository

Postprint version Open Access

DOI

10.1145/3453146

Also available from

dl.acm.orgRestricted

ARIADNEplus
Advanced Research Infrastructure for Archaeological Data Networking in Europe - plus


OpenAIRE