ABRICOT - ABstRactness and Inclusiveness in COntexT: a CALAMITA challenge
Puccetti G., Collacciani C., Ravelli A. A., Esuli A., Bolognesi M. M.
Abstraction Inclusiveness Large Language Models
The ABRICOT Task is designed to evaluate Italian language models on their ability to understand and assess the abstractness and inclusiveness of language, two nuanced features that humans naturally convey in everyday communication. Unlike binary categorizations such as abstract/concrete or inclusive/exclusive, these features exist on a continuous spectrum with varying degrees of intensity. The task is based on a manual collection of sentences that present the same noun phrase (NP) in different contexts, allowing its interpretation to vary between the extremes of abstractness and inclusiveness. This challenge aims to verify the how LLMs perceive subtle linguistic variations and their implications in natural language.
Source: CEUR WORKSHOP PROCEEDINGS, vol. 3878. Pisa, Italy, 4-6/12/2024
Back to previous page
@inproceedings{oai:iris.cnr.it:20.500.14243/528781,
title = {ABRICOT - ABstRactness and Inclusiveness in COntexT: a CALAMITA challenge},
author = {Puccetti G. and Collacciani C. and Ravelli A. A. and Esuli A. and Bolognesi M. M.},
booktitle = {CEUR WORKSHOP PROCEEDINGS, vol. 3878. Pisa, Italy, 4-6/12/2024},
year = {2024}
}
0000-0002-5725-4322