2017
Contribution to conference  Open Access

Grey Literature and Research Assessment exercises: from the current criteria to the Open Science models

Giannini S., Deluca R., Molino A., Biagioni S.

VQR  Grey Literature  Research assessment 

In the recent years the application of strategies, procedures and tools to evaluate the research have become subject of interest and their application is currently matter of discussion. The assessment exercises are regulated at national level and are carried out in different European countries such as France, United Kingdom and The Netherlands. In Italy the first research assessment exercise has been legislated in 2003 and entrusted to a specific Committee named Comitato di Indirizzo per la Valutazione della Ricerca (CIVR)1. Three years later the CIVR and other committees have been replaced by a specific Agency named Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca (ANVUR). This Agency, set up at the end of 2006, aims to «...rationalize the system of assessment of the quality of Universities, state and private Research Institutions beneficiary of public funds...» « The results of these activities managed by ANVUR represent a criteria to assign the state funds to Universities and Research Institutions». It is not hard to imagine that the effects of this type of exercise has a strong political implication and determines a significant economic impact on the future of Universities and Research Institutions. The debate concerning the adopted methods and critical aspects about the assessment exercises is studied thoroughly at international level. At the present time, ANVUR has completed two evaluation exercises of the quality of the research named Valutazione della Qualità della Ricerca (VQR): the first one spans the years 2004 - 2010; the second from 2011 to 2014. The work analyzes the environment of VQR in order to understand the organizational set-up, the operational models, the scientific areas involved in the process, the selection and evaluation criteria and indicators of the research products. The work looks at the environment of VQR in order to understand the organizational set-up, the operational models, the scientific Areas involved in the process and the selection and evaluation criteria of the research products. More in detail, our work analyzes and compares the evaluation exercises conducted in Italy with the aim of verifying if and how Grey Literature is involved in the research evaluation processes. The article checked the types of products admissible for the research assessment and those actually presented by the researchers of Universities and Research Institutions. We measured the products from a quantitative point of view and observed their ramification in the different disciplinary fields rather than their transformation during the period of time taken into consideration. At the same time, we focused on the Open Science movement in order to understand what could be its role within the research assessment exercises and how it could affect the future of scholarly scientific communication.

Source: Nineteenth International Conference on Grey Literature, pp. 17–22, Rome, Italy, 23-24 October 2017



Back to previous page
BibTeX entry
@inproceedings{oai:it.cnr:prodotti:384163,
	title = {Grey Literature and Research Assessment exercises: from the current criteria to the Open Science models},
	author = {Giannini S. and Deluca R. and Molino A. and Biagioni S.},
	booktitle = {Nineteenth International Conference on Grey Literature, pp. 17–22, Rome, Italy, 23-24 October 2017},
	year = {2017}
}