Vienna STS Talk

Recent years have seen an increasing critique on the application of research metrics as a means of evaluation (DORA Declaration, 2012, the Leiden Manifesto, 2014). In this lecture, we will discuss bibliometrics as a tool in research evaluation processes, with a critical perspective on the application of research metrics in assessing research. After a historical positioning of the use of such metrics in research evaluation practices, we will delve into the various levels of criticism related to the application of research metrics. These various layers can be characterized as ranging from macro to micro level, or from a conceptual level to a very technical level. On a conceptual level, we will show the limitations of research metrics, while on a methodological level the adequacy (or the lack thereof) of databases supporting research assessment will be shown. Finally, some of the most infamous research metrics, the Journal Impact Factor and the h-index, will be discussed in the lecture. There will also be possibility to discuss other topics related to research metrics and their application, in the context of my experience with them in assessment procedures.