192
Views
0
CrossRef citations to date
0
Altmetric
Review Articles

Fuzzy data definitions distort fair comparability of universities in university rankings: results from Italy and Belgium on the Times Higher Education Ranking

ORCID Icon, , ORCID Icon &
Pages 75-96 | Published online: 19 Feb 2023
 

Abstract

World university rankings have had an impact on academic competition worldwide. The comparability of ranking results depends on how data is collected within each university. When data concepts are interpreted differently, data variety is introduced and ranking results cannot be used in a meaningful manner. In this case study, the effect of semantic harmonisation of the data concepts of the Times Higher Education World University Ranking is evaluated. Based on two independent initiatives, in Italy and in Belgium, the data and results of this ranking before and after interuniversity harmonisation of data collection are compared. This study demonstrates that, despite the data definitions provided by the ranking organisation, the data concepts ‘academic staff’ and ‘students’ are interpreted differently within each university. These differences can affect how universities are positioned relative to each other in ranking tables. A profound level of semantic harmonisation is then required to ensure semantically comparable data.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Acknowledgements

This project has been realised thanks to the efforts of many. Special thanks go to the members of the participating universities in Flanders, to the Flemish Interuniversity Council, to the Working Group on ‘International academic rankings’ at the Conference of Italian Rectors, and to the 62 universities partaking since October 2017. The research of the Flemish ranking initiative is part of the ‘Data and classification governance, semantics and information management’ project of the Expertise Centre for Research & Development Monitoring (ECOOM) in Flanders. This work was supported by the Department of Economy, Science, and Innovation, Flanders.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 480.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.