Fuzzy data definitions distort fair comparability of universities in university rankings: results from Italy and Belgium on the Times Higher Education Ranking

References

• Altbach, P.G. & Knight, J., 2007, ‘The internationalization of higher education: motivations and realities’, Journal of Studies in International Education, 11(3–4), pp. 290–305.
   Google Scholar
• Angelis, L., Bassiliades, N. & Manolopoulos, Y., 2019, ‘On the necessity of multiple university rankings’, COLLNET Journal of Scientometrics and Information Management, 13(1), pp. 11–36.
   Web of Science ®Google Scholar
• Baty, P., 2010, Times Higher Education World University Rankings. Available at https://www.timeshighereducation.co.uk/news/the-world-university-rankings/411739.article/(accessed 27 May 2010).
   Google Scholar
• Benito, M., Gil, P. & Romera, R., 2019, ‘Funding, is it key for standing out in the university rankings?’, Scientometrics, 121, pp. 771–92.
   Web of Science ®Google Scholar
• Bonaccorsi, A., Daraio, C. & Slipersæter, S., 2007, ‘Indicators on individual higher education institutions: addressing data problems and comparability issues’, Research Evaluation, 16, pp. 66–78.
   Web of Science ®Google Scholar
• Bornmann, L., Mutz, R. & Daniel, H.D., 2013, ‘A multilevel-statistical reformulation of citation-based university rankings: the Leiden ranking 2011/2012’, Journal of the American Society of Information Science and Technology, 64(8), pp. 1649–58.
   Web of Science ®Google Scholar
• Bowles, K.H., Potashnik, S., Ratcliffe, S.J., Rosenberg, M.M., Shih, M.N., Topaz, M.M., Holmes, J.H. & Naylor, M.D., 2013, ‘Conducting research using the electronic health record across multi-hospital systems: semantic harmonization implications for administrators’ The Journal of Nursing Administration, 43(6), pp. 355–60.
   PubMed Web of Science ®Google Scholar
• Degli Esposti, M. & Vidotto, G., 2020, CRUI Working Group on International Rankings: Activities, results and prospects 2017–2020. Available at https://www.crui.it/pubblicazioni.html (accessed 22 July 2021).
   Google Scholar
• Fortier, I., Burton, P.R., Robson, P.J., Ferretti, V., Little, J., L'Heureux, F., Deschênes, M., Knoppers, B.M., Doiron, D., Keers, J.C., Linksted, P., Harris, J.R., Lachance, G., Boileau, C., Pedersen, N.L., Hamilton, C.M., Hveem, K., Borugian, M.J., Gallagher, R.P., McLaughlin, J., Parker, L., Potter, J.D., Gallacher, J., Kaaks, R., Liu, B., Sprosen, T., Vilain, A., Atkinson, S.A., Rengifo, A., Morton, R., Metspalu, A., Wichmann, H.E., Tremblay, M., Chisholm, R.L., Garcia-Montero, A., Hillege, H., Litton, J.E., Palmer, L.J., Perola, M., Wolffenbuttel, B.H., Peltonen, L. & Hudson, T.J., 2010, ‘Quality, quantity and harmony: the DataSHaPER approach to integrating data across bioclinical studies’, International Journal of Epidemiology, 39(5), pp. 1383–93.
   PubMed Web of Science ®Google Scholar
• Fortier, I., Raina, P., Van den Heuvel, E., Griffith, L., Craig, C., Saliba, M., Doiron, D., Stolk, R., Knoppers, B., Ferretti, V., Granda, P. & Burton, P., 2017, ‘Maelstrom research guidelines for rigorous retrospective data harmonization’, International Journal of Epidemiology, 46(1), pp. 103–05.
   PubMed Web of Science ®Google Scholar
• Hazelkorn E., 2012, ‘Striving for world class excellence: rankings and emerging societies’, in Araya, D. & Marber, P. (Eds), 2012, Higher Education in the Global Age: Universities, interconnections and emerging societies (London, Routledge).
   Google Scholar
• Hazelkorn E., 2013, ‘World-class universities or world-class systems? Rankings and higher education policy choices’, in Hazelkorn, E., Wells, P. & Marope, M. (Eds), 2013, Rankings and Accountability in Higher Education: Uses and misuses, pp. 71–94 (Paris, UNESCO Publishing).
   Google Scholar
• Hazelkorn, E., 2007, ‘The impact of league tables and ranking systems on higher education decision making’, Higher Education Management and Policy, 19(2), pp. 1–24.
   Google Scholar
• Huisman, J., Meek, L. & Wood, F., 2007, ‘Institutional diversity in higher education: a cross-national and longitudinal analysis’, Higher Education Quarterly, 61(4), pp. 563–77.
   Google Scholar
• Hutchinson, D.M., Silins, E., Mattick, R.P., Patton, G.C., Fergusson, D.M., Hayatbakhsh, R., Toumbourou, J.W., Olsson, C.A., Najman, J.M., Spry, E., Tait, R.J., Degenhardt, L., Swift, W., Butterworth, P. & Horwood, L.J., 2015, ‘How can data harmonisation benefit mental health research? An example of the Cannabis Cohorts Research Consortium’, Australian and New Zealand Journal of Psychiatry, 49, pp. 317–23.
   PubMed Web of Science ®Google Scholar
• Ioannidis, J., Patsopoulos, N., Kavvoura, F., Tatsioni, A., Evangelou, E., Kouri, I., Contopoulos-Ioannidis, D. & Liberopoulos, G., 2007, ‘International ranking systems for universities and institutions: a critical appraisal’, BMC Medicine, 5, pp. 30.
   PubMed Web of Science ®Google Scholar
• Johnes, J., 2018, ‘University rankings: what do they really show?’ Scientometrics, 115, pp. 585–606.
   Web of Science ®Google Scholar
• Madnick, S.E. & Zhu, H., 2005, ‘Improving data quality through effective use of data semantics’, Social Science Research Network Electronic Journal, 59(2), pp. 460–75.
   Google Scholar
• Manu, T., Minaxi, P., Shashikumar, A. & Viral, A., 2019, ‘Research information management systems: a comparative study’, in Bhardwaj, R. & Banks, P. (Eds.), 2019, Research Data Access and Management in Modern Libraries, pp. 54–80 (Hershey, PA, IGI Global).
   Google Scholar
• Marconi, G. & Ritzen, J., 2015, ‘Determinants of international university rankings scores’, Applied Economics, 47(57), pp. 6211–27.
   Web of Science ®Google Scholar
• Marginson, S., 2014, ‘University rankings and social science’, European Journal of Education, 49(1), pp. 45–59.
   Web of Science ®Google Scholar
• Rauhvargers, A., 2011, EUA Report on Rankings 2011: Global University Rankings and Their Impact (Brussels, European University Association). Available at https://eua.eu/resources/publications/384:global-university-rankings-and-their-impact.html (accessed 16 July 2021).
   Google Scholar
• Robinson-Garcia, N., Torres-Salinas, D., Herrera-Viedma, E. & Docampo, D., 2019, ‘Mining university rankings: publication output and citation impact as their basis’, Research Evaluation, 28(3), pp. 232–40.
   Web of Science ®Google Scholar
• Rolland, B., Reid, S., Stelling, D., Warnick, G., Thornquist, M., Feng, Z. & Potter, J.D., 2015, ‘Toward rigorous data harmonization in cancer epidemiology research: one approach’, American Journal of Epidemiology, 182, pp. 1033–38.
   PubMed Web of Science ®Google Scholar
• Sorz, J., Wallner, B., Seidler, H. & Fieder, M., 2015, ‘Inconsistent year-to-year fluctuations limit the conclusiveness of global higher education rankings for university management’, PeerJ: Life and Environment, 3, pp. e1217.
   PubMed Web of Science ®Google Scholar
• Stergiou, K.I. & Lessenich, S., 2014, ‘On impact factors and university rankings: from birth to boycott’, Ethics in Science and Environmental Politics, 13(2), pp. 101–11.
   Google Scholar
• Times Higher Education (THE), 2020, THE World University Rankings 2020: Methodology. Available at https://www.timeshighereducation.com/world-university-rankings/world-university-rankings-2020-methodology (accessed 20 January 2023).
   Google Scholar
• Tuesta, E., Garcia-Zorita, C., Ayllon, R. & Casado, E., 2019, ‘Does a country/region’s economic status affect its universities’ presence in international rankings?’, Journal of Data and Information Science, 4(2), pp. 56–78.
   Web of Science ®Google Scholar
• Usher, A. & Savino, M., 2006, A World of Difference: A global survey of university league tables (Toronto, Educational Policy Institute).
   Google Scholar
• Uslu, B., 2020, ‘A path for ranking success: what does the expanded indicator-set of international university rankings suggest?’, Higher Education, 80, pp. 949–72.
   Web of Science ®Google Scholar
• van den Brink, L., Janssen, P., Quak, W. & Stoter, J., 2017, ‘Towards a high level of semantic harmonisation in the geospatial domain’, Computers, Environment and Urban Systems, 62, pp. 233–42.
   Web of Science ®Google Scholar
• Vernon, M., Balas, E. & Momani, S., 2018, ‘Are university rankings useful to improve research? A systematic review’, PLOS One, 13(3), e0193762.
   PubMed Web of Science ®Google Scholar
• Waltman, L., Wouters, P. & van Eck, N.J., 2017, Ten Principles for the Responsible Use of University Rankings. Available at https://www.cwts.nl/blog?article=n-r2q274 (accessed 1 December 2022).
   Google Scholar
• Wien, J.J.F., Knapen, R., Jansen, S.J.C., Verweij, P.J.F.M., Athanasiadis, I., Li, H., Rizzoli, A. & Villa, F., 2007, ‘Using ontology to harmonize knowledge concepts in data and models’, in Oxley, L. & Kulasiri, D. (Eds.), 2007, MODSIM 2007 International Congress on Modelling and Simulation, pp. 1959–65 (Canberra, Modelling and Simulation Society of Australia and New Zealand).
   Google Scholar
• Young, A. & McConkey, K., 2012, ‘Data governance and data quality: is it on your agenda?’, Journal of Institutional Research, 17(1), pp. 69–77.
   Google Scholar
• Zeb, A., Soininen, J. & Sozer, N., 2021, ‘Data harmonisation as a key to enable digitalisation of the food sector: a review’, Food and Bioproducts Processing, 127, pp. 360–70.
   Web of Science ®Google Scholar