70
Views
0
CrossRef citations to date
0
Altmetric
Comment

F*, an interpretable transformation of the F measure, equates to the critical success index

ORCID Icon & ORCID Icon
Article: 2326685 | Received 12 Feb 2024, Accepted 27 Feb 2024, Published online: 07 May 2024

References

  • Larner AJ. The 2x2 matrix. Contingency, confusion, and the metrics of binary classification. 2nd ed. London: Springer; 2024.
  • Powers DMW. What the F measure doesn’t measure … Features, flaws, fallacies and fixes. arXiv. 2015. doi:10.48550/arXiv.1503.06410
  • Dice LR. Measures of the amount of ecological association between species. Ecology. 1945;26(3):297–302. doi:10.2307/1932409
  • Sørensen T. A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons. Kongelige Danske Videnskabernes Selskab. 1948;5(4):1–34.
  • van Rijsbergen CJ. Foundation of evaluation. J Doc. 1974;30:365–373. doi:10.1108/eb026584
  • Hand DJ, Christen P, Kirielle N. F*: an interpretable transformation of the F measure. Mach Learn. 2021;110(3):451–456. doi:10.1007/s10994-021-05964-1
  • Gilbert GK. Finley’s tornado predictions. Am Meteorol J. 1884;1:166–172.
  • Jaccard P. The distribution of the flora in the alpine zone. New Phytol. 1912;11:37–50. doi:10.1111/j.1469-8137.1912.tb05611.x
  • Palmer WC, Allen RA. Note on the accuracy of forecasts concerning the rain problem. Washington (DC): U.S. Weather Bureau manuscript; 1949.
  • Tanimoto TT. An elementary mathematical theory of classification and prediction. Internal IBM Technical Report; 17 Nov 1958; Available from: http://dalkescientific.com/tanimoto.pdf
  • Donaldson RJ, Dyer RM, Kraus MJ. An objective evaluator of techniques for predicting severe weather events. In: Preprints, 9th Conference on Severe Local Storms; Norman, Oklahoma; 1975. p. 312–326.
  • Schaefer JT. The critical success index as an indicator of warning skill. Weather Forecast. 1990;5:570–575. doi:10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2
  • Jolliffe IT. The Dice co-efficient: a neglected verification performance measure for deterministic forecasts of binary events. Meteorol Appl. 2016;23(1):89–90. doi:10.1002/met.1532
  • Jaccard P. Nouvelles recherches sur la distribution florale. Bull Soc Vaudoise Sci Nat. 1908;44:223–270.
  • Jaccard P. Étude comparative de la distribution florale dans une portion des Alpes et des Jura. Bull Soc Vaudoise Sci Nat. 1901;37:547–579.
  • Larner AJ. Assessing cognitive screening instruments with the critical success index. Prog Neurol Psychiatry. 2021;25(3):33–37. doi:10.1002/pnp.719
  • Mbizvo GK, Bennett KH, Simpson CR, et al. Using critical success index or Gilbert skill Score as composite measures of positive predictive value and sensitivity in diagnostic accuracy studies: weather forecasting informing epilepsy research. Epilepsia. 2023;64:1466–1468. doi:10.1111/epi.17537
  • Mbizvo GK, Larner AJ. Isolated headache is not a reliable indicator for brain cancer. Clin Med. 2022;22(1):92–93. doi:10.7861/clinmed.Let.22.1.2
  • Mbizvo GK, Larner AJ. Re: realistic expectations are key to realising the benefits of polygenic scores. BMJ. [cited 2022 Mar 11]. Available from: https://www.bmj.com/content/380/bmj-2022-073149/rapid-responses
  • Mbizvo GK, Simpson CR, Duncan SE, et al. Critical success index or F measure to validate the accuracy of administrative healthcare data identifying epilepsy in deceased adults in Scotland. Epilepsy Res. 2024;199:107275. doi:10.1016/j.eplepsyres.2023.107275
  • Mbizvo GK, Larner AJ. On the dependence of the critical success index (CSI) on prevalence. medRxiv. doi:10.1101/2023.12.03.23299335