Advertisement
Letters to the Editor|Articles in Press

Response to Statistical Issues on Agreement Analysis

      Thank you very much for your comment regarding the use of Cohens kappa statistics for assessing the agreement. We agree with you that for ordinally scaled variables, the modified Cohens Kappa with linear or quadratic weights can be used. However, the choice of weights is arbitrary. Alternatively, an intraclass correlation coefficient could also be used. There are also other measures of agreement, all of which have their advantages and disadvantages (
      • Gwet K.L.
      Handbook of Inter-Rater ReLiability: the definitive guide to measuring the extent of agreement among raters.
      ,
      • de Raadt A.
      • Warrens M.J.
      • Bosker R.J.
      • et al.
      A comparison of reliability coefficients for ordinal rating scales.
      ).
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Gwet K.L.
        Handbook of Inter-Rater ReLiability: the definitive guide to measuring the extent of agreement among raters.
        Advanced Analytics, LLC, 2014
        • de Raadt A.
        • Warrens M.J.
        • Bosker R.J.
        • et al.
        A comparison of reliability coefficients for ordinal rating scales.
        J Classif. 2021; 38: 519-543https://doi.org/10.1007/s00357-021-09386-5
        • Maschke S.K.
        • Werncke T.
        • Becker L.S.
        • et al.
        The value of C-arm computed tomography in addition to conventional digital subtraction angiography in the diagnostic work-up of patients with suspected chronic thromboembolic pulmonary hypertension: an update of 300 patients.
        Acad Radiol. 2022; 29: S1-S10
        • Warrens M.J.
        Conditional inequalities between Cohen’s kappa and weighted kappas.
        Stat Methodol. 2013; 10: 14-22https://doi.org/10.1016/j.stamet.2012.05.004