Inter- and intra-observer reliability and agreement of O2Pulse inflection during cardiopulmonary exercise testing: a comparison of subjective and novel objective methodology

Jaafar, Zulkarnain, Nickolay, Thomas ORCID: https://orcid.org/0000-0002-1481-7949, McGregor, Gordon ORCID: https://orcid.org/0000-0001-8963-9107, Powell, Richard, Begg, Brian ORCID: https://orcid.org/0000-0002-1668-3163, Birkett, Stefan ORCID: https://orcid.org/0000-0003-0422-6843, Nichols, Simon ORCID: https://orcid.org/0000-0003-0377-6982, Ennis, Stuart ORCID: https://orcid.org/0000-0002-7176-6252, Banerjee, Prithwish, Shave, Rob, Metcalfe, James, Hoye, Angela and Ingle, Lee (2024) Inter- and intra-observer reliability and agreement of O2Pulse inflection during cardiopulmonary exercise testing: a comparison of subjective and novel objective methodology. PLoS ONE, 19 (3). e0299486. ISSN 1932-6203

Preview

Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Cardiopulmonary exercise testing (CPET) is the ‘gold standard’ method for evaluating functional capacity, with oxygen pulse (O2Pulse) inflections serving as a potential indicator of myocardial ischaemia. However, the reliability and agreement of identifying these inflections have not been thoroughly investigated. This study aimed to assess the inter- and intra-observer reliability and agreement of a subjective quantification method for identifying O2Pulse inflections during CPET, and to propose a more robust and objective novel algorithm as an alternative methodology. A retrospective analysis was conducted using baseline data from the HIIT or MISS UK trial. The O2Pulse curves were visually inspected by two independent examiners, and compared against an objective algorithm. Fleiss’ Kappa was used to determine the reliability of agreement between the three groups of observations. The results showed almost perfect agreement between the algorithm and both examiners, with a Fleiss’ Kappa statistic of 0.89. The algorithm also demonstrated excellent inter-rater reliability (ICC) when compared to both examiners (0.92–0.98). However, a significant level (P ≤0.05) of systematic bias was observed in Bland-Altman analysis for comparisons involving the novice examiner. In conclusion, this study provides evidence for the reliability of both subjective and novel objective methods for identifying inflections in O2Pulse during CPET. These findings suggest that further research into the clinical significance of O2Pulse inflections is warranted, and that the adoption of a novel objective means of quantification may be preferable to ensure equality of outcome for patients.