POS1430 RELIABILITY OF THE OMERACT GIANT CELL ARTERITIS ULTRASOUND SCORE (OGUS): RESULTS OF A PATIENT-BASED EXERCISE OF VASCULAR ULTRASONOGRAPHY EXPERTS AND NON-EXPERTS
Background:In giant cell arteritis (GCA), various ultrasound composite scores, including the provisional OMERACT GCA ultrasonography score (OGUS), the Southend Halo score and the Halo count, have recently been introduced as a monitoring tool for clinical trials [1,2]. Patient-based reliability of these ultrasonography (US) composite scores remain elusive so far.Objectives:To test the reliability of the OGUS and the other US scores in a patient-based reliability exercise involving experts and non-experts in vascular ultrasonography.Methods:Twelve experts and 12 non-experts were asked to evaluate 6 GCA patients. Each patient was scanned twice (2 rounds separated by ≥3 hours) by each participant.Experts had a half-day meeting ahead to align on US settings and procedures. Non-experts received a training module (90 minutes of theoretical and 240 minutes of practical instructions) after round 1. US examinations were conducted at bilateral common superficial temporal arteries, frontal and parietal branches as well as the axillary arteries. The Intima-media complex was measured at the thickest site of the deep wall of individual arteries, preferentially in longitudinal scan to calculate the OGUS, the Southend score and the Halo count. In case of missing values, a normalized score was calculated by considering the available segments. Inter- and intra-reader reliability were tested by Intraclass correlation coefficient (ICC).Results:Mean age of GCA patients was 78±5.1 years, 2 (33%) were female. All had established disease and were in clinical remission, median disease duration was 22.5 (IQR 16.3-28.3) months. Experts and non-experts had a median of 16.5 years (IQR 9.8-20.0) and 1.8 years (IQR 0-3.3) of experience with vascular US, respectively. According to experts, all patients had at least one pathological vessel, mean OGUS was 0.83 (±0.07), mean Southend score was 19.0 (±4.6) and mean Halo count was 2.8 (±1.4). As depicted in Table 1, expert inter-rater ICC of the OGUS was moderate in both rounds, fair for the Southend score and the Halo count in round 1 and moderate in round 2. Expert intra-rater reliability was good for all scores.For non-experts, inter-rater reliability was poor in round 1 for all scores as well as for individual measurements. In round 2, a moderate reliability was found for the OGUS, the normalized Halo count and individual IMT measurements, while reliability remained poor for the normalized Southend score (detailed in Table 1).Conclusion:We demonstrate fair to moderate inter-rater reliability and good intra-rater reliability of the OGUS, the Southend score and the Halo count among experts. A short training program for non-experts improved their inter-rater reliability.REFERENCES:[1] Dejaco C, Ponte C, Monti S, et al. The provisional OMERACT ultrasonography score for giant cell arteritis. Ann Rheum Dis 2023;82:556-64.[2] van der Geest KSM, Borg F, Kayani A, et al. Novel ultrasonographic halo score for giant cell arteritis: assessment of diagnostic accuracy and association with ocular ischaemia. Ann Rheum Dis 2020;79:393–9.Table 1.Inter-rater (experts and non-experts in vascular ultrasonography) as well as intra-rater reliability (experts) on ultrasonography scores in GCA.Inter-raterRound 1Inter-raterRound 2Intra-raterScorenICC95% CInICC95% CIMedian ICCIQRExperts in vascular ultrasonographyOGUS60.600.33-0.9060.600.33-0.910.860.65-0.92Southend Score60.400.17-0.8260.510.24-0.870.810.61-0.87Halo Count60.450.20-0.8460.520.25-0.870.650.40-0.84Individual IMT measurements480.790.72-0.86480.840.78-0.900.880.80-0.95Non-experts in vascular ultrasonographyOGUS60.200.05-0.6560.520.25-0.88Southend Score200-0.961n.d.Normalized Southend Score60.220.06-0.6660.350.13-0.78Halo Count200-0.981n.d.Normalized Halo Count60.350.14-0.7860.570.31-0.90Individual IMT measurements4500-0.34400.630.52-0.75CI, confidence interval; ICC, intra-class correlation coefficient; IMT, intima media thickness; IQR, interquartile range; n, number; n.d., not determined; OGUS, OMERACT ultrasonography score for GCA; normalized Southend Score and Halo count, calculated in case of missing values.Acknowledgements:We thank the Austrian team of Canon for providing the Ultrasound machines, used in the reliability exercise.Disclosure of Interests:None declared.
Read more