Takaisin Tulosta

Interobserver variability if evaluating cross-sectioanl images

Lisätietoa aiheesta
Glaucoma Working Group
28.3.2023

Interobserver variability if evaluating cross-sectioanl images

Study 1

An online survey, including questions relating to qualification, practice environment, and diagnostic methods was completed by 1256 optometrists. Based on their responses, 208 (17%) were selected to undertake an online disc assessment exercise. Optometrists evaluated the same disc images previously assessed by European ophthalmologists as part of the European Optic Disc Assessment Trial (EODAT); the task was to state if the disc appeared healthy or glaucomatous. There were 110 stereoscopic disc images, of which 40 were healthy, 48 glaucomatous, and six ocular hypertensive, with 16 duplicates images. Sensitivity, specifisity and overall accuracy were calculated and compared between optometrist groups and with the EODAT ophthalmologists using permutation analysis.

Median sensitivity was 0.92 (95% CI: 0.70, 1.00) and median specificity was 0.74 (95% CI: 0.62, 0.88). Median overall accuracy was 80% (95% CI: 67%, 88%). Agreement between optometrists was moderate (Fleiss' κ: 0.57). Optometrists with higher qualifications did not have overall higher sensitivity than those without (p = 0.23), but had higher specificity (p = 0.001) and higher overall accuracy (p < 0.001). Optometrists displayed higher sensitivity but lower specificity than the EODAT ophthalmologists «Hadwin SE, Redmond T, Garway-Heath DF ym. Assessme...»1.

Study 2

The purpose of the study wasdetermine the diagnostic accuracy of judging optic disc photographs for glaucoma by ophthalmologists. A total of 243 of 875 (27%) invited ophthalmologists in 11 European countries classified 40 healthy eyes and 48 glaucomatous eyes with varying severity of the disease on stereoscopic slides. Duplicate slides were provided for determining intraobserver agreement «Reus NJ, Lemij HG, Garway-Heath DF ym. Clinical as...»2.

The intraobserver agreement (kappa) varied between -0.13 and 1.0 and was on average good (0.7).The overall diagnostic accuracy of ophthalmologists was 81% (standard deviation [SD], 6.8; range, 61%-94%).

Study 3

Two hundred seven subjects (109 glaucoma and 98 normal subjects) were evaluated to study the agreement of optic disc measurements obtained with the Cirrus high-density optical coherence tomography (HD-OCT) and the Heidelberg retina tomograph (HRT) and compare the intervisit, test-retest variability between the instruments.

One eye from each individual was selected randomly for optic disc imaging by the Cirrus HD-OCT and the HRT. Areas of the optic disc and the cup, cup volume, vertical cup-to-disc ratio and cup-to-disc area ratio were compared between the instruments. The OCT measurements were corrected for ocular magnification using the Littman's formula. The measurement agreement was evaluated with the Bland-Altman plots. The intervisit test-retest variability was examined in 17 randomly selected glaucoma patients who underwent optic disc imaging weekly for 8 consecutive weeks. The intraclass correlation coefficients (ICC) and the reproducibility coefficients of the optic disc parameters were computed.

The OCT measured smaller optic disc and rim areas and greater cup volume, vertical cup-to-disc ratio and cup-to-disc area ratio than the HRT did (all with P<0.001). There were proportional biases in the Bland-Altman plots between OCT and HRT optic disc measurements except for rim area and cup-to-disc area ratio. The 95% limits of agreement of rim area ranged between -0.28 and 0.88 mm(2) before, and between -0.22 and 0.92 mm(2) after correction for ocular magnification. Optic disc assessment by spectral-domain OCT and confocal scanning laser ophthalmoscopy demonstrates poor agreement «Yang B, Ye C, Yu M ym. Optic disc imaging with spe...»3.

Earlier studies with supporting the evidence R4-R11.

Kirjallisuutta

  1. Hadwin SE, Redmond T, Garway-Heath DF ym. Assessment of optic disc photographs for glaucoma by UK optometrists: the Moorfields Optic Disc Assessment Study (MODAS). Ophthalmic Physiol Opt 2013;33:618-24 «PMID: 23634792»PubMed
  2. Reus NJ, Lemij HG, Garway-Heath DF ym. Clinical assessment of stereoscopic optic disc photographs for glaucoma: the European Optic Disc Assessment Trial. Ophthalmology 2010;117:717-23 «PMID: 20045571»PubMed
  3. Yang B, Ye C, Yu M ym. Optic disc imaging with spectral-domain optical coherence tomography: variability and agreement study with Heidelberg retinal tomograph. Ophthalmology 2012;119:1852-7 «PMID: 22572035»PubMed
  4. Polo V, Larrosa JM, Pinilla I ym. Optimum criteria for short-wavelength automated perimetry. Ophthalmology 2001;108:285-9 «PMID: 11158800»PubMed
  5. Ugurlu S, Hoffman D, Garway-Heath DF ym. Relationship between structural abnormalities and short-wavelength perimetric defects in eyes at risk of glaucoma. Am J Ophthalmol 2000;129:592-8 «PMID: 10844049»PubMed
  6. Caprioli J, Prum B, Zeyen T. Comparison of methods to evaluate the optic nerve head and nerve fiber layer for glaucomatous change. Am J Ophthalmol 1996;121:659-67 «PMID: 8644809»PubMed
  7. Niessen AG, van den Berg TJ, Langerhorst CT ym. Grading of retinal nerve fiber layer with a photographic reference set. Am J Ophthalmol 1995;120:577-86 «PMID: 7485359»PubMed
  8. Varma R, Steinmann WC, Scott IU. Expert agreement in evaluating the optic disc for glaucoma. Ophthalmology 1992;99:215-21 «PMID: 1553210»PubMed
  9. Tuulonen A, Airaksinen PJ, Montagna A ym. Screening for glaucoma with a non-mydriatic fundus camera. Acta Ophthalmol (Copenh) 1990;68:445-9 «PMID: 2220362»PubMed
  10. Tielsch JM, Katz J, Quigley HA ym. Intraobserver and interobserver agreement in measurement of optic disc characteristics. Ophthalmology 1988;95:350-6 «PMID: 3174002»PubMed
  11. Sommer A, Quigley HA, Robin AL ym. Evaluation of nerve fiber layer assessment. Arch Ophthalmol 1984;102:1766-71 «PMID: 6508617»PubMed