Skip to main content

Table 3 Agreement statistics for the best algorithm (s) assessing prevalent heart failure

From: Accuracy of heart failure ascertainment using routinely collected healthcare data: a systematic review and meta-analysis

First author

Country

GS HF events

RCD source

GS source

ICD coding

Sensitivity (95% CI)

Specificity (95% CI)

PPV (95% CI)

NPV (95% CI)

Kappa (95% CI)

Version

Pos./Alg

Borzecki [67]

USA

82

ACD

MR

9

Any

77.0

99.0

0.74

Birman-Deych [78]

USA

11014

Registry

MR

9

Any

76.0 (75.2–76.8)

98.0 (97.7–98.2)

97.0 (96.6–97.3)

82.4 (81.8–83.0)

Rector [71]

USA

218

ACD a

Self-report

9

Best alg.

70.2 (63.6–76.2)

91.0 (90.0–91.9)

33.3 (29.0–98.4)

98.0 (97.4–98.4)

Allen [77]

USA

108

Registry

MR

9

Alg. 2

61.5 (39.6–79.5)

98.5 (96.6–99.3)

68.6 (44.9–85.4)

97.9 (95.9–99.0)

Van Doorn [75]

USA

217

HDD

MR

10

Any

56.7 (49.8–63.4)

98.7 (96.7–99.6)

96.9 (92.1–99.1)

76.3 (71.8–80.4)

0.59

Fleming [59]

USA

103

ACD

MR

9

Study alg.

46.6 (36.7–56.7)

95.9 (94.9–96.7)

37.2 (28.9–46.2)

97.1 (96.3–97.8)

0.38

Kieszak [69]

USA

145

ACD

MR

9

Any

0.38

Etzioni [12]

USA

249

HDD

Registry

9

Secondary

0.22

Schultz [76]

Canada

99

HDD + ACD

Primary care record

8, 9, 10

Alg. 4

84.8 (76.2–91.3)

97.0 (96.2–97.7)

55.6 (47.3–63.7)

99.3 (98.9–99.6)

Xu [72]

Canada

296

HDD

MR

10

Any

57.4 (51.8–63.0)

99.2 (98.8–99.6)

92.4 (88.6–96.2)

93.4 (92.3–94.5)

 + EMR

Any + MLA

83.3 (73.9–92.8)

97.3 (95.6–98.9)

83.3 (73.9–92.8)

97.3 (95.6–98.9)

Juurlink [79]

Canada

1371

HDD

Re–coded MR

10

Secondary

82.0 (80.0–84.0)

96.0 (95.6–96.3)

68.0 (65.0–70.0)

98.1 (97.8–98.3)

0.71 (0.69–0.73)

So [65]

Canada

55

HDD

MR

10

Secondary

80.0 (67.0–89.6)

97.8 (93.8–99.6)

93.6 (82.5–98.7)

92.5 (86.9–96.2)

 

9

Secondary

81.8 (68.7–90.5)

96.4 (91.8–98.8)

90.0 (78.2–96.7)

93.0 (87.5–96.6)

Quan (2002) [63]

Canada

128

HDD

MR

9

Any

77.3 (69.1–84.3)

98.7 (97.8–99.3)

87.6 (80.1–93.1)

97.3 (96.2–98.2)

0.80

Quan (2008) [70]

Canada

333

Re-coded MR

MR

9

Any

71.8 (66.6–76.5)

99.3 (99.0–99.5)

90.2 (86.0–93.5)

97.5 (96.9–98.0)

0.78

 

HDD

MR

10

Any

68.6 (63.2–73.5)

99.3 (99.0–99.6)

90.1 (85.8–93.5)

97.2 (96.6–97.7)

0.76

Humphries [60]

Canada

58

HDD

MR

9

Any

65.5 (51.9–77.5)

95.0 (93.2–96.4)

50.0 (38.3–61.7)

97.3 (95.9–98.3)

0.53

Wilchesky [49]

Canada

1057

ACD

Primary care record

9

Any

41.5 (38.5–44.6)

96.1 (95.7–96.4)

44.4 (41.3–47.6)

95.6 (95.2–95.9)

Henderson [68]

Australia

392

HDD

Re-coded

MR

10

Any (98–99)

87.0 (83.1–90.2)

99.4 (99.2–99.6)

89.9 (86.2–92.7)

99.3 (99.0–99.5)

0.88

153

Any (00–01)

86.3 (79.7–91.0)

99.7 (99.6–99.8)

86.3 (79.7–91.0)

99.7 (99.6–99.8)

0.86

Powell [61]

Australia

172

HDD

MR

9

Secondary

62.2 (54.5–69.5)

98.3 (97.4–98.9)

81.7 (74.0–87.9)

95.4 (94.2–96.4)

Preen [62]

Australia

100

HDD

MR

9

Any

40.0 (30.3–50.3)

99.8 (99.5–99.9)

90.9 (78.3–97.5)

97.0 (96.1–97.7)

Sarfati [64]

New Zealand

64

HDD

MR

9

Any

31.3 (20.2–44.1)

98.0 (96.4–99.0)

66.7 (47.2–82.7)

91.8 (89.2–94.0)

0.38 (0.25–0.51)

Chong [58]

Singapore

469

HDD

MR

9

Secondary

35.4 (31.1–39.9)

97.1 (96.5–97.7)

65.9 (59.2–71.7)

90.6 (89.5–91.6)

0.40 (0.39–0.42)

Kaspar [73]

Germany

222

HDD

MR

10

Any + MLA

83.8 (78.3–88.4)

97.2 (95.8–98.2)

89 .0 (83.9–92.9)

95.7 (94.1–97.0)

 + EMR

 

Any

49.5 (42.8–56.3)

99.1 (98.2–99.7)

94.0 (88.1–97.6)

87.9 (85.6–89.9)

Soo [66]

UK

546

HDD

MR

10

Any

52.4 (48.2–56.5)

91.6 (90.5–92.6)

56.0 (51.6–60.2)

90.4 (89.2–91.5)

0.45

Luthi [74]

Switzerland

52

HDD

MR

10

Any

48.1 (34.0–62.4)

93.2 (91.3–94.8)

30.5 (20.8–41.6)

96.7 (95.2–97.8)

0.32 (0.21–0.43)

  1. Studies from one country using the same RCD source are shown in bold lettering
  2. ACD indicates administrative claims data, Alg. algorithm, CI confidence interval, EMR electronic medical record, GS gold standard, HDD hospital discharge data, HF heart failure, ICD International Classification of Diseases, MLA machine learning algorithm, Pos. position, PPV positive predictive value, NPV negative predictive value, RCD routinely collected data
  3. aACD including pharmacy claims data