Skip to main content

Table 4 Summary of findings

From: Quality of measurement properties of medication adherence instruments in cardiovascular diseases and type 2 diabetes mellitus: a systematic review and meta-analysis

Measurement property

PROM

Summary

Overall rating

Quality of evidence

Content validity

MMAS-8 [28, 41, 47, 57, 61, 67, 68, 73, 76, 86, 88, 91, 93, 100, 104, 108], MTA – OA [32], MTA – Insulin [32], MARS-5 [77], ARMS-12 [44, 106, 123, 132], MTA [105], ARMS-7 [127], MEDS [114], IADMAS [38], GMAS [128, 129, 134, 136], ProMAS [130], A-14 [131], 12-item questionnaire [66], and Mascard [113]

Relevance, Comprehensiveness, and Comprehensibility with inconsistent results

 ± 

No information

MGT [52]

Sufficient relevance, sufficient comprehensiveness and sufficient comprehensibility

 + 

Moderate

Structural validity

MMAS-8 [28, 35, 39, 40, 46, 47, 50, 55, 57, 61, 62, 67, 68, 73, 79, 80, 86,87,88, 93, 100, 108, 110]

CFA: Tested one and two factor solutions. One factor presented five studies ' + ', two studies '-' and one study '?'. Two factors presented two studies ' + '. EFA: Solutions varying from one to four factors with results ' + ', '-' and '?'. IRT: one study '-' and one study '?'

 ± 

No information

SMAQ [29, 63]

EFA: One factor solution in one study '?'. Two factor solution in one study '?'

?

No information

MEDS [114]

CFA: One factor solution in one study ' + '

 + 

High

MNPS [115]

CFA: One factor solution in one study ' + '

 + 

High

DMAS-7 [31]

EFA: Three factor solution in one study ' + '

 + 

Moderate

ARMS-12 [44, 106, 123, 132]

CFA: Two factor solution in one study ' + '. EFA: Two factor solution in two studies ' + ' and one study '-'. Three factor solution in one study '-'

 ± 

No information

Structural validity

MGT [51, 52, 81, 125]

EFA: One factor solution in two studies ' + ', one study '-' and one study '?'. CFA: One factor solution in one study ' + '

 ± 

No information

LMAS-14 [71, 111]

EFA: Four factor solution in one study ' + '. Three factor solution in one study ' + '

 ± 

No information

MTA [72]

CFA: One factor solution in one study '-'

-

High

MARS-5 [92, 117, 133]

CFA: One factor solution in one study ' + '. EFA: One factor solution in two studies '?'. IRT: One study ' + '

 + 

Moderate

ARMS-10 [75]

EFA: Two factor solution in one study ' + '

 + 

Moderate

ARMS-D [37]

EFA: Two factor solution in one study ' + '

 + 

Moderate

GMAS [65, 119, 128, 129, 134, 135]

EFA: Three factor solution in three studies ' + '. CFA: Three factor solution in four studies ' + ' and one study '-'. IRT: One study ' + '

 + 

High

ProMAS [130]

IRT: One study ' + '

 + 

High

ARMS-7 [127]

EFA: Two factor solution in one study ' + '. CFA: Two factor solution in one study ' + '

 + 

High

Mascard [113]

EFA: Three factor solution in one study '-'

-

Moderate

Internal consistency

MMAS-8 [28, 30, 35, 39,40,41, 46,47,48, 50, 55, 57, 58, 60,61,62, 67, 68, 73, 76, 79, 80, 84, 86,87,88, 91, 93, 94, 99,100,101, 104, 108, 121, 124]

Cronbach alpha lower than 0.7 in 22 studies. Cronbach alpha equal or higher than 0.7 in 14 studies. Sample size: 10,472

?

No information

SMAQ [29, 63]

Cronbach alpha lower than 0.7 in two studies. Sample size: 66

?

No information

MEDS [114]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 685

 + 

High

Internal consistency

MNPS [115]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 675

 + 

High

DMAS-7 [31, 36]

Cronbach alpha lower than 0.7 in two studies. Sample size: 800

-

Moderate

ARMS-12 [44, 106, 123, 132]

Cronbach alpha lower than 0.7 in at least one subscale in 3 studies. Cronbach alpha equal or higher than 0.7 in 1 study. Sample size: 1,220

?

No information

MGT [51, 52, 54, 69, 81, 83, 89, 110, 125]

Cronbach alpha lower than 0.7 in seven studies. Cronbach alpha equal or higher than 0.7 in two studies. Sample size: 8,382

?

No information

MTA – OA [32]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 90

?

No information

MTA – Insulin [32]

Cronbach alpha lower than 0.7 in one study. Sample size: 90

?

No information

LMAS-14 [71, 111]

Cronbach alpha lower than 0.7 in at least one subscale in one study. Cronbach alpha equal or higher than 0.7 in one study. Sample size: 577

?

No information

MTA [42, 105, 126]

Cronbach alpha lower than 0.7 in two studies. Cronbach alpha equal or higher than 0.7 in one study. Sample size: 701

?

No information

MARS-5 [77, 92, 117, 133]

Cronbach alpha lower than 0.7 in two studies. Cronbach alpha equal or higher than 0.7 in two studies. Sample size: 1,783

 + 

High

A-14 [74, 131]

Cronbach alpha equal or higher than 0.7 in two studies. Sample size: 119

?

No information

Internal consistency

ARMS-10 [75]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 120

 + 

Very low

MALMAS [33, 34, 45]

Cronbach alpha lower than 0.7 in three studies. Sample size: 279

?

No information

ARMS-D [37]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 314

 + 

High

IADMAS [38]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 80

?

No information

GMAS [65, 119, 128, 129, 134, 136]

Cronbach alpha lower than 0.7 in at least one subscale in five studies. Cronbach alpha equal or higher than 0.7 in one study. Sample size: 1,487

-

High

MAQ [97]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 20

?

No information

ProMAS [130]

Cronbach alpha equal or higher than 0.7 in one study. Sample size: 370

 + 

High

ARMS-7 [127]

Cronbach alpha lower than 0.7 in at least one subscale in one study. Sample size: 100

-

Moderate

AS [112]

Cronbach alpha higher than 0.7 in one study. Sample size: 201

?

No information

12-item questionnaire [66]

Cronbach alpha higher than 0.7 in one study. Sample size: 30

?

No information

Mascard [113]

Cronbach alpha lower than 0.7 in one study. Sample size: 219

?

No information

Reliability

MMAS-8 [41, 46, 47, 50, 55, 60,61,62, 76, 79, 82, 86,87,88, 93, 94, 104]

ICC and/or kappa lower than 0.7 in three studies; ICC or kappa equal or higher than 0.7 in ten studies; four studies did not report ICC or Kappa; sample size: 1,211

 + 

Low

ARMS-12 [123, 132]

ICC not reported (one study); ICC = 0.97 (one study). sample size: 295

 + 

Low

MGT [52, 54, 69]

ICC not reported (three studies); sample size: 325

?

No information

MARS-5 [77, 117]

ICC not reported (two studies); sample size: 291

?

No information

ARMS-10 [75]

ICC = 0.86 (one study); sample size = 120

 + 

Low

MALMAS [33, 34, 45]

ICC not reported (three studies); sample size: 273

?

No information

IADMAS [38]

ICC not reported (one study); sample size: 24

?

No information

GMAS [119, 128, 129, 136]

ICC range 0.26—0.78 (one study); ICC not reported (three studies); sample size: 673

-

Moderate

MAQ [97]

ICC = 0.98 (one study); sample size = 20

 + 

Very low

ARMS-7 [127]

ICC range 0.76—0.80 (one study); sample size: 100

 + 

Very low

Criterion validity

MMAS-8 [30, 39, 41, 43, 46,47,48, 53, 57,58,59, 67, 76, 79, 80, 84, 87, 90, 99,100,101, 103, 108, 121, 124]

AUC lower than 0.7 in four studies. Correlation coefficient lower than 0.7 in nine studies. Sensititivity and/or specificity equal or lower than 50% in seven studies. Sensititivity and specificity higher than 50% in eight studies. Not presented the expected measures in three studies

-

Low

Criterion validity

SMAQ [29, 63]

Correlation coefficient lower than 0.7 in one study. Not presented the expected measures in one study

-

Very low

MEDS [114]

Not presented the expected measures (one study)

?

No information

MNPS [115]

Not presented the expected measures (one study)

?

No information

DMAS-7 [31, 36]

AUC lower than 0.7 in two studies

-

High

ARMS-12 [44, 106, 123]

AUC equal or higher than 0.7 in one study. Correlation coefficient lower than 0.7 in one study. Not presented the expected measures (one study)

 ± 

No information

MGT [51, 53, 54, 56, 69, 78, 81, 85, 89, 95, 96, 102, 107, 110, 118, 122]

AUC lower than 0.7 in three studies. Correlation coefficient lower than 0.7 in three studies. Sensititivity and/or specificity equal or lower than 50% in ten studies. Not presented the expected measures in two studies

-

Low

LMAS-14 [71]

Sensititivity and/or specificity equal or lower than 50% in one study

?

No information

MTA [42, 120, 126]

AUC lower than 0.7 in one study. Correlation coefficient lower than 0.7 in two studies. Sensititivity and/or specificity equal or lower than 50% in one study. Sensititivity and specificity higher than 50% in one study

-

High

MARS-5 [92, 102, 117]

AUC lower than 0.7 in one study. Correlation coefficient equal or higher than 0.7 in one study. Not presented the expected measures in one study

 ± 

No information

MALMAS [34, 45]

Correlation coefficient lower than 0.7 in one study. Sensititivity and/or specificity equal or lower than 50% in two studies

-

High

ARMS-D [37]

Correlation coefficient lower than 0.7 in one study

-

High

Criterion validity

IADMAS [38]

Correlation coefficient lower than 0.7 in one study. Sensititivity and/or specificity equal or lower than 50% in one study

-

Moderate

GMAS [119, 128, 129, 134]

Sensititivity and/or specificity higher than 50% in two studies. Not presented the expected measures in two studies

?

No information

5-item questionnaire [109]

Correlation coefficient lower than 0.7 in one study. Sensititivity and/or specificity equal or lower than 50% in one study

-

High

3-item questionnaire [137]

Sensititivity and/or specificity equal or lower than 50% in one study

?

No information

Mascard [113]

Sensititivity and/or specificity equal or lower than 50% in one study

?

No information

Hypotheses testing

MMAS-8 [39, 41, 46,47,48, 50, 55, 60, 67, 73, 80, 86, 87, 99, 100, 103, 104]

27 out of 38 hypotheses confirmed (seventeen studies)

 ± 

No information

MEDS [114]

2 out of 2 hypotheses confirmed (one study)

 + 

High

DMAS-7 [31, 36]

5 out of 5 hypotheses confirmed (two studies)

 + 

High

ARMS-12 [44, 64, 116, 123]

17 out of 21 hypotheses confirmed (three studies)

 + 

High

MGT [54, 69, 70, 89, 102, 118, 122]

8 out of 17 hypotheses confirmed (seven studies)

 ± 

No information

MTA – OA [32]

2 out of 2 hypotheses confirmed (one study)

 + 

Very low

MTA – Insulin [32]

2 out of 2 hypotheses confirmed (one study)

 + 

Very low

LMAS-14 [71]

1 out of 1 hypotheses confirmed (one study)

 + 

Low

MTA [105, 120]

5 out of 12 hypotheses confirmed (two studies)

 ± 

No information

Hypotheses testing

MARS-5 [77, 102, 117]

4 out of 6 hypotheses confirmed (three studies)

 ± 

No information

A-14 [74, 131]

3 out of 3 hypotheses confirmed (two studies)

 + 

High

MALMAS [33, 34, 45]

10 out of 10 hypotheses confirmed (three studies)

 + 

Low

ARMS-D [37]

9 out of 9 hypotheses confirmed (one study)

 + 

High

IADMAS [38]

4 out of 4 hypotheses confirmed (one study)

 + 

Moderate

GMAS [65, 119, 128, 129, 134, 136]

12 out of 14 hypotheses confirmed (six studies)

 + 

Moderate

ProMAS [49, 130]

2 out of 2 hypotheses confirmed (two studies)

 + 

High

5-item questionnaire [109]

2 out of 2 hypotheses confirmed (one study)

 + 

High

AS [112]

2 out of 2 hypotheses confirmed (one study)

 + 

High

Responsiveness

MMAS-5 [98]

3 out of 3 hypotheses confirmed (one study)

 + 

High

  1. ARMS Adherence to Refills and Medication Scale, AS Adherence Scale, AUC Area under the curve, CFA Confirmatory factor analysis, DMAS-7 7-item Diabetes Medication Adherence Scale, GMAS General Medication Adherence Scale, IADMAS Iraqi Anti-Diabetic Medication Adherence Scale, ICC Intraclass correlation coefficient, IRT Item response theory, LMAS-14 Fourteen-item Lebanese Medication Adherence Scale, MALMAS Malaysian Medication Adherence Scale, MAQ Medication Adherence Questionnaire, MARS-5 5-item Medication Adherence Report Scale, Mascard Medication Adherence Scale in Cardiovascular disorders, MEDS Medication Adherence Estimation and Differentiation Scale, MGT Morisky-Green test, MMAS-5 5-item adapted Morisky Medication Adherence Scale, MMAS-8 8-item Morisky Medication Adherence Scale, MNPS Medication Non-persistence Scale, MTA Measurement of Treatment Adherence, MTA-Insulin Measurement of Treatment Adherence – Insulin, MTA-OA MTA-Oral Antidiabetics, NPV Negative predictive value, PPV Positive predictive value, PROM Patient-reported outcome measures, ProMAS Probabilistic Medication Adherence Scale, SMAQ Simplified Medication Adherence Questionnaire, “ + ” = Sufficient; “ ± ” = Inconsistent; “ − ” = Insufficient; “?” = Indeterminate