Skip to main content
Download PDF

Psychometric properties of medication adherence instruments in cardiovascular diseases and type 2 diabetes mellitus: systematic review protocol

Systematic Reviews volume 10, Article number: 202 (2021) Cite this article

Abstract

Background

The pharmacological treatment of cardiovascular diseases and type 2 diabetes mellitus reduces the risk of cardiovascular events.; however, most patients do not adhere to the treatment. There are several self-reported measures for assessing medication adherence. Identifying the instruments with the best psychometric evidence is essential for selecting an accurate measure. The aim of this study is to critically assess, compare and synthesize the quality of the measurement properties of patient-reported outcome measures to access medication adherence among patients with cardiovascular diseases and/or type 2 diabetes mellitus.

Methods

This protocol is reported according to Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) and the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. The following databases will be searched: Web of Science, SCOPUS, PubMed, CINAHL, EMBASE, LILACS, PsycINFO and ProQuest.

Discussion

This review will provide a detailed assessment of the measurement properties of self-reported medication adherence instruments in patients with cardiovascular diseases and/or type 2 diabetes mellitus to support clinical practice and research.

Systematic review registration

PROSPERO CRD42019129109.

Peer Review reports

Background

Medication adherence represents an important challenge in the treatment of noncommunicable diseases (NCDs), as a considerable number of patients do not adhere to treatment [1]. It is associated with decreased mortality [2] and optimal quality of life [3].

Approximately 68% (38 million) of deaths worldwide were caused by NCDs, 50% of which were related to cardiovascular diseases (CVDs) and diabetes [4]. Poor drug adherence may result in clinical and psychosocial worsening of the disease, increased mortality, and increased healthcare costs [5].

Assessing and promoting medication adherence is paramount, considering the impact of medication regimens in improving glycemic control and decreasing the risk of cardiovascular events and mortality [5, 6].

Obtaining an accurate measurement of adherence has been as challenging as addressing the factors that lead to non-adherence because medication adherence behavior is complex, multifactorial, and influenced by different psychosocial variables such as motivation, self-efficacy, beliefs, and perceived barriers [7].

Several validated, patient-reported outcome measures (PROMs) are available in the literature to measure medication adherence among patients with different chronic diseases [8, 9]. The selection of an appropriate tool should consider its conceptual structure and the quality of its psychometric properties.

Some initiatives have been undertaken to evaluate the quality of the measurement properties of PROMs. In 2010, a taxonomy of terminologies and concepts related to measurement properties [10] and a checklist—COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) were created to evaluate the methodological quality of measurement properties studies [11].

Subsequent studies refined the checklist resulting in a guideline for systematic reviews on the measurement properties of PROMs [12]. This guideline proposes a combination of studies' methodological quality on measurement properties and the quality of the self-reported measurement itself.

There are several systematic reviews addressing the measurement properties of PROMs used to assess medication adherence in NCDs, but none of them have evaluated the quality of the measurement properties of medication adherence PROMs, according to COSMIN guidelines in patients with CVDs and/or type 2 diabetes mellitus (T2DM).

Therefore, this systematic review aims to critically assess, compare, and synthesize the PROMs' quality properties for medication adherence assessment among patients with CVDs and/or T2DM.

Methods

This protocol was developed considering the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) [13] (see checklist in Additional file 1) and in accordance with the COSMIN guideline for systematic reviews of PROMs [12]. The systematic review protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO CRD42019129109).

According to the COSMIN guideline for systematic reviews of PROMs [12], ten stages divided into three parts are to be followed (Fig. 1):

  • Part A – Literature search: which includes the definition of the review's objective, defining eligibility criteria, literature search, and selection of abstracts and full-text papers;

  • Part B – Assessment of the measurement properties: content validity, internal structure, and remaining measurement properties. There are three sub-stages for each of these stages: studies' methodological quality, quality of results, and a summary of evidence and quality of evidence grading;

  • Part C – Selection of a PROM: includes the description of interpretability and feasibility, recommendations, and the systematic review report.

Fig. 1
figure 1

Flowchart of the steps necessary to perform a systematic review of PROMs. Source: Extracted from Prinsen et al., 2018, p. 1149. Note: PROM = Patient-reported outcome measures; COSMIN = Consensus-based Standards for the selection of Health Measurement Instruments; GRADE = Grading of Recommendations Assessment, Development, and Evaluation

Full size image

Eligibility criteria

This review will include:

  • studies which aimed to develop or to culturally adapt a PROM to assess medication adherence among patients with a CVD and/or T2DM and who were older than 18 years of age, regardless of the language and date of publication;

  • studies reporting the assessment of one or more properties of the PROMs.

This review will exclude:

  • studies in which a PROM was used to measure an outcome (e.g., randomized clinical trials);

  • studies in which a PROM was used to validate another measure;

  • studies that evaluated the measurement properties of PROMs that aimed to evaluate the factors related to medication adherence (self-efficacy, beliefs, intention, etc.);

  • studies that not provided sufficient information on outcomes of interest, even after contacting authors.

Search strategy

The following databases were included: Web of Science, SCOPUS, PubMed, CINAHL, EMBASE, LILACS and PsycINFO. ProQuest was considered to search the gray literature. The search strategy considered terms related to cardiovascular disease, type 2 diabetes mellitus, PROMs, medication adherence and measurement properties. The second version of the search filter for measurement properties proposed by the COSMIN initiative was used in the search strategy [14]. The search strategy used in Pubmed is available in Additional file 2. Rayyan QCRI online software will be used to manage the references [15].

Study selection

The process of study selection will be documented in accordance with the PRISMA flow diagram model [16]. Studies will be selected using four steps:

  • (a) Exclusion of duplicates;

  • (b) Titles and abstracts will be assessed according to eligibility criteria;

  • (c) Full texts of potentially eligible studies identified in step 2 will be assessed to determine those that will be included in the review;

  • (d) The list of references from the studies included in the review will be checked to identify other studies that haven’t been retrieved in previous searches.

Anticipated results

The searches performed in July of 2020 resulted in a total of 41.886 papers. After the exclusion of duplicities (step a), a total of 27.060 papers will be evaluated according to their titles and abstracts (step b). The evaluation of titles and abstracts will be done independently by three pairs of reviewers. Therefore, each pair will evaluate 9.020 papers. Disagreements will be discussed with another reviewer until a consensus is obtained. The reviewers were trained and a pilot with 50 papers was performed to guarantee an inter-reviewer agreement.

Data extraction

Data will be independently extracted by two reviewers. A standardized and pretested form will be used to extract data from the studies included in the review (characteristics of studies and information regarding PROMs) to assess the methodological quality of studies and summarize the evidence. Information will include: study design; sample size; participants' demographic and clinical characteristics (gender, age, disease, disease duration and number of taking medications); response rate; presence of conflicts of interest; funding; setting, country and language; PROMs number of items and domains; mode of administration; recall period; response options; range of scores; original language and available translations; number of studies evaluating the PROM; measurement properties (PROM development, content validity, structural validity, internal consistency, cross-cultural validity/measurement invariance, reliability, measurement error, criterion validity, hypothesis testing for construct validity and responsiveness); interpretability and feasibility; and information to assess the studies' methodological quality.

Methodological quality/risk of bias

The studies' methodological quality will be assessed independently by two reviewers. COSMIN Risk of Bias checklist for systematic reviews of PROMs will be used to assess the methodological quality of the included studies [17, 18].

This checklist contains 116 items that assess the methodological quality of studies concerning aspects related to the measurement properties: PROMs development, content validity, structural validity, internal consistency, cross-cultural validity/measurement invariance, reliability, measurement error, criterion validity, hypotheses testing for construct validity, and responsiveness. The items can be rated as 'very good', 'adequate', 'doubtful', 'inadequate', or 'not applicable' (NA). An overall rating is assigned to each measurement property based on the worst scored item [18].

Quality of the results concerning the measurement properties

The results will be assessed independently by two reviewers considering criteria for good measurement properties proposed by COSMIN [18]. Individual measurement properties of each assessed PROM will ultimately be classified as sufficient ( +), insufficient (-), inconsistent ( ±), or indeterminate (?) [12, 17, 18] (Table 1). If the data allow, a meta-analysis will be performed.

Table 1 Criteria for good measurement properties
Full size table

Quality of evidence

After summarizing the results, the quality of evidence of these results will be assessed considering an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) proposed by the COSMIN initiative [12]. Evidence will be classified as high, moderate, poor, or very poor (Table 2).

Table 2 Definitions of quality levels
Full size table

Recommendations for selecting a PROM

The review's final stage will be the creation of recommendations to select the most appropriate PROM. PROMs will be classified into three categories:

  • (a) PROMs that presented sufficient content validity and at least low quality of evidence for sufficient internal consistency;

  • (b) PROMs that are not classified in categories (a) or (c);

  • (c) PROMs that presented high quality of evidence for an insufficient measurement property.

A PROM that falls under category (a) means it is reliable and can be recommended. A PROM that falls under category (b) means it has the potential to be recommended, though further studies are needed to ensure its quality. A PROM classified under category (c) should not be recommended.

Discussion

This review will provide a detailed assessment of the measurement properties of PROMs to measure medication adherence of patients with CVD and/or T2DM. Thus, based on this assessment, we expect to gather sufficient evidence regarding the most appropriate PROM to be used for these populations.

In the context of chronic diseases, studies that summarize knowledge and grading of evidence are essential, given the exponential increase of instruments, inconsistencies of validation methods and the importance of accurate measures for use in randomized clinical trials.

No recent systematic review addressing the quality of measurement properties of PROMs that assess medication adherence in the context of CVDs and T2DM was found. Therefore, this review's original contribution will be the use of current methodology with well-established quality as proposed by COSMIN [12].

Another strength of this review is the interdisciplinary nature of the team that designed this review protocol, composed of professionals from different areas of knowledge, including a statistician and researchers with expertise in the development, adaptation, and validation of self-reporting measures.

In summary, this protocol provides detailed information to plan a systematic review about the quality of measurement properties, which is a fundamental step to obtain clarity, transparency, and to ensure the reproducibility of the results of studies [19].

This review's results will support the recommendation of an instrument with the best psychometric evidence to measure medication adherence among patients with CVDs and/or T2DM. The systematic review is expected to facilitate the challenge of selecting an accurate self-reported measure of medication adherence for clinical and research use in this particular group of chronic diseases.

Availability of data and materials

Not applicable.

Abbreviations

CINAHL:

Cumulative index to nursing and allied health literature

COSMIN:

Consensus-based standards for the selection of health measurement instruments

CVDs:

Cardiovascular diseases

EMBASE:

Excerpta medica database

GRADE:

Grading of recommendations assessment, development, and evaluation

LILACS:

Literatura latino-americana e do Caribe em ciências da saúde

NCDs:

Noncommunicable diseases

PRISMA-P:

Preferred reporting items for systematic review and meta-analysis protocols

PROMs:

Patient-reported outcome measures

PROSPERO:

International prospective register of systematic reviews

T2DM:

Type 2 diabetes mellitus

References

  1. Kim S, Shin DW, Yun JM, Hwang Y, Park SK, Ko YJ, et al. Medication adherence and the risk of cardiovascular mortality and hospitalization among patients with newly prescribed antihypertensive medications. Hypertension. 2016;67(3):506–12. https://doi.org/10.1161/HYPERTENSIONAHA.115.06731.

    Article  CAS  PubMed  Google Scholar 

  2. Kim YY, Lee JS, Kang HJ, Park SM. Effect of medication adherence on long-term all-cause-mortality and hospitalization for cardiovascular disease in 65,067 newly diagnosed type 2 diabetes patients. Sci Rep. 2018;8(1):12190. https://doi.org/10.1038/s41598-018-30740-y.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Alfian SD, Sukandar H, Lestari K, Abdulah R. Medication adherence contributes to an improved quality of life in type 2 diabetes mellitus patients: a cross-sectional study. Diabetes Ther. 2016;7(4):755–64. https://doi.org/10.1007/s13300-016-0203-x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. World Health Organization. Global Status Report on noncommunicable diseases 2014. Geneva: WHO. 2014. Available from: https://www.who.int/nmh/publications/ncd-status-report-2014/en/.

  5. Polonsky WH, Henry RR. Poor medication adherence in type 2 diabetes: recognizing the scope of the problem and its key contributors. Patient Prefer Adherence. 2016;10:1299–307. https://doi.org/10.2147/PPA.S106821.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Al-Ganmi AH, Perry L, Gholizadeh L, Alotaibi AM. Cardiovascular medication adherence among patients with cardiac disease: a systematic review. J Adv Nurs. 2016;72(12):3001–14. https://doi.org/10.1111/jan.13062.

    Article  PubMed  Google Scholar 

  7. Nguyen TMU, La Caze A, Cottrell N. What are validated self-report adherence scales really measuring?: a systematic review. Br J Clin Pharmacol. 2014;77(3):427–45. https://doi.org/10.1111/bcp.12194.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Lu Y, Xu J, Zhao W, Han HR. Measuring Self-Care in persons with type 2 diabetes: a systematic review. Eval Health Prof. 2016;39(2):131–84. https://doi.org/10.1177/0163278715588927.

    Article  PubMed  Google Scholar 

  9. Pareja-Martínez E, Esquivel-Prados E, Martínez-Martínez F, García-Corpas JP. Questionnaires on adherence to antihypertensive treatment: a systematic review of published questionnaires and their psychometric properties. Int J Clin Pharm. 2020;42(2):355–65. https://doi.org/10.1007/s11096-020-00981-x.

    Article  PubMed  Google Scholar 

  10. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. https://doi.org/10.1016/j.jclinepi.2010.02.006.

    Article  PubMed  Google Scholar 

  11. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49. https://doi.org/10.1007/s11136-010-9606-8.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–57. https://doi.org/10.1007/s11136-018-1798-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. https://doi.org/10.1186/2046-4053-4-1.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18(8):1115–23. https://doi.org/10.1007/s11136-009-9528-5.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. https://doi.org/10.1186/s13643-016-0384-4.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7): e1000097. https://doi.org/10.1371/journal.pmed.1000097.

    Article  Google Scholar 

  17. Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171–9. https://doi.org/10.1007/s11136-017-1765-4.

    Article  CAS  PubMed  Google Scholar 

  18. Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27(5):1159–70. https://doi.org/10.1007/s11136-018-1829-0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;350: g7647. https://doi.org/10.1136/bmj.g7647.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank the Fundo de Apoio ao Ensino, Pesquisa e Extensão—FAEPEX, University of Campinas – Unicamp, São Paulo, Brazil and the Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq for the funding support to this research.

Funding

The authors acknowledge the following financial support: Fundo de Apoio ao Ensino, Pesquisa e Extensão—FAEPEX, University of Campinas – Unicamp, São Paulo, Brazil (grant: 3056/18; No. 519.292), and Conselho Nacional de Desenvolvimento Científico e Tecnológico—CNPq (grant No. 312367/2017–1).

Author information

Authors and Affiliations

  1. School of Nursing, University of Campinas (Unicamp), 126 Tessália Vieira de Camargo Street, Campinas, São Paulo, CEP: 13083-887, Brazil

    Henrique Ceretta Oliveira, Daisuke Hayashi Neto, Samantha Dalbosco Lins Carvalho, Rita de Cássia Lopes Barros, Mayza Luzia dos Santos Neves, Carla Renata Silva Andrechuk, Neusa Maria Costa Alexandre & Roberta Cunha Matheus Rodrigues

Authors
  1. Henrique Ceretta Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daisuke Hayashi Neto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samantha Dalbosco Lins Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rita de Cássia Lopes Barros
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mayza Luzia dos Santos Neves
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Carla Renata Silva Andrechuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Neusa Maria Costa Alexandre
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Roberta Cunha Matheus Rodrigues
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The authors HCO, NMCA and RCMR conceived this research and developed the protocol. HCO, DHN, SDLC, RCLB, CRSA and MLSN evaluated the titles and abstracts. All authors contributed to the improvement, revised and approved the final manuscript.

Corresponding author

Correspondence to Henrique Ceretta Oliveira.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oliveira, H.C., Neto, D.H., Carvalho, S.D.L. et al. Psychometric properties of medication adherence instruments in cardiovascular diseases and type 2 diabetes mellitus: systematic review protocol. Syst Rev 10, 202 (2021). https://doi.org/10.1186/s13643-021-01755-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-021-01755-w

Keywords

Systematic Reviews

ISSN: 2046-4053