This article has Open Peer Review reports available.
Quality metrics in solid organ transplantation: protocol for a systematic scoping review
© The Author(s). 2016
Received: 22 February 2016
Accepted: 1 June 2016
Published: 14 June 2016
Transplantation is often the best, if not the only treatment for end-stage organ failure; however, the quality metrics for determining whether a transplant program is delivering safe, high quality care remains unknown. The purpose of this study is to identify and describe quality indicators or metrics in patients who have received a solid organ transplant.
We will conduct a systematic scoping review to evaluate and describe quality indicators or metrics in patients who have received a solid organ transplant. We will search MEDLINE, Embase, and the Cochrane Central Register for Controlled Trials. Two reviewers will conduct all screening and data extraction independently. The articles will be categorized according to the six domains of quality, and the metrics will be appraised using criteria for a good quality measure.
The results of this review will guide the development, selection, and validation of appropriate quality metrics necessary to drive quality improvement in transplantation.
Systematic review registration
Transplantation is the only treatment for some types of end-stage organ failure (e.g., liver) while it is the treatment of choice for others (e.g., kidney). In the case of kidney failure, transplantation is preferred since it improves quality of life, prolongs survival, and is less costly compared to dialysis [1–3]. From the perspective of the patient and the healthcare system, however, major problems remain in transplantation including lack of appropriate access; premature transplant failure and death; and reduced quality of life due to various complications.
The best approach for determining whether a transplant program is delivering high-quality, safe care remains unknown [4–6]. The USA has instituted mandatory reporting of survival data from all transplant hospitals ; however, this metric on its own may not adequately capture all aspects of transplant program quality as “poor” performance may lead to reduced access to transplantation services [4, 7, 8]. Healthcare quality encompasses important dimensions beyond effectiveness outcomes (e.g., graft survival), such as access to treatment, patient-centeredness, safety, and equity . In transplantation, these aspects of quality are less well known. The purpose of this study is to systematically identify and review all quality metrics/indicators that have been used in the practice of solid organ transplantation.
The aim of this study is to systematically review the literature in order to identify and describe the indicators/metrics that are used to measure the quality of care provided to solid organ transplant recipients. Our objectives are the following: first, to describe which quality metrics are being reported and how they are being used in solid organ transplantation; second, to categorize these metrics within the domains of quality ; and third, to evaluate whether these metrics fit the criteria for a good measure .
A comprehensive electronic literature search will be conducted in MEDLINE, Embase, and the Cochrane Central Register for Controlled Trials (CENTRAL) from inception to April 2016. The references of the included studies and existing reviews will be scanned for additional studies that were not identified by the search. The search strategy will be developed with the assistance of a medical librarian experienced in systematic reviews. A structured search strategy will be based on controlled vocabulary and relevant key terms, and will be broad to prioritize sensitivity (Additional file 1). Key search terms will include “quality”, “quality indicator”, “quality improvement” and ”quality of health care”. The language of publication will be restricted to the English language. This review has been registered with PROSPERO (CRD42016035353).
Study screening and inclusion
Literature search results will be uploaded to EndNote X7 software, which will be used to find and remove duplicates. References will be sorted alphabetically by title and exported to Microsoft Word for screening. Two independent reviewers will screen the titles and abstracts (stage 1) against the inclusion criteria. Additional duplicates that may be missed by the referencing software will be identified during the screening process. For all titles and abstracts that appear potentially eligible, we will obtain full-text reports. If no abstract is available for a given citation, then the full-text will be obtained unless the article can be confidently excluded by its title alone. Two independent reviewers will screen all full-text reports to determine whether they meet the inclusion criteria (stage 2). Prior to the formal screening process, the two reviewers will participate in a short pilot exercise to identify and address any inconsistencies in the application of the screening criteria. A third reviewer will reconcile any disagreements between the two reviewers regarding an article’s inclusion status. The study selection process will be summarized using a PRISMA flow diagram .
Study eligibility criteria
Studies will be selected according to predefined criteria. Peer reviewed, published articles will be included if they evaluate, measure, or review quality metrics/indicators in solid organ transplantation. Quality metrics are defined as “any objective measure that has been developed to support self-assessment and quality improvement at the provider, hospital and/or health care system” . To be included, the metrics/indicators must be capable of some degree of quantification  and related to the quality of care that is provided to the transplant recipients by a transplant program. All metrics (e.g., structure, process, and outcomes) will be considered . Metrics will be excluded for the following reasons: (i) they are not capable of some degree of quantification, (ii) the metric is dependent on non-modifiable factors, (iii) the metric is related to the organ donor or the organ procurement process, and (iv) the metric is used as a predictive tool, rather than an assessment of quality. We will include studies examining humans of all ages who have undergone a solid organ transplant (kidney, heart, liver, lung, pancreas, small bowel, and combinations of these organs). We will exclude studies involving bone marrow and cell transplants. There will be no restrictions on the design of the study, the type of setting, or the length of follow-up for outcomes.
Data will be extracted from each eligible study by two independent reviewers using a pre-designed form in Microsoft Excel. The form will be pilot tested to ensure it captures all the relevant information. Any discrepancies that cannot be resolved by discussion will be adjudicated by a third reviewer.
Information pertaining to study identification (author, year of publication, number and location of centers, funding, and journal), study design (type of study, sample size, eligibility criteria, and length of follow-up), aggregate patient characteristics (age, gender, organ(s) studied, length of time since transplant, and comorbidities), and relevant quality metrics (name of metric(s), type of metric, measurement time points, the comparator outcome, main findings, and limitations of the metric) will be extracted.
Domain of quality
Delivery of health care that is timely, geographically reasonable, and provided in a setting where skills and resources are appropriate
Delivering health care which does not vary in quality because of personal characteristics such as gender, race, ethnicity, or socio-economic status
Delivering health care which takes into account the individual patient preferences, needs, and values
Delivering health care in a manner which maximizes resources use and avoids waste, including waste of equipment, supplies, ideas and energy
Delivering health care which minimizes risks and avoids injuries to patients from the care that is intended to help them
Delivering health care that is adherent to an evidence base and results in improved health outcomes for patients, and refraining from providing services to those not likely to benefit.
The aim of this systematic scoping review is to evaluate and describe quality metrics that are used in solid organ transplantation. The rigorous and systematic nature of our review will ensure that it captures all relevant information on quality metrics in organ transplantation. Due to the multiple domains of quality, we have purposely created a relatively broad search strategy and study inclusion criteria in order to capture the most comprehensive look at quality metrics that are being used or have been proposed in solid organ transplantation. Reliable and valid quality metrics are necessary to establish baseline performance, to determine areas that need improvement, and to determine if practice changes have led to progress. The results of this study will identify innovative transplant quality indicators, which will help to guide the selection of core quality metrics which are suitable for further study, and can be used in subsequent transplant quality improvement initiatives that will actively measure and promote improvements in health outcomes.
CENTRAL, Cochrane Central Register for Controlled Trials; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; PRISMA-P, Preferred Reporting Items for Systematic review and Meta-Analysis Protocols
We would like to thank Risa Shorr for her guidance with the development of the search strategy. Dr Knoll is supported by the University of Ottawa Chair in Clinical Transplantation Research.
This study is funded by the Canadian Institutes of Health Research (#143239). The funder has no role in developing the review protocol.
GK is the guarantor. All authors conceived and designed the protocol. KB drafted the protocol. GK critically reviewed and revised the protocol. KB, AB, and NF performed the study selection and data extraction, and each person reconciled any discrepancies discovered by the other two reviewers. KB and GK performed data interpretation and manuscript preparation. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Laupacis A, Keown P, Pus N, Krueger H, Ferguson B, Wong C, Muirhead N. A study of the quality of life and cost-utility of renal transplantation. Kidney Int. 1996;50:235–42.View ArticlePubMedGoogle Scholar
- Tonelli M, Wiebe N, Knoll G, Bello A, Browne S, Jadhav D, Klarenbach S, Gill J. Systematic review: kidney transplantation compared with dialysis in clinically relevant outcomes. Am J Transplant. 2011;11:2093–109.View ArticlePubMedGoogle Scholar
- Wong G, Howard K, Chapman JR, Chadban S, Cross N, Tong A, Webster AC, Craig JC. Comparative survival and economic benefits of deceased donor kidney transplantation and dialysis in people with varying ages and co-morbidities. PLoS One. 2012;7:e29591.View ArticlePubMedPubMed CentralGoogle Scholar
- Kasiske BL, McBride MA, Cornell DL, Gaston RS, Henry ML, Irwin FD, AK, Metzler NW, Murphy KW, Reed AI, et al. Report of a consensus conference on transplant program quality and surveillance. Am J Transplant. 2012;12:1988–96.Google Scholar
- Toussaint ND, McMahon LP, Dowling G, Soding J, Safe M, Knight R, Fair K, Linehan L, Walker RG, Power DA. Implementation of renal key performance indicators: promoting improved clinical practice. Nephrology (Carlton). 2015;20:184–93.View ArticleGoogle Scholar
- van der Veer SN, van Biesen W, Couchoud C, Tomson CR, Jager KJ. Measuring the quality of renal care: things to keep in mind when selecting and using quality indicators. Nephrol Dial Transplant. 2014;29:1460–7.View ArticlePubMedGoogle Scholar
- Schold JD, Arrington CJ, Levine G. Significant alterations in reported clinical practice associated with increased oversight of organ transplant center performance. Prog Transplant. 2010;20:279–87.View ArticlePubMedGoogle Scholar
- Schold JD, Buccini LD, Srinivas TR, Srinivas RT, Poggio ED, Flechner SM, Soria C, Segev DL, Fung J, Goldfarb DA. The association of center performance evaluations and kidney transplant volume in the United States. Am J Transplant. 2013;13:67–75.View ArticlePubMedGoogle Scholar
- Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001.Google Scholar
- Janakiraman V, Ecker J. Quality in obstetric care: measuring what matters. Obstet Gynecol. 2010;116:728–32.View ArticlePubMedGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8:336–41.View ArticlePubMedGoogle Scholar
- Bonow RO, Masoudi FA, Rumsfeld JS, Delong E, Estes 3rd NA, Goff Jr DC, Grady K, Green LA, Loth AR, Peterson ED, et al. ACC/AHA classification of care metrics: performance measures and quality metrics: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures. J Am Coll Cardiol. 2008;52:2113–7.View ArticlePubMedGoogle Scholar
- Donabedian A. The quality of care how can it be assessed. JAMA. 1988;260:1743–8.View ArticlePubMedGoogle Scholar
- World Health Organization. Quality of care: a process for making strategic choices in health systems. France: WHO Press; 2006. p. 50. 50.Google Scholar