Magnetic resonance myocardial perfusion imaging in the diagnosis of functionally significant obstructive coronary artery disease: a systematic review protocol
© Pharithi et al.; licensee BioMed Central Ltd. 2014
Received: 3 November 2013
Accepted: 31 March 2014
Published: 26 May 2014
Cardiac magnetic resonance (CMR) myocardial perfusion imaging has been suggested as a non-invasive alternative to pressure wire guided fractional flow reserve (FFR) in detecting haemodynamically significant obstructive coronary artery disease (CAD). The objective of this systematic review is to determine the diagnostic accuracy of CMR and to compare it to FFR.
A systematic review of diagnostic test accuracy of CMR and FFR will be conducted. Relevant English-language articles published before November 2013 in Medline, PubMed, EMBASE, Google scholar, Scopus and Cochrane databases will be identified. Relevant referenced articles from those selected will also be analysed. Articles describing diagnostic studies that compared CMR to FFR in patients with known or suspected coronary artery disease will be included. Two investigators will independently screen, assess quality and extract data from the selected articles. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool will be used to assess methodological quality. STATA 13 (the xtmelogit command) software will be used to calculate bivariate random effects models and estimate pooled sensitivity and specificity with 95% confidence intervals. Forests plots and summary receiver operating characteristics curves will also be generated. Sub-group pooled analyses using image quality of CMR (in terms of magnetic flux density - Tesla) and basis of analyses (coronary arterial territory vs. patients basis) at different FFR cutoffs (≤0.75 and ≤0.8) will also be performed.
This systematic review will help to determine if CMR is an adequate alternative to FFR in the diagnosis of significant and obstructive CAD. We will also be able to assess diagnostic accuracy of specific types of CMR scan at different FFR cutoffs.
Systematic review registration
This systematic review had been registered at PROSPERO and the registration number is CRD42013006180.
KeywordsCardiac magnetic resonance Fractional flow reserve CMR FFR Quality assessment of diagnostic accuracy studies 2 tool QUADAS2 STATA 13 Coronary artery disease Meta-analyses and systematic review protocol
Ischaemic heart disease (IHD) as a consequence of untreated coronary artery disease (CAD) is one of the top three causes of mortality and the most common cause of morbidity in developed countries [1, 2]. Therefore, early diagnosis is important. Assessment of haemodynamically significant narrowing of coronary arteries with pressure-wire guided fractional flow reserve (FFR) is a widely accepted practice by interventional cardiologists [3–6]. However, this technique is invasive and exposes patients to ionizing radiation. Hence, the use of non-invasive diagnostic tools with less or no radiation is desirable.
Cardiac magnetic resonance (CMR) perfusion imaging is a well-established and non-invasive technique that has been shown to be safe in the diagnosis of obstructive coronary lesions . In a single exam, both anatomical and functional information can be integrated with high spatial and temporal resolution without exposing the patient to harmful radiation .
Several small individual studies have evaluated the diagnostic performance of CMR compared to FFR, with its diagnostic power varying among reports. Some of these studies have been included in a meta-analyses which compared CMR to quantitative coronary angiography (QCA) . As several reports have been published after the above meta-analyses [10–13], and also owing to the fact that QCA often provides insufficient information regarding physiological significance of the coronary lesions, an updated systematic review of CMR diagnostic accuracy compared with an invasive pressure-wire guided FFR is required.
The primary objective is to assess the diagnostic accuracy of CMR perfusion imaging in the detection of functionally significant, obstructive coronary artery lesions in patients with known or suspected CAD, in comparison to FFR.
The secondary objective is to assess the potentially relevant-patient benefit (prognosis) of CMR perfusion imaging in the diagnosis of haemodynamically significant, obstructive but stable CAD. We also plan to investigate the diagnostic accuracy of CMR on the basis of magnetic flux density (in Tesla) and basis of analysis (coronary artery territory vs. patient analysis) and the methodological quality of the included studies.
The design of this systematic review follows the methodological approach as recommended by the Cochrane collaboration methods group on screening and diagnostic tests , the Agency for Healthcare Research and Quality and the United Kingdom National Institute for Health and Clinical Excellence. This protocol was written in accordance with the preferred reporting items for systematic review and meta-analysis (PRISMA) . This protocol has also been registered with PROSPERO (#CRD42013006180).
Relevant original English-language articles published prior to November 2013 in OVID Medline, Cochrane, Embase, Scopus, Google Scholar and PubMed databases will be electronically searched. Reference lists of all the retrieved papers will also be extensively cross-checked to supplement the list of the selected articles. Details of the specific search strategies for the relevant databases are shown in Additional file 1 (search strategy for OVID Medline database) and Additional file 2 (search strategy for PubMed Database).
Eligibility criteria and study selection
Search terms are present either in the title or abstract for the articles to be considered for analysis. Studies selected for inclusion are those which evaluate the diagnostic accuracy of CMR perfusion imaging (index test) for the detection of functionally significant coronary artery lesions (target condition) compared to an appropriate reference standard. The reference standard which will be used is coronary angiogram guided pressure wire-derived FFR. An FFR cutoff of either <0.75 or ≤0.80 will be used. These cutoffs are used because they include the narrow ‘grey zone’ (0.75-0.80) associated with inducible myocardial ischaemia with accuracy of ≤0.75 being above 90% . An FFR cutoff of ≤0.80 has widely been used in multi-vessel CAD since its introduction by the FAME investigators . The two cutoffs are still used interchangeably by researchers at this point.
Other forms of reference standard, such as single photon emission computed tomography (SPECT), visual coronary angiogram alone, stress echocardiogram and electrocardiogram or computed tomography coronary angiogram, will not be included so as to avoid verification bias . Two reviewers will independently screen the titles and the abstracts to deem a study suitable for inclusion. Subsequently, the entire manuscript will be assessed by one reviewer and double checked by another. Disagreements will be resolved by consensus or referral to a third reviewer. Review articles (to avoid repeated data), unpublished studies, letters, comments and case reports will be excluded.
Eligible articles, fulfilling our inclusion criteria, will be independently reviewed by two authors. The data to be extracted will include the author, country, year of publication, number and age of subjects, type of study, either single or multi-vessel CAD, diagnostic test characteristics and threshold for critical functional coronary arterial luminal stenosis (FFR ≤0.75 and or ≤0.8). Where values are not available we will also manually extract and calculate values for true positive (TP), false positive (FP), true negative (TN), false negative (FN), sensitivity, specificity, accuracy, positive predictive value, negative predictive value, positive likelihood ratio and negative likelihood ratio results in the detection of haemodynamically significant obstructive coronary artery lesions. Data for the diagnostic performance of CMR perfusion imaging against FFR will be displayed in contingency 2 × 2 tables. In order to allow the calculation of outcomes measures of interest, empty cells will be filled with 0.5 of events.
Assessment of methodological quality
Two reviewers will independently assess methodological quality of included studies by using the published QUADAS-2 (the Quality Assessment of Diagnostic Accuracy studies) tool . CMR results should be interpreted without knowledge of FFR. The QUADAS-2 tool was chosen because it assesses the risk of bias by methodological domain (participant selection, index test, reference standard and flow of participant through the study (see Additional file 3) rather than the more general overall risk of bias - as evident in the original QUADAS. The agreement or disagreement between the reviewers (inter-rater reliability) in evaluating methodological quality will be calculated with Cohen Kappa coefficient (k) . The items in QUADAS-2 will be as recommended by the Cochrane collaboration methods group on screening and diagnostic tests , the Agency for Healthcare Research and Quality and the United Kingdom National Institute for Health and Clinical Excellence. This tool will be applied in four phases: (1) the review question will be summarised; (2) the tool will be tailored to produce a review-specific guidance; (3) a flow diagram for the primary study will be constructed; and finally (4) bias and applicability will be judged. See Additional file 3 which shows an adapted QUADAS-2 in assessment of the risk of bias and applicability.
The primary outcome of this systematic review is to assess the diagnostic accuracy of CMR perfusion imaging in the detection of functionally significant obstructive luminal stenoses in patients with known or suspected CAD in comparison to FFR. The secondary objectives are to investigate the diagnostic accuracy of CMR in the diagnosis of haemodynamically obstructive CAD on the basis of magnetic flux density (defined in Tesla) and basis of analysis (coronary artery territory vs. patient basis). We will also be able to assess the methodological quality of the included studies.
Statistical analysis and data synthesis
Data analysis will be performed according to the following steps: (1) inter-rater reliability testing for study selection and assessment of methodological quality; (2) calculation of test accuracy measures (sensitivity, specificity and likelihood ratios); (3) testing of heterogeneity; (4) pooling of data; and (5) sub-group analysis.
Agreement between the reviewers (inter-rater reliability) in evaluating methodological quality by using the revised QUADAS-2 tool will be calculated with Cohen Kappa coefficient (k) . QUADAS-2 suggested tabulations  will also be used to present assessment results of overall performance of the selected studies. We will also calculate the sensitivity, specificity, positive and negative likelihood ratio (LR) and the diagnostic odds ratio (DOR) along with 95% confidence intervals (CI) to determine the diagnostic accuracy of each index test in differentiating non-significant from significant and haemodynamically critical coronary arterial luminal stenosis.
To statistically determine the heterogeneity in the studies we will use Cochrane Q (x 2 statistic) test and the I 2 statistic for heterogeneity. Evidence of clinically relevant heterogeneity will be considered when the I 2 statistic is >25% . In cases where clinically relevant heterogeneity is found, outcome measures will be estimated from studies factoring the highest scientific validity (studies that are most likely to be free from bias). Using bivariate random effects model (BREM), pooled and individual estimates of sensitivity and specificity at 95% CI will be presented in forest-plot diagrams. We will also generate summary of receiver operator curves (SROC) using point estimates of each study as well as symmetrical summary curve, a summary point estimate, 95% confidence region and 95% prediction region using STATA version 13 (xtmelogit command) as it has the capabilities . We also intend to use multivariate random effects model in the calculation pooled analysis of CMR’s diagnostic accuracy in relation to different FFR thresholds . Direct comparison of CMR and FFR will also be achieved by using bivariate models.
We will evaluate the presence of possible publication bias graphically by drawing funnel plots for each outcome measure and statistically by means of Egger’s standard regression test. Two-tailed P <0.10 tests will be assumed to be statistically significant. We will also acknowledge methodological heterogeneity or true study heterogeneity as these could also introduce asymmetry in publication bias assessment . The bivariate random effects model was preferred for this protocol as it preserves the two-dimensional nature of the original data. It also allows the estimation of between study variation in sensitivity and specificity separately in addition to the degree of correlation between the two .
The assessment of the haemodynamic clinical relevance of coronary arterial lesions seen on routine qualitative coronary angiography is important as evidence has emerged showing no long-term symptomatic or survival benefit for routine revascularisation procedures in patients with stable coronary disease . Conversely, there is evidence for improved outcomes following revascularisation in subjects with known haemodynamically significant coronary artery lesions [3–6]. Previous diagnostic test studies comparing CMR and FFR have reported variable results. Whether this is due to imprecision in reporting or variable methodological quality it is still not clear and needs to be explored. This systematic review will allow determination as to whether CMR is an adequate screening test in the diagnosis of significant obstructive CAD. It will also determine if CMR could replace FFR for diagnosing coronary arterial lesions that are haemodynamically significant, and allow consideration of the potential benefit of CMR in diagnosing ischaemic  and non-ischaemic myocardial pathologies [28–30] without exposing patients to ionising radiation. This systematic review may also identify the type of CMR magnetic field strength that could provide the greatest sensitivity and specificity. The results of the review will be communicated as abstract presentations at conferences and will be published in a peer-reviewed journal.
Area under the curve
Coronary artery disease
Cardiac magnetic resonance
Fractional flow reserve
Summary of receiver operator curves
Quality assessment of diagnostic accuracy studies.
This research received no grants or funding from any agency in the public, commercial or not-for-profit sectors.
- Yusuf S, Reddy S, Ounpuu S, Anand S: Global burden of cardiovascular diseases: part I: general considerations, the epidemiologic transition, risk factors, and impact of urbanization. Circulation. 2001, 104: 2746-2753. 10.1161/hc4601.099487.View ArticlePubMedGoogle Scholar
- Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, Abraham J, Adair T, Aggarwal R, Ahn SY, Alvarado M, Anderson HR, Anderson LM, Andrews KG, Atkinson C, Baddour LM, Barker-Collo S, Bartels DH, Bell ML, Benjamin EJ, Bennett D, Bhalla K, Bikbov B, Bin Abdulhak A, Birbeck G, Blyth F, Bolliger I, Boufous S, Bucello C, Burch M: Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2013, 380: 2095-2128.View ArticleGoogle Scholar
- Tonino PA, de Bruyne B, Pijls NH, Siebert U, Ikeno F, van’t Veer M, Klauss V, Manoharan G, Engstrøm T, Oldroyd KG, Ver Lee PN, MacCarthy PA, Fearon WF, FAME Study Investigators: Fractional flow reserve versus angiography for guiding percutaneous coronary intervention. N Engl J Med. 2009, 360: 213-224. 10.1056/NEJMoa0807611.View ArticlePubMedGoogle Scholar
- Pijls NH, Fearon WF, Tonino PA, Siebert U, Ikeno F, Bornschein B, van’t Veer M, Klauss V, Manoharan G, Engstrøm T, Oldroyd KG, Ver Lee PN, MacCarthy PA, De Bruyne B, FAME Study Investigators: Fractional flow reserve versus angiography for guiding percutaneous coronary intervention in patients with multivessel coronary artery disease: 2-year follow-up of the FAME (Fractional Flow Reserve Versus Angiography for Multivessel Evaluation) study. J Am Coll Cardiol. 2010, 56: 177-184. 10.1016/j.jacc.2010.04.012.View ArticlePubMedGoogle Scholar
- Muller O, Mangiacapra F, Ntalianis A, Verhamme KM, Trana C, Hamilos M, Bartunek J, Vanderheyden M, Wyffels E, Heyndrickx GR, van Rooij FJ, Witteman JC, Hofman A, Wijns W, Barbato E, De Bruyne B: Long-term follow-up after fractional flow reserve-guided treatment strategy in patients with an isolated proximal left anterior descending coronary artery stenosis. JACC Cardiovasc Interv. 2011, 4: 1175-1182. 10.1016/j.jcin.2011.09.007.View ArticlePubMedGoogle Scholar
- Fearon WF, Bornschein B, Tonino PA, Gothe RM, Bruyne BD, Pijls NH, Siebert U, Fractional Flow Reserve Versus Angiography for Multivessel Evaluation (FAME) Study Investigators: Economic evaluation of fractional flow reserve-guided percutaneous coronary intervention in patients with multivessel disease. Circulation. 2010, 122: 2545-2550. 10.1161/CIRCULATIONAHA.109.925396.View ArticlePubMedGoogle Scholar
- Costa MA, Shoemaker S, Futamatsu H, Klassen C, Angiolillo DJ, Nguyen M, Siuciak A, Gilmore P, Zenni MM, Guzman L, Bass TA, Wilke N: Quantitative magnetic resonance perfusion imaging detects anatomic and physiologic coronary artery disease as measured by coronary angiography and fractional flow reserve. J Am Coll Cardiol. 2007, 50: 514-522. 10.1016/j.jacc.2007.04.053.View ArticlePubMedGoogle Scholar
- Lanza GABA, Sestito A, Natale L, Sgueglia GA, Galiuto L, Infusino F, Mariani L, Centola A, Crea F: Relation between stress-induced myocardial perfusion defects on cardiovascular magnetic resonance and coronary microvascular dysfunction in patients with cardiac syndrome X. J Am Coll Cardiol. 2008, 51: 466-472. 10.1016/j.jacc.2007.08.060.View ArticlePubMedGoogle Scholar
- Hamon M, Fau G, Née G, Ehtisham J, Morello R, MH : Meta-analysis of the diagnostic performance of stress perfusion cardiovascular magnetic resonance for detection of coronary artery disease. J Cardiovasc Magn Reson. 2010, 19: 1-Google Scholar
- Jogiya R, Kozerke S, Morton G, de Silva K, Redwood S, Perera D, Nagel E, Plein S: Validation of dynamic 3-dimensional whole heart magnetic resonance myocardial perfusion imaging against fractional flow reserve for the detection of significant coronary artery disease. J Am Coll Cardiol. 2012, 60: 756-765. 10.1016/j.jacc.2012.02.075.View ArticlePubMedGoogle Scholar
- Manka R, Paetsch I, Kozerke S, Moccetti M, Hoffmann R, Schroeder J, Reith S, Schnackenburg B, Gaemperli O, Wissmann L, Wyss CA, Kaufmann PA, Corti R, Boesiger P, Marx N, Luscher TF, Jahnke C: Whole-heart dynamic three-dimensional magnetic resonance perfusion imaging for the detection of coronary artery disease defined by fractional flow reserve: determination of volumetric myocardial ischaemic burden and coronary lesion location. Eur Heart J. 2012, 33: 2016-2024. 10.1093/eurheartj/ehs170.View ArticlePubMedGoogle Scholar
- Lockie T, Ishida M, Perera D, Chiribiri A, de Silva K, Kozerke S, Marber M, Nagel E, Rezavi R, Redwood S, Plein S: High-resolution magnetic resonance myocardial perfusion imaging at 3.0-Tesla to detect hemodynamically significant coronary stenoses as determined by fractional flow reserve. J Am Coll Cardiol. 2011, 57: 70-75. 10.1016/j.jacc.2010.09.019.View ArticlePubMedGoogle Scholar
- Bettencourt N, Chiribiri A, Schuster A, Ferreira N, Sampaio F, Duarte R, Santos L, Melica B, Rodrigues A, Braga P, Teixeira M, Simoes L, Leite-Moreira A, Silva-Cardoso J, Nagel E, Portugal P, Gama V: Cardiac magnetic resonance myocardial perfusion imaging for detection of functionally significant obstructive coronary artery disease: A prospective study. Int J Cardiol. 2013, 168: 765-773. 10.1016/j.ijcard.2012.09.231.View ArticlePubMedGoogle Scholar
- Smidt N, Deeks J, Davenport C: Guide to the contents of a Cochrane Diagnostic Test Accuracy Protocol. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0.0. Edited by: Deeks JJ, Bossuyt PM, Gatsonis C. 2011, Oxford: The Cochrane CollaborationGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, DG; A, Group P: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.View ArticlePubMedPubMed CentralGoogle Scholar
- Pijls NH, van Gelder B, van der Voort P, Peels K, Bracke FA, Bonnier HJ, MI eG: Fractional flow reserve. A useful index to evaluate the influence of an epicardial coronary stenosis on myocardial blood flow. Circulation. 1995, 92: 3183-3193. 10.1161/01.CIR.92.11.3183.View ArticlePubMedGoogle Scholar
- Fearon WF, Tonino PA, de Bruyne B, Siebert U, NH; P, Investigators. FS: Rationale and design of the fractional flow reserve versus angiography for multivessel evaluation (FAME) study. Am Heart J. 2007, 154: 632-636. 10.1016/j.ahj.2007.06.012.View ArticlePubMedGoogle Scholar
- Lijmer JG, Mol BW, Heisterkamp S, Bonsel GJ, Prins MH, JH vM: Emperical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999, 282: 1061-1066. 10.1001/jama.282.11.1061.View ArticlePubMedGoogle Scholar
- Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, QUADAS-2 Group: QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011, 155: 529-536. 10.7326/0003-4819-155-8-201110180-00009.View ArticlePubMedGoogle Scholar
- Cicchetti DV: Assessing inter-rater reliability for rating scales: resolving some basic issues. Br J Psychiatry. 1976, 129: 452-456. 10.1192/bjp.129.5.452.View ArticlePubMedGoogle Scholar
- Higgins JP, Thompson SG, Deeks JJ, DG A: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.View ArticlePubMedPubMed CentralGoogle Scholar
- Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, LM B: An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol. 2008, 61: 1095-1103. 10.1016/j.jclinepi.2007.09.013.View ArticlePubMedGoogle Scholar
- Hamza TH, Arends LR, van Houwelingen HC, T. S : Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Med Res Methodo. 2009, 9: 73-10.1186/1471-2288-9-73.View ArticleGoogle Scholar
- Egger M, Davey Smith G, Schneider M, C M: Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997, 315: 629-634. 10.1136/bmj.315.7109.629.View ArticlePubMedPubMed CentralGoogle Scholar
- Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, AH Z: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.View ArticlePubMedGoogle Scholar
- Boden W, O’Rourke R, Teo K, Hartigan P, Maron D, Kostuk W, Knudtson M, Dada M, Casperson P, C H: Optimal medical therapy with or without PCI for stable coronary disease. N Eng J Med. 2007, 356: 1503-1516. 10.1056/NEJMoa070829.View ArticleGoogle Scholar
- Masci PG, Andreini D, Francone M, Bertella E, de Luca L, Coceani M, Mushtaq S, Mariani M, Carbone I, Pontone G, Agati L, Bogaert J, Lombardi M: Prodromal angina is associated with myocardial salvage in acute ST-segment elevation myocardial infarction. Eur Heart J Cardiovasc Imaging. 2013, 14: 1041-1048. 10.1093/ehjci/jet063.View ArticlePubMedGoogle Scholar
- Grün S, Schumm J, Greulich S, Wagner A, Schneider S, Bruder O, Kispert EM, Hill S, Ong P, Klingel K, Kandolf R, Sechtem U, Mahrholdt H: Long-term follow-up of biopsy-proven viral myocarditis: predictors of mortality and incomplete recovery. J Am Coll Cardiol. 2012, 59: 1604-1615. 10.1016/j.jacc.2012.01.007.View ArticlePubMedGoogle Scholar
- Greulich S, Deluigi CC, Gloekler S, Wahl A, Zürn C, Kramer U, Nothnagel D, Bültel H, Schumm J, Grün S, Ong P, Wagner A, Schneider S, Nassenstein K, Gawaz M, Sechtem U, Bruder O, Mahrholdt H: CMR imaging predicts death and other adverse events in suspected cardiac sarcoidosis. JACC Cardiovasc Imaging. 2013, 6: 501-511. 10.1016/j.jcmg.2012.10.021.View ArticlePubMedGoogle Scholar
- Silvera S, Strach K, Bogaert J, Sommer T, Vignaux O: Cardiomyopathies (hypertrophy and failure): what can offer cardiac magnetic resonance imaging?. Presse Med. 2011, 40: e425-e436. 10.1016/j.lpm.2010.12.016.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.