Skip to main content

Individual patient data meta-analysis for the clinical assessment of coronary computed tomography angiography: protocol of the Collaborative Meta-Analysis of Cardiac CT (CoMe-CCT)



Coronary computed tomography angiography has become the foremost noninvasive imaging modality of the coronary arteries and is used as an alternative to the reference standard, conventional coronary angiography, for direct visualization and detection of coronary artery stenoses in patients with suspected coronary artery disease. Nevertheless, there is considerable debate regarding the optimal target population to maximize clinical performance and patient benefit. The most obvious indication for noninvasive coronary computed tomography angiography in patients with suspected coronary artery disease would be to reliably exclude significant stenosis and, thus, avoid unnecessary invasive conventional coronary angiography. To do this, a test should have, at clinically appropriate pretest likelihoods, minimal false-negative outcomes resulting in a high negative predictive value. However, little is known about the influence of patient characteristics on the clinical predictive values of coronary computed tomography angiography. Previous regular systematic reviews and meta-analyses had to rely on limited summary patient cohort data offered by primary studies. Performing an individual patient data meta-analysis will enable a much more detailed and powerful analysis and thus increase representativeness and generalizability of the results. The individual patient data meta-analysis is registered with the PROSPERO database (CoMe-CCT, CRD42012002780).


The analysis will include individual patient data from published and unpublished prospective diagnostic accuracy studies comparing coronary computed tomography angiography with conventional coronary angiography. These studies will be identified performing a systematic search in several electronic databases. Corresponding authors will be contacted and asked to provide obligatory and additional data. Risk factors, previous test results and symptoms of individual patients will be used to estimate the pretest likelihood of coronary artery disease. A bivariate random-effects model will be used to calculate pooled mean negative and positive predictive values as well as sensitivity and specificity. The primary outcome of interest will be positive and negative predictive values of coronary computed tomography angiography for the presence of coronary artery disease as a function of pretest likelihood of coronary artery disease, analyzed by meta-regression. As a secondary endpoint, factors that may influence the diagnostic performance and clinical value of computed tomography, such as heart rate and body mass index of patients, number of detector rows, and administration of beta blockade and nitroglycerin, will be investigated by integrating them as further covariates into the bivariate random-effects model.


This collaborative individual patient data meta-analysis should provide answers to the pivotal question of which patients benefit most from noninvasive coronary computed tomography angiography and thus help to adequately select the right patients for this test.

Peer Review reports


Coronary artery disease (CAD) is the main cause of death in industrialized countries [1]. To allow early detection as well as accurately ruling out CAD, a reliable noninvasive test would have important advantages. To reliably exclude disease, a diagnostic test with a minimal proportion of false-negative results and thus a relatively high sensitivity should be used [2]. Coronary computed tomography (CT) angiography has already been evaluated comprehensively concerning its diagnostic accuracy potentials by single studies and meta-analyses. However, the influence of the clinical presentation, risk factors and prior test results of patients, which can be used to estimate the influence of the pretest likelihood of CAD on the positive and negative predictive values of coronary CT angiography, are not fully understood. A few single-center studies have been published dealing with the influence of the pretest likelihood of CAD on the diagnostic performance of CT. Meijboom et al. demonstrated in 254 symptomatic patients that the accuracy of coronary CT angiography was greatest in patients with low-to-intermediate pretest likelihood whereas the negative predictive value was substantially reduced in patients with high pretest likelihood [3]. This reduction of the negative predictive values in patients with high disease prevalence was also shown in a comparable study by Husmann et al. comprising 88 patients [4]. In 90 patients, Leber et al. also demonstrated that CT allows CAD to be accurately ruled out if an intermediate pretest likelihood is present [5]. Applying Bayesian analysis, Dewey et al. [6] confirmed that the diagnostic performance of both CT and magnetic resonance coronary angiography was influenced by the pretest likelihood. Pretest likelihood of CAD can be estimated according to clinical presentation and risk factors applying several tabulation tools [711] and the appropriateness of further testing may be estimated based on their results. Establishing and further elucidating the potential of pretest likelihood estimations to ensure the appropriateness of CT is an important aim of cardiovascular medicine. In a meta-regression analysis using disease prevalence as a surrogate marker for pretest likelihood, Schlattmann et al. further specified the boundaries of low-to-intermediate pretest likelihood for patients in whom coronary CT angiography can be applied as a reliable rule-out test [12] (Figure 1).

Figure 1
figure 1

Predictive values of coronary computed tomography angiography. The population-averaged predictive values (based on published studies and their summary results) are shown as blue (positive) and green (negative) curves with their 95% confidence intervals based on the published studies (circles). The negative predictive values are shown as 1-negative predictive values to avoid overlap with the positive predictive value curve. The number of patients included in the published studies is indicated by the size of the circles. The dashed lines indicate the predefined minimal predictive values on the y-axis (90% for negative and 70% for the positive predictive values). Such analyses are limited because only the published predictive values in the studies and the calculated prevalences (but not the pretest likelihoods [79]) are available. Thus, individual patient data (IPD) from a collaborative meta-analysis can overcome these limitations and draw more meaningful conclusions about the clinical utility of diagnostic tests. Image reproduced from: Schlattmann P, Schuetz GM, Dewey M: Influence of coronary artery disease prevalence on predictive values of coronary CT angiography: a meta-regression analysis. Eur Radiol 2011, 21(9):1904–1913 [12].

The analysis is based on summary patient collective data from primary study articles aggregated in a regular meta-analysis [13] and, thus, further specific patient-level information for more detailed subanalyses were not available.

The purpose and main aim of this project is thus to summarize the published and unpublished evidence on coronary CT angiography using IPD in a collaborative meta-analysis to draw more reliable and generalizable conclusions [14] concerning the appropriateness of CT in patients with varying presentations and thus pretest likelihoods [15]. The results should enable us to determine which patients benefit most from noninvasive coronary angiography and those less suited to undergo CT.

Moreover, the influence of additional patient and acquisition characteristics will also be summarized in our collaborative meta-analysis to allow us to draw important conclusions concerning the eligibility of patients for coronary CT angiography and the importance of specific technical requirements and methods of preparation. Among these factors being discussed or having previously been shown to influence the diagnostic performance of coronary CT angiography is the heart rate of the patients during scanning, which may lead to motion artifacts, and the body mass index, which, if severely increased, can result in rather noisy nondiagnostic test results [1618]. Also, technical factors such as the number of simultaneous CT detector rows and the administration of beta blockade to reduce heart rate and nitroglycerin to dilate the vessels have been shown in single-center studies to alter the diagnostic performance and image quality of coronary CT angiography [1924]. In detail, subanalyses will be performed to investigate the following questions:

  • Is there a decrease in diagnostic accuracy of coronary CT angiography in patients with a body mass index >30?

  • Does heart rate control (heart rate <60 beats per minute) lead to an increase of accuracy?

  • Does the use of =64-row CTs lead to an increase of diagnostic accuracy?

  • Is there a difference in diagnostic accuracy between men and women after adjusting for differences in pretest likelihood?

  • Is diagnostic accuracy higher in patients >70 years of age or younger patients after adjusting for differences in calcium score?

  • Is a certain Agatston calcium score threshhold a good universal predictor for coronary artery disease?

  • Is diagnostic accuracy of CT different in patients with atypical or typical chest pain?

This IPD meta-analysis will enable us to perform the main and secondary analyses on an individual per-patient basis, the clinically most relevant level of analysis. The results may have relevant clinical implications because conventional coronary angiography (CCA) exposes the patients to infrequent yet considerable risks, such as myocardial infarction, coronary artery dissection and ventricular tachycardia [25, 26], which might be avoided using CT in selected patient populations with suspected CAD. In addition, there are also economic considerations because CT might also be more cost effective [27].


This is a study protocol for the collaborative IPD meta-analysis on coronary CT angiography in comparison to conventional angiography as the gold standard, called Co llaborative Me ta-Analysis of C ardiac CT (CoMe-CCT). It was registered with the PROSPERO database [28, 29] (registration number: CRD42012002780). This collaborative IPD meta-analysis is exempt from ethical approval as the analysis as well as the results for publication only involve de-identified data and all individual studies that will be summarized have received local ethics approval.

Identifying eligible studies for CoMe-CCT

Valid published and unpublished studies will be retrieved by directly contacting all corresponding authors from published studies on coronary CT versus CCA in patients with suspected CAD. This will be achieved by including the primary studies of a recent regular systematic review and meta-analysis by our working group [13], and performing an update of this review to identify most recent studies. A sensitive search strategy using the particular thesaurus terms of the specific databases in combination with free text word synonyms [2] will be used to search MEDLINE (via PubMed), EMBASE (via Ovid) and ISI Web of Science databases for updating the article pool of relevant studies (suggested search strategies for all databases are provided in Additional file 1). We will also search bibliographies of retrieved studies, systematic reviews and meta-analyses, and include results of abstracts presented at most recent congresses as suggested by clinical experts.

Key inclusion criteria are a prospective study design; use of a contemporary CT scanner with at least 12 simultaneous detector rows; use of ≥50% diameter reduction as the cut-off criterion for significant coronary artery stenoses in CT and CCA; application of CCA in all patients, regardless of the results of CT; provision of individual patient results for CT and CCA (positive, negative, and nondiagnostic), which allow calculation of 2×2 (excluding nondiagnostic results) or 3×2 (including nondiagnostic results) tables [30]; articles published in English or German; and provision of basic patient characteristics (age, gender, angina type, heart rate).

Studies with the following characteristics will be excluded: retrospective study design; overlap with other studies as indicated by the corresponding author.

Study screening and selection will be performed by two independent investigators. Retrieved articles will be searched after duplicate papers (from MEDLINE, EMBASE and ISI Web of Science) are identified and eliminated. In a first phase, titles and abstracts will be scanned and, in accordance with the inclusion and exclusion criteria, either discarded or retained for further investigation. In a second phase, the remaining potentially eligible articles will be reassessed in depth using the full text.

Methodological quality assessment

Two investigators will independently carry out the data extraction (including quality assessment) from all the retrieved published studies based on the full text articles. Discrepancies will be resolved in a consensus meeting, or, if agreement cannot be reached, they will be resolved in consensus with a third investigator. To assess and quantify the inter-rater agreement between the two investigators in evaluating methodological quality using the QUADAS tool [31], we will calculate the kappa statistics. The data extracted will be: general and detailed methodological study characteristics, characteristics of the study population, details of the CT technology used, and detailed reference standard (CCA) specifications.

Collection of individual patient data

An international steering committee of renowned experts from the field of noninvasive coronary CT angiography has been established to lead, oversee and represent the CoMe-CCT project. The steering committee consists of four clinical experts for cardiac CT: Stephan Achenbach, Erlangen, Germany; Matthew Budoff, Los Angeles, CA, USA; Mario J Garcia, New York, NY, USA; Marc Dewey, Berlin, Germany, and one clinical expert for CCA: Michael Laule, Berlin, Germany. The steering committee is completed by the project’s statistician Peter Schlattmann, Jena, Germany.

Corresponding authors of identified eligible published studies will be contacted using mail including a cover letter detailing the objectives of the collaborative meta-analysis, background information on IPD meta-analysis, and a CD containing a data collection file for input of individual patient results for the project. The details of the obligatory and additional patient and study characteristics are shown in Tables 1 and 2. The filled out data templates will be send back to us by either mail on CD or, more conveniently, by email. Further communication will mainly be performed by email or phone. Corresponding authors will also be contacted about unpublished data that will be eligible for inclusion in the collaborative meta-analysis if the inclusion criteria are met. To further enlarge the clinical data pool, authors will additionally be asked to provide data from registries. These data will not be included in the primary analyses, which are only based on data from the prospective studies.

Table 1 Obligatory computed tomography technology and patient characteristics requested in the data file
Table 2 Additional computed tomography technology and patient characteristics requested in the data file

Data management, security and validation

The same two investigators who will perform the electronic database search and identify published eligible studies for the regular review will also collect and assemble the IPD provided by the investigators of published and unpublished studies. Data will be sent as email attachments to the coordinating investigator of CoMe-CCT in an anonymized and de-identified way (without directly identifying information, that is, record numbers, names, addresses and so on will be removed). Data will be accepted in any kind of electronic format (for example, SPSS, Stata, Word document,) but, ideally, the investigators will provide the data using the individualized Microsoft Excel (Microsoft Corp., Redmond, WA, USA) spreadsheets made available to them. The original data collection files sent by the authors will be kept in their original version and will be saved on a password-protected server behind the firewall in order to ensure security. Only the coordinating laboratory of CoMe-CCT at Charité will have direct access to the individual data. Both investigators will each perform data validation using a copy. To ensure quality of the data, they will independently check the received data sets for data entry mistakes and consistency and will compare the sum of the individual patient results received with the published summary results from the primary studies. Differences will be discussed and settled in consensus, if possible. They will contact the providing corresponding author in case of discrepancies that should be resolved.

Outcome measures and statistical analysis

An extension of the exact binomial rendition [32] of the bivariate mixed-effects regression model developed by van Houwelingen et al. [33, 34] for treatment trial meta-analysis and modified for synthesis of diagnostic test data [35, 36] will be used for data synthesis. This bivariate statistical model does not transform pairs of positive and negative predictive values into a single indicator, but preserves the two-dimensional nature of the data taking into account any correlation between the two. Given that we are dealing with individual data, a three-level bivariate random-effects model will be applied. On the first level of the model, a binomial distribution will be assumed for the true positives among the test positives and the true negatives among the test negatives. On the second level, the variability between patients within a certain study will be modeled. Finally, on the third level the variability between studies will be taken into account.

The primary covariate of interest is the pretest likelihood of CAD. It will be calculated using a validated prediction tool [10] based on the original Diamond and Forrester model for risk calculation [7]. Using this tool, the pretest likelihood of a patient based on age, gender and clinical presentation can be estimated. Furthermore, the influence of covariates such as heart rate and body mass index of patients as well as the number of CT rows, and the administration of beta blockade and nitroglycerin, will be taken into account on the individual patient level. Model selection will be based on the likelihood ratio test and Bayesian Information Criterion.

Based on this model, mean logit positive predictive values and negative predictive values with their standard error and 95% confidence intervals, estimates of the between-study variability in logit positive and negative predictive values, and the covariance between them will be estimated. These quantities will be back-transformed to the original scale to obtain summary positive and negative predictive values. Using this data, a statistical prediction for a new cohort will be performed following the ideas presented by Skrondal and Rabe-Hasketh [37, 38]. Estimation will be done with SAS 9.2, Proc GLIMMIX and STATA 11, using the package GLLAMM. In addition, for performing a sensitivity analysis, we will also use WinBUGS [39]. If necessary, macros will be written to facilitate the use of three-level generalized linear mixed-effects models.

Based on the model described above, mean logit sensitivity and specificity with their standard error and 95% confidence intervals, estimates of the between-study variability in logit sensitivity and specificity, and the covariance between them will be estimated. These quantities will be back-transformed to the original ROC (Receiver Operating Characteristic) scale to obtain summary sensitivity, specificity and the diagnostic odds ratios. The derived logit estimates of sensitivity, specificity and respective variances are then used to construct a hierarchical summary ROC curve for CT with summary operating points for sensitivity and specificity on the curves and a 95% confidence contour ellipsoid.

Here the individual patient-specific covariates such as type and severity of symptoms, body mass index, beta blockade and sublingual nitroglycerin will be used in the regression analysis. This serves as tool to identify spectrum bias and clinically relevant influential factors.

For performing sensitivity analysis, the analysis will be redone by leaving out one study. The generalized linear mixed model is known to be sensitive to starting values. Thus an additional analysis with Bayesian methods using PROC MCMC, SAS 9.2 will be performed.


We believe that this collaborative multi-centric and multi-continental IPD meta-analysis will have an important impact on the clinical management of patients with suspected CAD as it should provide an answer to the question of which patients benefit most from coronary CT angiography. Furthermore, additional factors that influence the diagnostic performance of CT in comparison to CCA can be identified in this meta-analysis. This IPD meta-analysis also holds the potential to analyze and compare the predictive value of cardiac CT and CCA for subsequent major adverse cardiovascular events. Finally, the CoMe-CCT may facilitate the adequate selection of patients for cardiac CT by estimating the pretest likelihood for disease and predicting the diagnostic performance for individual patients that should ultimately help to avoid unnecessary examinations and thus decrease the use of scarce health care resources in the future [40].

Trial status

Currently, in the course of performance of the IPD meta-analysis, we are in the state of data collection and data validation. No statistical analysis has yet been performed. The update search still has to be performed to be able to identify most recent articles and to contact the corresponding authors. At the time of study protocol submission, 54 single data sets from 40 authors and including more than 5,500 IPD comparing CT and CCA have been acquired.

Authors’ information

GMS is a physician working as a junior research assistant in MD's working group. His research interests and publications include the conduction of systematic reviews and meta-analyses as well as quality aspects concerning reporting and methodology of diagnostic accuracy studies in radiology.

PS is a physician and a statistician and professor of medical statistics. His research interests are modeling of heterogeneity in medical research including meta-analytic methods. PS is author of the book Medical Applications of Finite Mixture Models.

SA (MD) is the chairman of the Department of Cardiology. His main are of research is cardiac imaging, with a special focus on CT and noninvasive assessment of coronary atherosclerosis. He has authored approximately 150 original research papers and is associate editor of JACC Cardiovascular Imaging and the Journal of Cardiovascular CT. He has served as the chairman of the Society of Cardiovascular CT, and is currently a board member of the Society of Cardiovascular CT as well as the European Society of Cardiology.

MB (MD) is a cardiologist who has over 20 years’ experience with early detection of coronary artery disease using both coronary artery calcium testing and CT angiography. He has published four books on the topic of cardiac CT and published over 450 MEDLINE-indexed articles on cardiovascular CT. He is past president of both the Society of Atherosclerosis Imaging and Prevention and Society of Cardiovascular Computed Tomography. He is currently a professor of medicine at the David Geffen School of Medicine at UCLA, and program director of Cardiology at Harbor-UCLA Medical Center.

MJG (MD) is chief of Division of Cardiology at the Montefiore Medical Center and professor of medicine at the Albert Einstein College of Medicine. He is member and past founding board member of the Society of Cardiovascular CT and member of the American Board of Cardiovascular Disease. His research interests include screening for CAD, management of chest pain in the emergency department, and imaging in heart failure.

RR holds a Master in Education and is currently enrolled in the Master of Science in Statistics Program. He works as an assistant researcher in the working group of MD and his research interests include biometrics as well as survey statistics.

GP graduated in medicine followed by postgraduate degree in cardiology and radiology at University of Milan. From 1993 to 1994 he worked as visiting researcher at the Institute of Human Physiology focusing his basic research in the field of cardiovascular diseases. From 1995 to 2000 he began scientific and clinical training in noninvasive cardiology. During this time, he has devoted much of his activity in clinical research in the field of dilated cardiomyopathy and in 2000 he published his first scientific book. In 2001 he began training in cardiovascular imaging and in 2004 he participated in the founding of one of the first cardiac radiology services in Italy. He is currently director of Magnetic Resonance Imaging (MRI) and deputy director of the CT Unit. He has authored more than 65 MEDLINE-indexed articles in international journals, four scientific books and more than 150 scientific abstracts at national and international meetings in the field of dilated cardiomyopathy and of cardiovascular imaging. He is also reviewer of European Radiology, International Journal of Cardiology, Journal of Cardiovascular Medicine, Expert Review of Cardiovascular Therapy, Case Reports in Cardiology, Case Reports in Medicine, International Journal of Cardiovascular Imaging and European Heart Journal - Cardiovascular Imaging.

WBM (MD, PhD) is a resident cardiologist and researcher. His research interests and publications include diagnostic performance of CT coronary angiography.

DA is a physician with degree in cardiology and radiology and director of the Cardiovascular CT Unit. His research interests and publications mainly lie in the different applications of CT coronary angiography, such as patients with coronary stents or by-pass grafts, with dilated cardiomyopathy of unknown etiology, with coronary anomalies and with diabetes.

HA (MD, MPH, EBCR) is an associate professor and senior radiologist. He is a board certified radiologist and board certified neuroradiologist. His main research interests are body CT, emergency radiology and abdominal imaging.

LH (MD) is a cardiac CT research fellow. Her research interests include non-calcified plaque, plaque volume analysis and the effect of hormone replacement therapy in perimenopausal women.

NB is a cardiologist consultant, responsible for the Cardiovascular CT and Cardiac MR Program, working in collaboration with the Cardiovascular Research and Development Unit of the Faculty of Medicine of Porto. His research interests and publications are related to noninvasive detection of CAD and risk stratification.

JH (MD) is a board certified doctor for internal medicine and cardiology. He is currently vice director of the Medizinische Klinik I. He is a professor of medicine at the Ludwig-Maximilians-Universität München. As an interventional cardiologist, his clinical main focus includes the percutaneous treatment of coronary and valvular diseases. In addition, he has gained an international reputation as a noninvasive cardiologist focusing on noninvasive coronary imaging by CT imaging. He is an active member in several societies for cardiology and cardiovascular CT imaging (

SL is a senior staff radiologist working as the section head of CT and Emergency Radiology. His research interests are cardiovascular imaging, abdominal radiology, emergency radiology and forensic imaging. SL is editor of two books and author of more than 130 original and review articles and more than 20 book chapters.

BLG (MD, PhD) is a cardiologist and researcher working in the field of noninvasive cardiac imaging. BLG has published over 70 MEDLINE-indexed articles including works on cardiovascular imaging, cardiac MRI, CT and nuclear imaging. He is the treasurer of the working group for cardiovascular MRI of the European Heart Association.

MFLM works as a resident. His clinical and research activities focus on cardiac CT and MRI, left ventricular hypertrophy and genetics.

AAS (MD) is a radiologist and associate professor of radiology. He is currently chairman of the Radiology and Cardiac CT Departments and his publications and particular interests are mainly related to cardiothoracic and body imaging. He has 14 MEDLINE-indexed and 18 ISI Web of Knowledge-indexed published papers, mostly in the field of cardiothoracic and vascular imaging. He is head of the Cardiac Imaging Committee in the Iranian Society of Radiology and elected head of the Society of Cardiovascular CT in Iran and a member of the Iranian Board of Radiology. He is the head of the Cardiac Imaging Section in Advanced Diagnostic and Interventional Radiology center and is an editorial board member as well as associate editor of the Iranian Journal of Radiology (

AS is an interventional cardiologist and researcher in the field of cardiovascular imaging and an associate professor. His research interests are in the field of cardiac remodeling after acute myocardial infarction and coronary plaque morphology on cardiovascular imaging.

EZ (MD) is a radiologist in MD's working group and her research interests include all aspects of cardiovascular imaging.

UJS is a professor of radiology, cardiology and pediatrics and the director of Cardiovascular Imaging. His main scientific interest is cardiovascular imaging, especially the use of advanced CT and MRI techniques for diagnosing heart disease. UJS serves on the editorial boards of several scientific journals including Radiology, the Journal of the American Heart Association, the American Journal of Roentgenology, Academic Radiology and European Radiology and is Associate Editor of the Journal of Thoracic Imaging. He has authored >230 articles in peer-reviewed scientific journals, 20 book chapters, and three books. UJS is a member of numerous scientific societies and serves as chairman of several committees of the American College of Radiology, the Radiological Society of North America, American Heart Association, North American Society of Cardiovascular Imaging, Society of Computed Body Tomography and MR, and the Society of Thoracic Radiology. He is an honorary member of the Société Canadienne-Française de Radiologie as well as of the Hungarian Radiological Society and was elected Fellow of the American Heart Association, of the Society of Computed Body Tomography and MR, and of the Society for Cardiovascular CT.

AD is a consultant and associated professor. His main interest is in the area of atherosclerosis with focus on prevention of ischemic heart disease. Since 2006, he has been working with cardiac CT, and is now the chairman of the Danish working group Cardiac Imaging. AD is the principal investigator of the multi-center study, DanRisk, which aims to examine the prevalence of coronary calcification in middle-aged people and to compare the CAC score with the HeartScore.

DAH is a clinical cardiologist and director of Interventional Cardiology. His clinical and research interests include predictive value of plaque level analysis of coronary CT angiograms, the clinical role of cardiac CT angiography, interventional and therapeutic studies in acute coronary syndromes and transcatheter aortic valve implantation.

VMR (MD, PhD) is a cardiology physician, assistant professor and researcher. He is chief of the CT Department and full member of the Cuban Society of Cardiology. His research interests and publications are related to noninvasive and invasive methods of cardiovascular diseases diagnostic. He has more than 40 national and international publications on these subjects (

AH is a senior cardiologist and researcher with experience in the field of cardiac CT and MRI. Between 2006 and 2009, he held a fellowship in the field of cardiac CT and MRI at the German Heart Institute Berlin.

BLN is a cardiologist and researcher with longstanding experience in the field of cardiac diagnostic imaging. He is currently working as an associate professor and senior consultant. He has published more than 50 MEDLINE-indexed articles including works on cardiovascular CT imaging.

HB is a radiologist. His research interests include multiple aspects of cardiac CT, most notably noninvasive coronary angiography, assessment of myocardial viability and plaque analysis.

KAØ is a fellow in Cardiology at Vejle Hospital and Odense University Hospital, departments of Cardiology, Vejle and Odense, Denmark. His research and PhD have focused on the use of coronary CT angiography in patients with suspected CAD.

SMMJ (MD, MRCP, BSc(Hons)) gained her degrees in Science and Medicine from the University of Glasgow in 2000 and 2002 respectively. She subsequently underwent clinical training in medicine and cardiology and, following research in the field of cardiac imaging, was awarded a postgraduate Doctor of Medicine degree in 2011, again conferred by the University of Glasgow. She has worked as a specialist registrar in clinical cardiology since 2008 and her subspecialty interests, research and publications are focused on cardiac imaging and heart failure.

BAH is a clinical staff cardiologist. His primary research interests are in cardiac imaging, cardiac CT and cardiac MRI.

JR is a physician working as a clinical and research fellow. His key activities both in clinical routine and science are cardiac CT as well as cardiac MRI. During the enrolment period of CoMe-CCT, JR was in charge of patient inclusion and patient data acquisition at Kerckhoff Heart and Thorax Center in Bad Nauheim, Germany.

MS is professor of radiology. His clinical and research interest is cross-sectional imaging.

CL is a cardiologist; he is American College of Cardiology Level 3 certified for cardiac CT and a Fellow of the Society of Cardiovascular Computed Tomography.

EM (MD, FESC) is associated professor of cardiology. He is chief of the catheterization laboratory (UOS of hemodynamics). His principal field of interest is interventional cardiology and imaging by CT. EM is author of 62 MEDLINE-indexed articles including works on coronary revascularization (CABRI and SOS trials), HCMO, radiation (PROTECTION trial), studies comparing CCA and CT. He is author of two chapters of the book Cardiac CT. He is chairman of the working group of cardiac CT and nuclear cardiology of the Italian Society of Cardiology.

AR is a radiologist and researcher in the field of diagnostic imaging and particularly in cardiac imaging. He is chief of the Simple Operative Unit in Cardiac Radiology. AR has published over 30 MEDLINE-indexed articles including works on cardiovascular imaging, interventional radiology, radiation and abdominal radiology. He is author of several book chapters concerning cardiac radiology.

AJHAS (MD, PhD) is a cardiologist. His clinical and research interests include noninvasive cardiac imaging, diabetes mellitus and aortic diseases.

RPM is a medical student, working as a research assistant under the supervision of Konstantin Nikolaou, MD and Fabian Bamberg, MD, MPH. His research interests include cardiovascular CT and cardiovascular MRI.

GRU is a radiologist with main occupation at the private Aleris Hospital in Oslo, working mainly with breast diagnostics. He is now a part-time PhD student at Akershus University Hospital, researching cardiac imaging.

KN is a cardiologist whose clinical and research interests include noninvasive cardiac imaging and acute cardiac care.

HM is consultant, professor and head of research. His main interest is in the area of ischemic heart disease. HM is the creator of Odense Chest Pain Bio-bank, which was established in 2010 to 2011 and includes 2,500 patients with a suspected acute myocardial infarction.

KN is a full professor of radiology, vice chair of the Department of Clinical Radiology, and section chief of MRI. His research interests include cardiovascular CT/dual energy CT, cardiovascular MRI, imaging of atherosclerosis, thoracic imaging and molecular imaging. KN has published more than 160 scientific papers, one book, and more than 20 book chapters. He also serves as a reviewer for numerous journals, including the American Journal of Radiology, Circulation, JACC Imaging, European Journal of Radiology, Investigative Radiology, International Journal of Cardiovascular Imaging, Journal of Computer Assisted Tomography, Journal of the American College of Cardiology, Magnetic Resonance in Medicine, and others.

JCF (MD) is a cardiologist and director of the research center of the Montreal Heart Institute. He also leads the Canadian Atherosclerosis Imaging Network and holds the Université de Montréal-endowed research chair in atherosclerosis and Canada Research Chair in translational and personalized medicine.

TRCJ is a radiologist working as associate professor and head of CT. Among his research interests are cardiovascular CT and MRI and spectral CT. He has published some 75 peer-reviewed articles and three radiological textbooks.

SM is an interventional cardiologist working in the CathLab of the Department of Cardiology. His research interests include interventional cardiology and cardiovascular imaging (

BJWC is associate professor and staff cardiologist. He is the co-director of Cardiac Radiology and the director of the Postgraduate Cardiac Imaging Program. His research focuses on developing and evaluating novel imaging techniques with the goal of understanding their clinical applications and benefit to patient care.

DM is chairman of the Department of Radiology. His main research interests are cardiovascular imaging and image guided interventions.

ML is a senior physician and deputy director of the cardiac catheterization laboratory at the Department of Cardiology

MD is a radiologist and researcher with vast experience in the field of diagnostic imaging and chief consultant . MD has published over 120 MEDLINE-indexed articles including works on cardiovascular imaging, claustrophobia, cost-effectiveness, meta-analyses, radiation and patient safety. He is an associate editor of Radiology and European Radiology and the editor of the books Coronary CT Angiography and Cardiac CT. He is also president of the 1898-founded Röntgen Society of Berlin and Brandenburg.

PS, SA, MB, MJG, ML and MD are members of the steering committee of CoMe-CCT.


  1. Roger VL, Go AS, Lloyd-Jones DM, Benjamin EJ, Berry JD, Borden WB, Bravata DM, Dai S, Ford ES, Fox CS, Fullerton HJ, Gillespie C, Hailpern SM, Heit JA, Howard VJ, Kissela BM, Kittner SJ, Lackland DT, Lichtman JH, Lisabeth LD, Makuc DM, Marcus GM, Marelli A, Matchar DB, Moy CS, Mozaffarian D, Mussolino ME, Nichol G, Paynter NP, Soliman EZ: Heart disease and stroke statistics–2012 update: a report from the American Heart Association. Circulation. 2012, 125: e2-e220.

    Article  PubMed  Google Scholar 

  2. Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM: Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008, 149: 889-897.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Meijboom WB, van Mieghem CA, Mollet NR, Pugliese F, Weustink AC, van Pelt N, Cademartiri F, Nieman K, Boersma E, de Jaegere P, Krestin GP, de Feyter PJ: 64-slice computed tomography coronary angiography in patients with high, intermediate, or low pretest probability of significant coronary artery disease. J Am Coll Cardiol. 2007, 50: 1469-1475. 10.1016/j.jacc.2007.07.007.

    Article  PubMed  Google Scholar 

  4. Husmann L, Schepis T, Scheffel H, Gaemperli O, Leschka S, Valenta I, Koepfli P, Desbiolles L, Stolzmann P, Marincek B, Alkadhi H, Kaufmann PA: Comparison of diagnostic accuracy of 64-slice computed tomography coronary angiography in patients with low, intermediate, and high cardiovascular risk. Acad Radiol. 2008, 15: 452-461. 10.1016/j.acra.2007.12.008.

    Article  PubMed  Google Scholar 

  5. Leber AW, Johnson T, Becker A, von Ziegler F, Tittus J, Nikolaou K, Reiser M, Steinbeck G, Becker CR, Knez A: Diagnostic accuracy of dual-source multi-slice CT-coronary angiography in patients with an intermediate pretest likelihood for coronary artery disease. Eur Heart J. 2007, 28: 2354-2360. 10.1093/eurheartj/ehm294.

    Article  PubMed  Google Scholar 

  6. Dewey M, Teige F, Schnapauff D, Laule M, Borges AC, Wernecke KD, Schink T, Baumann G, Rutsch W, Rogalla P, Taupitz M, Hamm B: Noninvasive detection of coronary artery stenoses with multislice computed tomography or magnetic resonance imaging. Ann Intern Med. 2006, 145: 407-415.

    Article  PubMed  Google Scholar 

  7. Diamond GA, Forrester JS: Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med. 1979, 300: 1350-1358. 10.1056/NEJM197906143002402.

    Article  CAS  PubMed  Google Scholar 

  8. Morise AP, Haddad WJ, Beckner D: Development and validation of a clinical score to estimate the probability of coronary artery disease in men and women presenting with suspected coronary disease. Am J Med. 1997, 102: 350-356. 10.1016/S0002-9343(97)00086-7.

    Article  CAS  PubMed  Google Scholar 

  9. Pryor DB, Shaw L, McCants CB, Lee KL, Mark DB, Harrell FE, Muhlbaier LH, Califf RM: Value of the history and physical in identifying patients at increased risk for coronary artery disease. Ann Intern Med. 1993, 118: 81-90.

    Article  CAS  PubMed  Google Scholar 

  10. Genders TS, Steyerberg EW, Alkadhi H, Leschka S, Desbiolles L, Nieman K, Galema TW, Meijboom WB, Mollet NR, de Feyter PJ, Cademartiri F, Maffei E, Dewey M, Zimmermann E, Laule M, Pugliese F, Barbagallo R, Sinitsyn V, Bogaert J, Goetschalckx K, Schoepf UJ, Rowe GW, Schuijf JD, Bax JJ, de Graaf FR, Knuuti J, Kajander S, van Mieghem CA, Meijs MF, Cramer MJ: A clinical prediction rule for the diagnosis of coronary artery disease: validation, updating, and extension. Eur Heart J. 2011, 32: 1316-1330. 10.1093/eurheartj/ehr014.

    Article  PubMed  Google Scholar 

  11. Genders TS, Steyerberg EW, Hunink MG, Nieman K, Galema TW, Mollet NR, de Feyter PJ, Krestin GP, Alkadhi H, Leschka S, Desbiolles L, Meijs MF, Cramer MJ, Knuuti J, Kajander S, Bogaert J, Goetschalckx K, Cademartiri F, Maffei E, Martini C, Seitun S, Aldrovandi A, Wildermuth S, Stinn B, Fornaro J, Feuchtner G, De Zordo T, Auer T, Plank F, Friedrich G: Prediction model to estimate presence of coronary artery disease: retrospective pooled analysis of existing cohorts. BMJ. 2012, 344: e3485-10.1136/bmj.e3485.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Schlattmann P, Schuetz GM, Dewey M: Influence of coronary artery disease prevalence on predictive values of coronary CT angiography: a meta-regression analysis. Eur Radiol. 2011, 21: 1904-1913. 10.1007/s00330-011-2142-2.

    Article  PubMed  Google Scholar 

  13. Schuetz GM, Zacharopoulou NM, Schlattmann P, Dewey M: Meta-analysis: noninvasive coronary angiography using computed tomography versus magnetic resonance imaging. Ann Intern Med. 2010, 152: 167-177.

    Article  PubMed  Google Scholar 

  14. Riley RD, Lambert PC, Abo-Zaid G: Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ. 2010, 340: c221-10.1136/bmj.c221.

    Article  PubMed  Google Scholar 

  15. Taylor AJ, Cerqueira M, Hodgson JM, Mark D, Min J, O'Gara P, Rubin GD: ACCF/SCCT/ACR/AHA/ASE/ASNC/NASCI/SCAI/SCMR 2010 Appropriate Use Criteria for Cardiac Computed Tomography. A Report of the American College of Cardiology Foundation Appropriate Use Criteria Task Force, the Society of Cardiovascular Computed Tomography, the American College of Radiology, the American Heart Association, the American Society of Echocardiography, the American Society of Nuclear Cardiology, the North American Society for Cardiovascular Imaging, the Society for Cardiovascular Angiography and Interventions, and the Society for Cardiovascular Magnetic Resonance. Circulation. 2010, 122: e525-e555.

    Article  PubMed  Google Scholar 

  16. Leschka S, Wildermuth S, Boehm T, Desbiolles L, Husmann L, Plass A, Koepfli P, Schepis T, Marincek B, Kaufmann PA, Alkadhi H: Noninvasive coronary angiography with 64-section CT: effect of average heart rate and heart rate variability on image quality. Radiology. 2006, 241: 378-385. 10.1148/radiol.2412051384.

    Article  PubMed  Google Scholar 

  17. Nieman K, Rensing BJ, van Geuns RJ, Vos J, Pattynama PM, Krestin GP, Serruys PW, de Feyter PJ: Non-invasive coronary angiography with multislice spiral computed tomography: impact of heart rate. Heart. 2002, 88: 470-474. 10.1136/heart.88.5.470.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Raff GL, Gallagher MJ, O'Neill WW, Goldstein JA: Diagnostic accuracy of noninvasive coronary angiography using 64-slice spiral computed tomography. J Am Coll Cardiol. 2005, 46: 552-557. 10.1016/j.jacc.2005.05.056.

    Article  PubMed  Google Scholar 

  19. Chun EJ, Lee W, Choi YH, Koo BK, Choi SI, Jae HJ, Kim HC, So YH, Chung JW, Park JH: Effects of nitroglycerin on the diagnostic accuracy of electrocardiogram-gated coronary computed tomography angiography. J Comput Assist Tomogr. 2008, 32: 86-92. 10.1097/rct.0b013e318059befa.

    Article  PubMed  Google Scholar 

  20. Dewey M, Hoffmann H, Hamm B: Multislice CT coronary angiography: effect of sublingual nitroglycerine on the diameter of coronary arteries. Rofo. 2006, 178: 600-604. 10.1055/s-2006-926755.

    Article  CAS  PubMed  Google Scholar 

  21. Dewey M, Hoffmann H, Hamm B: CT coronary angiography using 16 and 64 simultaneous detector rows: intraindividual comparison. Fortschr Röntgenstr. 2007, 179: 581-586. 10.1055/s-2007-963112.

    Article  CAS  Google Scholar 

  22. Giesler T, Baum U, Ropers D, Ulzheimer S, Wenkel E, Mennicke M, Bautz W, Kalender WA, Daniel WG, Achenbach S: Noninvasive visualization of coronary arteries using contrast-enhanced multidetector CT: influence of heart rate on image quality and stenosis detection. AJR Am J Roentgenol. 2002, 179: 911-916.

    Article  PubMed  Google Scholar 

  23. Hausleiter J, Meyer T, Hadamitzky M, Zankl M, Gerein P, Dorrler K, Kastrati A, Martinoff S, Schomig A: Non-invasive coronary computed tomographic angiography for patients with suspected coronary artery disease: the Coronary Angiography by Computed Tomography with the Use of a Submillimeter resolution (CACTUS) trial. Eur Heart J. 2007, 28: 3034-3041. 10.1093/eurheartj/ehm150.

    Article  PubMed  Google Scholar 

  24. Herzog C, Arning-Erb M, Zangos S, Eichler K, Hammerstingl R, Dogan S, Ackermann H, Vogl TJ: Multi-detector row CT coronary angiography: influence of reconstruction technique and heart rate on image quality. Radiology. 2006, 238: 75-86.

    Article  PubMed  Google Scholar 

  25. Noto TJ, Johnson LW, Krone R, Weaver WF, Clark DA, Kramer JR, Vetrovec GW: Cardiac catheterization 1990: a report of the registry of the Society for Cardiac Angiography and Interventions (SCA&I). Cathet Cardiovasc Diagn. 1991, 24: 75-83. 10.1002/ccd.1810240202.

    Article  PubMed  Google Scholar 

  26. Scanlon PJ, Faxon DP, Audet AM, Carabello B, Dehmer GJ, Eagle KA, Legako RD, Leon DF, Murray JA, Nissen SE, Pepine CJ, Watson RM, Ritchie JL, Gibbons RJ, Cheitlin MD, Gardner TJ, Garson A, Russell RO, Ryan TJ, Smith SC: ACC/AHA guidelines for coronary angiography: executive summary and recommendations. A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Coronary Angiography) developed in collaboration with the Society for Cardiac Angiography and Interventions. Circulation. 1999, 99: 2345-2357. 10.1161/01.CIR.99.17.2345.

    Article  CAS  PubMed  Google Scholar 

  27. Dewey M, Hamm B: Cost effectiveness of coronary angiography and calcium scoring using CT and stress MRI for diagnosis of coronary artery disease. Eur Radiol. 2007, 17: 1301-1309. 10.1007/s00330-006-0439-3.

    Article  PubMed  Google Scholar 

  28. Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, Stewart L: The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Syst Rev. 2012, 1: 2-10.1186/2046-4053-1-2.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Stewart L, Moher D, Shekelle P: Why prospective registration of systematic reviews makes sense. Syst Rev. 2012, 1: 7-10.1186/2046-4053-1-7.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Schuetz GM, Schlattmann P, Dewey M: Use of 3x2 tables with an intention to diagnose approach to assess clinical performance of diagnostic tests: meta-analytical evaluation of coronary CT angiography studies. BMJ. 2012, 345: e6717-10.1136/bmj.e6717.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003, 3: 25-10.1186/1471-2288-3-25.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Chu H, Cole SR: Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006, 59: 1331-1332. 10.1016/j.jclinepi.2006.06.011.

    Article  PubMed  Google Scholar 

  33. Van Houwelingen HC, Zwinderman KH, Stijnen T: A bivariate approach to meta-analysis. Stat Med. 1993, 12: 2273-2284. 10.1002/sim.4780122405.

    Article  CAS  PubMed  Google Scholar 

  34. van Houwelingen HC, Arends LR, Stijnen T: Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002, 21: 589-624. 10.1002/sim.1040.

    Article  PubMed  Google Scholar 

  35. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.

    Article  PubMed  Google Scholar 

  36. Riley RD, Abrams KR, Sutton AJ, Lambert PC, Thompson JR: Bivariate random-effects meta-analysis and the estimation of between-study correlation. BMC Med Res Methodol. 2007, 7: 3-10.1186/1471-2288-7-3.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Skrondal A, Rabe-Hesketh S: Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models. 2004, Boca Raton, FL: Chapman & Hall/CRC

    Book  Google Scholar 

  38. Skrondal A, Rabe-Hesketh S: Prediction in multilevel generalized linear models. J R Stat Soc Ser A Sta. 2009, 172: 659-687. 10.1111/j.1467-985X.2009.00587.x.

    Article  Google Scholar 

  39. Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011.

    Article  Google Scholar 

  40. Iglehart JK: Health insurers and medical-imaging policy–a work in progress. N Engl J Med. 2009, 360: 1030-1037. 10.1056/NEJMhpr0808703.

    Article  CAS  PubMed  Google Scholar 

Download references


This collaborative meta-analysis based on individual patient data is funded by a grant of the German Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung – BMBF) (FKZ: 01KG1110) for meta-analyses as part of the joint program ‘clinical trials’ of the BMBF and the DFG.

We thank all collaborating authors who have already provided patient data for this IPD meta-analysis project at the time of writing.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Marc Dewey.

Additional information

Competing interests

PS and MD are supported by a grant of the German Federal Ministry of Education and Research (BMBF) for meta-analyses as part of the joint program "clinical trials" of the BMBF and the German Research Foundation (DFG). PS is also supported by another grant of the DFG (Schl 3–1) and has received lecture fees from Bayer-Schering. MD has received grant support from Heisenberg Program of the DFG for a professorship (DE 1361/14-1), European Regional Development Fund (20072013 2/05, 20072013 2/48), German Heart Foundation/German Foundation of Heart Research (F/23/08, F/27/10), Joint program from the DFG and the BMBF for meta-analyses (01KG1013, 01KG1110), GE Healthcare, Bracco, Guerbet, and Toshiba Medical Systems and lecture fees from Toshiba Medical Systems, Guerbet, Cardiac MR Academy Berlin, and Bayer (Schering-Berlex). MD is a consultant to Guerbet and one of the principal investigators of multi-center studies (CORE-64 and 320) on coronary CT angiography sponsored by Toshiba Medical Systems. He is also the editor of Coronary CT Angiography and Cardiac CT, both published by Springer, and offers hands-on workshops on cardiovascular imaging ( Institutional master research agreements exist between Charité and Siemens Medical Solutions, Philips Medical Systems, and Toshiba Medical Systems. GMS is a physician working as a research assistant in MD's working group. His salary is financed by a grant from the BMBF for meta-analyses granted to MD. RR is a research assistant in MD's working group; his salary is also paid by a grant from the BMBF for meta-analyses granted to MD. SA is Speaker Honoraria and receives grant support from Siemens AG; he is a consultant for Servier and Guerbet. MB receives grant support from GE. GP has received a grant from GE Healthcare as speaker's bureau. JH received research grants from Siemens Medical Solutions. UJS is a consultant for and receives research support from Bayer, Bracco, GE, Medrad, and Siemens. AD and HM have received grants from Region Syddanmark (grant number 08–17862 and 09–13526). DAH reports institutional research and development agreements with Philips Medical Systems. KAØ has received grant support from Vejle Hospital Research Foundation and a PhD scholarship from the Faculty of Health Sciences at Aarhus University. GRU has received lecture fees from Siemens Medical Solutions and Philips Medical Systems, but has no other conflicts of interest. KN is supported by an Erasmus MC Fellowship, receives unrestricted research support from Siemens Medical Solution and Bayer Scheering, and lecture fees from Siemens Medical Solutions, Bayer Scheering and Abbott Vascular. KN receives royalties for lectures including service on speakers' bureaus from Bayer Healthcare and Siemens Healthcare. TRCJ is supported by research grants and receives lecture fees from Siemens Healthcare and Bayer Healthcare. BJWC receives research support from GE Healthcare and educational support from TeraRecon. MJG, WBM, DA, HA, LH, SL, BLG, AAS, AS, EZ, VMR, AH, BLN, HB, SMMJ, BAH, JR, MS, CL, EM, AR, AJHAS, RPM, JCT, SM, DM and ML have no competing interests to declare. NB certifies that there is no conflict of interest with any financial organization regarding the material discussed in the manuscript. MFLM declares that there are no conflicts of interest for himself (or for any other Utrecht authors (Prokop, Cramer, Doevendans and De Vos) in the study described in Meijboom, Meijs, JACC 2008).

Authors’ contributions

MD conceived the idea; MD, GMS, RR and PS drafted the initial protocol. All authors reviewed, commented on, read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Schuetz, G.M., Schlattmann, P., Achenbach, S. et al. Individual patient data meta-analysis for the clinical assessment of coronary computed tomography angiography: protocol of the Collaborative Meta-Analysis of Cardiac CT (CoMe-CCT). Syst Rev 2, 13 (2013).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: