Skip to main content

The ability of late pregnancy maternal tests to predict adverse pregnancy outcomes associated with placental dysfunction (specifically fetal growth restriction and pre-eclampsia): a protocol for a systematic review and meta-analysis of prognostic accuracy studies



Pre-eclampsia and being born small for gestational age are associated with significant maternal and neonatal morbidity and mortality. Placental dysfunction is a key pathological process underpinning these conditions; thus, markers of placental function have the potential to identify pregnancies ending in pre-eclampsia, fetal growth restriction, and the birth of a small for gestational age infant.

Primary objective

To assess the predictive ability of late pregnancy (after 24 weeks’ gestation) tests in isolation or in combination for adverse pregnancy outcomes associated with placental dysfunction, including pre-eclampsia, fetal growth restriction, delivery of a SGA infant (more specifically neonatal growth restriction), and stillbirth.


Studies assessing the ability of biochemical tests of placental function and/or ultrasound parameters in pregnant women beyond 24 weeks’ gestation to predict outcomes including pre-eclampsia, stillbirth, delivery of a SGA infant (including neonatal growth restriction), and/or fetal growth restriction will be identified by searching the following databases: EMBASE, MEDLINE, Cochrane CENTRAL, Web of Science, CINAHL, ISRCTN registry, UK Clinical Trials Gateway, and WHO International Clinical Trials Portal. Any study design in which the biomarker and ultrasound scan potential predictors have been assessed after 24 weeks’ gestation but before diagnosis of outcomes (pre-eclampsia, fetal growth restriction, SGA (including neonatal growth restriction), and stillbirth) will be eligible (this would include randomized control trials and nested prospective case-control and cohort studies), and there will be no restriction on the background risk of the population. All eligible studies will be assessed for risk of bias using the modified QUADAS-2 tool. Meta-analyses will be undertaken using the ROC models to estimate and compare test discrimination and reclassification indices to test calibration. Validation will be explored by comparing consistency across studies.


This review will assess whether current published data reporting either a single or combination of tests in late pregnancy can accurately predict adverse pregnancy outcome(s) associated with placental dysfunction. Accurate prediction could allow targeted management and possible intervention for high-risk pregnancies, ultimately avoiding adverse outcomes associated with placental disease.

Systematic review registration

PROSPERO CRD42018107049

Peer Review reports


Pre-eclampsia and being born small for gestational age (SGA) are associated with significant maternal, fetal, and neonatal morbidity and mortality [1,2,3]. Despite the burden of disease associated with these conditions, in the UK, there has been little decline in their prevalence over the past two decades and pre-eclampsia remains a leading cause of maternal death worldwide [4]. Placental dysfunction plays a key role in the shared pathophysiology of these conditions [5,6,7,8]. Tests of placental function have been proposed as potential prognostic and diagnostic tools [9].

Delivery of a SGA infant is commonly defined as a birth weight under a specified threshold and includes both constitutionally small and growth-restricted infants, whereas growth restriction is more specifically defined as the failure of a fetus or infant to reach their full growth potential and can be diagnosed antenatally (fetal) or at birth (neonatal). The relationship between delivery of a SGA infant and adverse pregnancy outcome is likely secondary to the contribution of fetal (FGR) and/or neonatal growth restriction (NGR) within this group. Identifying growth restriction is complex, and study definitions vary for this outcome and are frequently misclassified. Delivery of a SGA infant is often seen as a surrogate for FGR and NGR and sometimes incorrectly used interchangeably with these definitions.

Most studies assessing maternal serum biomarkers of placental origin (e.g., pregnancy-associated plasma protein A (PAPP-A), alpha-fetoprotein (AFP)) to predict adverse pregnancy outcomes have tested in the first and/or second trimesters and have insufficient test accuracy for clinical use [10,11,12]. While combining biochemical with biophysical markers in the first and/or second trimesters appears to improve predictive ability, current evidence is insufficient for them to be recommended for use in clinical practice [8, 13,14,15].

Sampling later in pregnancy could provide greater predictive accuracy, as this is closer to disease onset (compared to first or second trimester sampling). This is supported by studies evaluating biomarkers associated with placental function in the third trimester [16,17,18,19]. There is most evidence to support the use of late pregnancy maternal tests for the prediction of pre-eclampsia, e.g., tests based upon placental growth factor (PlGF), but other studies also report benefits in high-risk and unselected populations for the prediction of delivering a SGA infant [18, 20]. Screening in late pregnancy using maternal tests to predict stillbirth is limited to a few small studies, and results are conflicting [20,21,22].

In an attempt to improve clinical outcomes, by targeted intervention for those at greatest risk, the most accurate late pregnancy prediction model for adverse pregnancy outcomes associated with placental dysfunction must be identified. Systematic reviews and meta-analyses assessing the predictive ability of late pregnancy tests (specifically maternal serum biomarkers) for conditions associated with placental dysfunction have not to date identified any accurate prediction tool whose use is beneficial in clinical practice [10, 23, 24]. However, several large studies reporting promising results for biomarkers in prediction of adverse pregnancy outcomes, particularly pre-eclampsia, have been published since the most recent of those previous systematic reviews [16, 17, 19, 20]. The aim of this review is to reevaluate the ability of late pregnancy tests to predict adverse pregnancy outcomes associated with placental dysfunction incorporating recent evidence.

A Cochrane diagnostic test accuracy review of biochemical tests of placental function versus ultrasound assessment of fetal size for stillbirth and SGA infants has already been undertaken (AH, lead author). Therefore, this review will primarily focus on prediction of pre-eclampsia and fetal and neonatal growth restriction (FGR and NGR) but will also include a search for any new studies, published subsequent to the period covered by the Cochrane review, predicting stillbirth and delivery of a SGA infant, so that a comprehensive up to date review of all evidence can be provided.


The primary objective is to explore the predictive ability of late pregnancy (after 24 weeks’ gestation) maternal biochemical tests of placental function (including human placental lactogen (hPL), soluble fms-like tyrosine kinase-1 (sFlt-1), placental growth factor (PlGF), sFlt-1: PlGF ratio), and ultrasound parameters (including estimated fetal weight (EFW), umbilical and uterine artery Doppler pulsatility index, and amniotic fluid index) in isolation or in combination for adverse pregnancy outcomes associated with placental dysfunction, including pre-eclampsia, FGR, delivery of a SGA infant (more specifically NGR), and stillbirth.


This protocol has been prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO; CRD42018107049) and will follow the preferred reporting items for systematic review and meta-analysis protocol (PRISMA-P) guidelines (Additional file 1). This includes details of inclusion and exclusion criteria, a data extraction tool, and analytical methods.

Inclusion criteria

To be included, they must explore the use of biochemical tests of placental function and/or ultrasound parameters in pregnant women as accurate predictors of key outcomes. Specifically, studies must:

  • Assess biochemical placental function tests and/or ultrasound parameters after 24 completed weeks’ gestation but before the occurrence of outcomes. The threshold of 24 weeks’ gestation for the assessment of the late pregnancy predictor (the focus of this review) has been selected to facilitate comparison with data soon to be reported in a Cochrane review, predicting stillbirth, and delivery of a SGA infant.

  • Evaluate their ability to predict one or more of these outcomes: pre-eclampsia, stillbirth, FGR, delivery of a SGA infant (including NGR), diagnosed after the biomarker, or ultrasound scan measurements have been assessed.

Studies assessing the predictive accuracy of late pregnancy maternal tests have used varying definitions for SGA, FGR, and NGR. To avoid excluding any potential studies in this systematic review, studies using any definition of SGA, FGR, or NGR will be assessed. For analysis, some studies will be reclassified according to the outcome measures outlined in this protocol. If any study definitions differ from those we use in this protocol (see section on outcome measures), that study data will be analyzed separately to the main outcome measures.

Any study that fulfills these criteria will be included (this could for example, include randomized controlled trials, prospective cohort, or nested prospective case-control studies). There will be no restriction on the background risk of the population (i.e., unselected or high-risk antenatal populations), and studies of women of any age will be included. Placental function biomarkers in urine or blood can be measured using any assay technique and threshold for a positive result. Studies evaluating the predictive ability of any ultrasound measurement measured beyond 24 weeks’ gestation will be included; these could include uterine and/or umbilical artery Doppler pulsatility index, estimated fetal weight, and amniotic fluid index.

Exclusion criteria

Studies including multifetal pregnancies and pregnancies complicated by major lethal fetal abnormality identified during pregnancy will be excluded, as these are independent risk factors for the pre-specified outcomes and it is reasonable to assume that concentrations of biomarkers would be different due to increased placental mass in multifetal pregnancies and altered trophoblast function in aneuploidy. Retrospective case-control and cross-sectional studies will be excluded.

Outcome measures

The primary outcome measures are pre-eclampsia, fetal growth restriction (FGR), delivery of a small for gestational age (SGA) infant (including neonatal growth restriction (NGR)), and stillbirth, defined as:

  1. I.

    Pre-eclampsia: New hypertension (> 140/90 mmHg) presenting after 20 weeks’ gestation and significant proteinuria (urinary protein:creatinine ratio > 30 mg/mmol or a validated 24-h urine collection > 300 mg protein or urine dipstick reading > 1+) or maternal organ dysfunction:

    1. a.

      Renal insufficiency (creatinine > 90 μmol/L)

    2. b.

      Liver involvement (elevated transaminases to twice normal concentration for pregnancy and/or severe right upper quadrant or epigastric pain)

    3. c.

      Neurological complications (examples include eclampsia, altered mental status, blindness, stroke, or more commonly hyperreflexia when accompanied by clonus, severe headaches when accompanied by hyperreflexia, persistent visual scotomata)

    4. d.

      Hematological complications (thrombocytopenia platelets < 100,000/μL, DIC, hemolysis) [25] [note that we will only include pre-eclampsia diagnosed after measurement of the predictor—so beyond 24 weeks’ gestation]

    Any studies using other definitions of pre-eclampsia will be considered but analyzed and reported separately.

  2. II.

    FGR: Abdominal circumference (AC) or estimated fetal weight (EFW) < 3rd gestation specific centile or AC/EFW < 10th gestation specific centile combined with uterine artery Doppler pulsatility index (UtAPI) > 95th centile and/or umbilical artery Doppler pulsatility index (UAPI) > 95th centile [26]

  3. III.

    SGA: A birth weight classified as small for gestational age (SGA) within the study. Study definitions will be documented if this differs to birth weight ≤ 10th gestation specific centile, using population or customized birth weight centiles

  4. IV.

    NGR: A birth weight ≤ 3rd gestation specific centile, on population or customized growth charts or at least 3 out of 5 of the following:

  1. a.

    Birth weight < 10th centile

  2. b.

    Head circumference < 10th centile

  3. c.

    Length < 10th centile

  4. d.

    Prenatal diagnosis of FGR

  5. e.

    Maternal pregnancy information (e.g., hypertension or pre-eclampsia) [27]

  1. V.

    Stillbirth: An infant born with no signs of life (that was not a planned termination of pregnancy)

Prior to analysis, studies reporting different labels for the same definitions as our outcome measures (such as severe SGA for neonatal growth restriction and intrauterine growth restriction for fetal growth restriction) will be reclassified according to the definitions specified above.

Any studies that include outcomes assessed before 24 weeks’ gestation will be initially included (i.e., at the full paper screen stage), and we will attempt to use information in the paper and/or from contact with authors to obtain estimates restricted to outcomes after 24 weeks’ gestation.

Search strategy

A detailed search strategy with no language or date restrictions will search the following sources: EMBASE, MEDLINE, Cochrane CENTRAL, Web of Science, CINAHL, ISRCTN registry, UK Clinical Trials Gateway, WHO International Clinical Trials Portal, and specialist abstract and conference proceeding resources (Web of Science Conference Proceedings Citation Index and British Library’s ZETOC). A draft for the search strategy to be used is detailed in Additional file 2.

In addition, information on ongoing studies, unpublished research and research reported in the grey literature will be sought. We will report our search terms as an appendix to published studies.

Study reviews and appraisals

MG and JZ will independently review the titles and abstracts of all studies identified by the search strategy to identify potentially relevant studies. Full text versions of all potentially relevant studies will be sought and independently assessed for inclusion by MG and JZ following the pre-specified inclusion criteria stated in the methods. If there is disagreement, the opinion of a third review author (DAL) will be sought. Reasons for study exclusion will be documented.

Data extraction

Data will be extracted independently by MG and JZ and collected using a customized data collection form. Recorded data will include participant characteristics, presence of one or more of our pre-specified outcome measures (including definitions used), type of biomarker assay or test combinations (including thresholds for a positive test), and processing and storage of samples before use. Data related to pregnancy outcome but additional to our pre-specified outcome measures will also be collected, including mode of delivery, maternal complications, and admission to neonatal intensive care unit.

Sensitivity and specificity of a prognostic test will be extracted when available; otherwise, true-positive (TP), false-positive (FP), true-negative (TN), and false-negative (FN) counts will be collected. For studies reporting data using multiple thresholds for a test, a 2 × 2 table of the above counts will be extracted at each threshold. If samples are reported at multiple time points within a study, then each will be considered individually. If these data are not available, we will extract odds ratios and/or area under (AUC) receiver operating characteristic (ROC) curves. If study data, critical to our proposed analysis, is unclear or absent, the relevant authors will be contacted for clarification.

The risk of bias in each study will be evaluated using the modified QUADAS-2 tool [28]. Two review authors (MG and JZ) will independently assess each study and assign either “yes,” “no,” or “unclear” to each of the criteria stated in the modified QUADAS-2 tool. This information will be summarized graphically in the final review document. Studies will not be excluded from the main meta-analysis on the basis of risk of bias.

Statistical analysis

For those studies where a 2 × 2 table can be extracted, test specific sensitivity will be calculated as TP/(TP + FN) and specificity will be calculated as TN/(TN + FP). Sensitivity will be plotted against specificity to construct separate receiver operating characteristic (ROC) curves for each primary outcome to determine test discrimination and assess for heterogeneity. A hierarchical summary ROC (HSROC) model will be used to pool the results to estimate summary sensitivity and specificity with associated confidence intervals and a ROC curve [29,30,31]. The HSROC model takes account of both the within- and between-study variability by inclusion of a study specific random effect that allows for heterogeneity between studies. If a study reports multiple test thresholds, the data related to the most frequently reported threshold across all studies will be included in the meta-analysis. We will explore the use of more advanced methodology, which allows pooling of multiple points per study [32, 33]. We will calculate net reclassification in each study as a measure of calibration and pool these using appropriate methods for proportions [34]. When test specific sensitivity and specificity data or a 2 × 2 table data are not available, we will perform meta-analysis of odds ratios and/or AUC [35].

Exploration of heterogeneity

We will quantify the amount of heterogeneity using the between studies standard deviation in logit sensitivity and logit specificity. If sufficient data are available, we will explore potential sources of heterogeneity using subgroup analyses/meta-regression. Key study characteristics that we intend to explore include risk of bias, study design, and population characteristics.

Once we have completed the systematic review and initial summary of completed studies, we will update this protocol in relation to these subgroup analyses. All statistical analysis will be carried out in the statistical package Stata version 14 (College Station, TX, USA).


This review will provide essential data necessary to evaluate the ability of late pregnancy tests in isolation and combination to predict adverse pregnancy outcomes related to placental dysfunction. It will be the first comprehensive review of late pregnancy tests, including ultrasound parameters to predict adverse pregnancy outcomes, including pre-eclampsia and fetal growth restriction. This work will build on a Cochrane review assessing the diagnostic accuracy of biochemical tests of placental function versus ultrasound assessment of fetal size for stillbirth and SGA infants and will allow us to extend their findings to include data relating to pre-eclampsia and FGR prediction and assess additional data on delivery of the SGA infant and stillbirth, published subsequent to the timeframe of that review.

These conditions remain a significant global cause of maternal and neonatal morbidity and mortality. Identifying an accurate predictive tool using either a single or combination of tests in late pregnancy would allow targeted management and possible intervention for high-risk pregnancies, ultimately avoiding adverse outcomes associated with placental disease.

Availability of data and materials

The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.



Area under (ROC) curve


Estimated fetal weight


Fetal growth restriction






Hierarchical summary ROC


Neonatal growth restriction

ROC curve:

Receiver operating characteristic curve


Small for gestational age






Umbilical artery Doppler pulsatility index


Uterine artery Doppler pulsatility index


  1. Flenady V, Koopmans L, Middleton P, Froen JF, Smith GC, Gibbons K, Coory M, Gordon A, Ellwood D, McIntyre HD, et al. Major risk factors for stillbirth in high-income countries: a systematic review and meta-analysis. Lancet. 2011;377(9774):1331–40.

    Article  Google Scholar 

  2. Malin GL, Morris RK, Riley R, Teune MJ, Khan KS. When is birthweight at term abnormally low? A systematic review and meta-analysis of the association and predictive ability of current birthweight standards for neonatal outcomes. BJOG. 2014;121(5):515–26.

    Article  CAS  Google Scholar 

  3. Harding K, Redmond P, Tuffnell D: Caring for women with hypertensive disorders of pregnancy. MBRRACE-UK Saving Lives, Improving Mothers’ Care - Surveillance of maternal deaths in the UK 2012-14 and lessons learned to inform maternity care from the UK and Ireland Con dential Enquiries into Maternal Deaths and Morbidity 2009-14 2016(Oxford):69-75.

  4. Say L, Chou D, Gemmill A, Tuncalp O, Moller AB, Daniels J, Gulmezoglu AM, Temmerman M, Alkema L. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014;2(6):e323–33.

    Article  Google Scholar 

  5. Huppertz B. Placental origins of preeclampsia: challenging the current hypothesis. Hypertension. 2008;51(4):970–5.

    Article  CAS  Google Scholar 

  6. Ptacek I, Sebire NJ, Man JA, Brownbill P, Heazell AE. Systematic review of placental pathology reported in association with stillbirth. Placenta. 2014;35(8):552–62.

    Article  CAS  Google Scholar 

  7. Gibbins KJ, Silver RM, Pinar H, Reddy UM, Parker CB, Thorsten V, Willinger M, Dudley DJ, Bukowski R, Saade GR, et al. Stillbirth, hypertensive disorders of pregnancy, and placental pathology. Placenta. 2016;43:61–8.

    Article  Google Scholar 

  8. Mastrodima S, Akolekar R, Yerlikaya G, Tzelepis T, Nicolaides KH. Prediction of stillbirth from biochemical and biophysical markers at 11-13 weeks. Ultrasound Obstet Gynecol. 2016;48(5):613–7.

    Article  CAS  Google Scholar 

  9. Heazell AE, Worton SA, Higgins LE, Ingram E, Johnstone ED, Jones RL, Sibley CP. IFPA Gabor than award lecture: recognition of placental failure is key to saving babies’ lives. Placenta. 2015;36(Suppl 1):S20–8.

    Article  CAS  Google Scholar 

  10. Conde-Agudelo A, Papageorghiou AT, Kennedy SH, Villar J. Novel biomarkers for predicting intrauterine growth restriction: a systematic review and meta-analysis. BJOG. 2013;120(6):681–94.

    Article  CAS  Google Scholar 

  11. Conde-Agudelo A, Bird S, Kennedy SH, Villar J, Papageorghiou AT. First- and second-trimester tests to predict stillbirth in unselected pregnant women: a systematic review and meta-analysis. BJOG. 2015;122(1):41–55.

    Article  CAS  Google Scholar 

  12. Hui D, Okun N, Murphy K, Kingdom J, Uleryk E, Shah PS. Combinations of maternal serum markers to predict preeclampsia, small for gestational age, and stillbirth: a systematic review. JOGC. 2012;34(2):142–53.

    PubMed  Google Scholar 

  13. Kuc S, Wortelboer EJ, van Rijn BB, Franx A, Visser GHA, Schielen PCJI. Evaluation of 7 serum biomarkers and uterine artery Doppler ultrasound for first-trimester prediction of preeclampsia: a systematic review. Obstet Gynecol Surv. 2011;66(4):225–39.

    Article  Google Scholar 

  14. Di Lorenzo G, Ceccarello M, Cecotti V, Ronfani L, Monasta L, Brumatti LV, Montico M, D’Ottavio G. First trimester maternal serum PIGF, HCG, PAPP-A, PP-13, uterine artery Doppler and maternal history for the prediction of preeclampsia. Placenta. 2012;33(6):495–501.

    Article  Google Scholar 

  15. Karagiannis G, Akolekar R, Sarquis R, Wright D, Nicolaides KH. Prediction of small-for-gestation neonates from biophysical and biochemical markers at 11–13 weeks. Fetal Diagn Ther. 2011;29(2):148–54.

    Article  Google Scholar 

  16. Chappell LC, Duckworth S, Seed PT, Griffin M, Myers J, Mackillop L, Simpson N, Waugh J, Anumba D, Kenny LC, et al. Diagnostic accuracy of placental growth factor in women with suspected preeclampsia: a prospective multicenter study. Circulation. 2013;128(19):2121–31.

    Article  CAS  Google Scholar 

  17. Zeisler H, Llurba E, Chantraine F, Vatish M, Staff AC, Sennstrom M, Olovsson M, Brennecke SP, Stepan H, Allegranza D, et al. Predictive value of the sFlt-1:PlGF ratio in women with suspected preeclampsia. N Engl J Med. 2016;374(1):13–22.

    Article  CAS  Google Scholar 

  18. Griffin M, Seed PT, Duckworth S, North R, Myers J, Mackillop L, Simpson N, Waugh J, Anumba D, Kenny LC, et al. Predicting delivery of a small-for-gestational-age infant and adverse perinatal outcome in women with suspected pre-eclampsia. Ultrasound Obstet Gynecol. 2018;51(3):387–95.

    Article  CAS  Google Scholar 

  19. Sovio U, Gaccioli F, Cook E, Hund M, Charnock-Jones DS, Smith GC. Prediction of preeclampsia using the soluble fms-like tyrosine kinase 1 to placental growth factor ratio: a prospective cohort study of unselected nulliparous women. Hypertension. 2017;69(4):731–8.

    Article  CAS  Google Scholar 

  20. Valino N, Giunta G, Gallo DM, Akolekar R, Nicolaides KH. Biophysical and biochemical markers at 30-34 weeks’ gestation in the prediction of adverse perinatal outcome. Ultrasound Obstet Gynecol. 2016;47(2):194–202.

    Article  CAS  Google Scholar 

  21. Chaiworapongsa T, Romero R, Erez O, Tarca AL, Conde-Agudelo A, Chaemsaithong P, Kim CJ, Kim YM, Kim JS, Yoon BH, et al. The prediction of fetal death with a simple maternal blood test at 24-28 weeks: a role for angiogenic index-1 (PlGF/sVEGFR-1 ratio). Am J Obstet Gynecol. 2017;217:682.e1–13.

    Article  CAS  Google Scholar 

  22. Chaiworapongsa T, Romero R, Korzeniewski SJ, Kusanovic JP, Soto E, Lam J, Dong Z, Than NG, Yeo L, Hernandez-Andrade E, et al. Maternal plasma concentrations of angiogenic/antiangiogenic factors in the third trimester of pregnancy to identify the patient at risk for stillbirth at or near term and severe late preeclampsia. Am J Obstet Gynecol. 2013;208(4):287 e281–15.

    Article  Google Scholar 

  23. Heazell AE, Whitworth M, Duley L, Thornton JG. Use of biochemical tests of placental function for improving pregnancy outcome. Cochrane Database Syst Rev. 2015;11:CD011202.

    Google Scholar 

  24. Kleinrouweler CE, Wiegerinck MM, Ris-Stalpers C, Bossuyt PM, van der Post JA, von Dadelszen P, Mol BW, Pajkrt E, Collaboration EC. Accuracy of circulating placental growth factor, vascular endothelial growth factor, soluble fms-like tyrosine kinase 1 and soluble endoglin in the prediction of pre-eclampsia: a systematic review and meta-analysis. BJOG. 2012;119(7):778–87.

    Article  CAS  Google Scholar 

  25. Taskforce on Hypertension in Pregnancy: Hypertension in pregnancy practice guideline. WQ 244. American College of Obstetricians and Gynecologists 2013.

  26. Gordijn SJ, Beune IM, Thilaganathan B, Papageorghiou A, Baschat AA, Baker PN, Silver RM, Wynia K, Ganzevoort W. Consensus definition of fetal growth restriction: a Delphi procedure. Ultrasound Obstet Gynecol. 2016;48(3):333–9.

    Article  CAS  Google Scholar 

  27. Beune IM, Bloomfield FH, Ganzevoort W, Embleton ND, Rozance PJ, van Wassenaer-Leemhuis AG, Wynia K, Gordijn SJ. Consensus based definition of growth restriction in the newborn. J Pediatr. 2018;196:71–6 e71.

    Article  Google Scholar 

  28. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, Group Q. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36.

    Article  Google Scholar 

  29. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20(19):2865–84.

    Article  CAS  Google Scholar 

  30. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58(10):982–90.

    Article  Google Scholar 

  31. Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59(12):1331–2.

    Article  Google Scholar 

  32. Jones HE, Gatsonsis CA, Trikalinos TA, Welton NJ, Ades AE. Quantifying how diagnostic test accuracy depends on threshold in a meta-analysis. Stat Med. 2019;38(24):4789–803.

    Article  Google Scholar 

  33. Steinhauser S, Schumacher M, Rucker G. Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies. BMC Med Res Methodol. 2016;16(1):97.

    Article  Google Scholar 

  34. Anderson EL, Howe LD, Jones HE, Higgins JP, Lawlor DA, Fraser A. The prevalence of non-alcoholic fatty liver disease in children and adolescents: a systematic review and meta-analysis. PLoS One. 2015;10(10):e0140908.

    Article  Google Scholar 

  35. van Klaveren D, Steyerberg EW, Perel P, Vergouwe Y. Assessing discriminative ability of risk models in clustered data. BMC Med Res Methodol. 2014;14:5.

    Article  Google Scholar 

Download references


We acknowledge Ms. Helen Pullen, University Hospitals Bristol NHS Foundation Trust Librarian, for her assistance with the draft search strategy, and Dr. Hayley Jones, University of Bristol for her advice on testing heterogeneity in prediction tests.


This work is supported by the David Telling Charitable Trust (to MG and DAL, and which funds JZ’s contribution to this work), the National Institute for Health Research Biomedical Research Centre at the University Hospitals Bristol NHS Foundation Trust and the University of Bristol (DAL, JZ), and a National Institute for Health Research Senior Investigator award (NF-SI-0611-10196 to DAL). AH is funded by a NIHR Clinical Scientist Fellowship Award (NIHR CS-2013-13-009). DAL works in a Unit that receives support from the University of Bristol and UK Medical Research Council (MC_UU_00011/6). None of the funders has been involved in developing the protocol. The views and opinions expressed therein are those of the authors and do not necessarily reflect those of any funder, the UK National Health Service, or the Department of Health.

Author information

Authors and Affiliations



MG has prepared this manuscript with support and statistical advice from DAL. This manuscript has been reviewed and edited by AH, LCC, and JZ. MG, DAL, AH, LCC, and JZ agree to be accountable for all aspects of this work. MG is the corresponding author and has registered the protocol with the PROSPERO database. DAL, AH, LCC, and JZ approved the final submission.

Corresponding author

Correspondence to Melanie Griffin.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Competing interests

AH is the Chief Investigator of ReMIT2, a pilot randomized controlled trial of sFlt-1/PlGF ratio in the management of women presenting with reduced fetal movements. He has no competing financial interests to declare.

MG, LCC, and JZ have no competing interests to declare.

DAL has received research support from Medtronic Ltd and Roche Diagnostics for research unrelated to this protocol or the planned systematic review.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

PRISMA-P 2015 Checklist.

Additional file 2.

Draft search strategy to be used for the Medline online database.

Additional file 3.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Griffin, M., Heazell, A.E.P., Chappell, L.C. et al. The ability of late pregnancy maternal tests to predict adverse pregnancy outcomes associated with placental dysfunction (specifically fetal growth restriction and pre-eclampsia): a protocol for a systematic review and meta-analysis of prognostic accuracy studies. Syst Rev 9, 78 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: