Preoperative prognostic factors associated with postoperative delirium in older people undergoing surgery: protocol for a systematic review and individual patient data meta-analysis
Systematic Reviews volume 9, Article number: 261 (2020)
Early identification of patients at risk for postoperative delirium is essential because adequate well-timed interventions could reduce the occurrence of delirium and the related detrimental outcomes.
We will conduct a systematic review and individual patient data (IPD) meta-analysis of prognostic studies evaluating the predictive value of risk factors associated with an increased risk of postoperative delirium in elderly patients undergoing elective surgery. We will identify eligible studies through systematic search of MEDLINE, EMBASE, and CINAHL from their inception to May 2020. Eligible studies will enroll older adults (≥ 50 years) undergoing elective surgery and assess pre-operative prognostic risk factors for delirium and incidence of delirium measured by a trained individual using a validated delirium assessment tool. Pairs of reviewers will, independently and in duplicate, screen titles and abstracts of identified citations, review the full texts of potentially eligible studies. We will contact chief investigators of eligible studies requesting to share the IPD to a secured repository. We will use one-stage approach for IPD meta-analysis and will assess certainty of evidence using the GRADE approach.
Since we are using existing anonymized data, ethical approval is not required for this study. Our results can be used to guide clinical decisions about the most efficient way to prevent postoperative delirium in elderly patients.
Systematic review registration
Elderly patients undergoing surgery are more vulnerable to adverse postoperative outcomes due to advanced age, frailty, and concurrent medical conditions . Postoperative delirium (POD) , in particular, is recognized as the most common postoperative complication in the elderly , affecting up to 50% of hospitalized surgical patients, POD typically occurs in the early postoperative period and is defined as an acute neuropsychiatric disorder, characterized by fluctuating disturbances in attention, awareness, and cognition. POD is associated with increased morbidity and mortality [4, 5], postoperative cognitive decline and long-term dementia, poor functional recovery, prolonged hospitalization, and increased nursing home admission [6,7,8].
Besides treating precipitating factors such as infection or pain, there is no simple and effective way to treat POD once it has occurred. Therefore, prevention may be the key to minimizing its occurrence and associated complications. Previous research has shown that delirium may be partially prevented using multicomponent risk intervention strategies , which are most effective when targeted at high-risk individuals. A plethora of clinical studies have described individual risk factors for POD [6, 10, 11], and various systematic reviews and meta-analyses have identified several important prognostic factors [10, 12,13,14,15,16,17,18,19,20,21]. To date, there has been no IPD meta-analysis to identify prognostic factors for postoperative delirium in older surgical patients and assess their relative prognostic importance.
Using aggregate data for meta-analysis of prognostic factors has important limitations mostly because of the heterogeneous nature of primary studies (e.g., different cut-off levels, diagnostic methods, methods of measurement, and analysis strategies) [22, 23]. Meta-analysis of aggregate data for prognostic studies is limited to study-level estimates of factor-outcome associations that may not be similarly adjusted. In addition, variability in baseline characteristics across studies can only be investigated at between-study level. Therefore, individual patient data (IPD) meta-analysis, in which the raw data from eligible studies are pooled, has been proven to be a superior approach for synthesising prognostic factor studies [24, 25]. There are advantages in using IPD for meta-analyses of prognostic factors including standardizing statistical analyses across included studies, the ability to explore heterogeneity in predictive performance, reducing the risk of over-fitting, and investigating more complex associations and interactions [23, 26].
Early identification of patients at risk for POD is essential as adequately timed interventions may reduce the occurrence of delirium and the related detrimental outcomes . Several pre- and postoperative risk prediction models, using multiple risk factors for POD have been developed in the past [11, 28, 29]; however, these models target highly specific populations and are not widely used in clinical practice. In 2018, the Fifth International Perioperative Neurotoxicity Working Group recommends that all patients above 50 years of age should be informed of the risk of perioperative neurocognitive disorders (including POD) and should receive a baseline cognitive testing before the operation . This systematic review will inform the basis of the first IPD meta-analysis that aims to identify and assess the value of prognostic factors for postoperative delirium in older patients. Subsequently, data will be used to develop a risk prediction model.
Protocol registration and standard reporting
We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols checklist when writing this protocol (Additional file 1) . We have submitted and registered our study protocol with PROSPERO (CRD42020171366) and will follow PRISMA-IPD guidance for reporting the results of this review .
We will perform systematic searches of MEDLINE, EMBASE, and CINAHL using OVID platform from their inception date to May 2020. A review of the gray literature will also be performed using Google Scholar. We will screen reference lists of included studies and relevant reviews to find additional studies that meet our inclusion criteria. An experienced librarian will refine the searches for individual databases. Additional file 2 provides a draft of our search strategy.
We will include randomized trials, non-randomized studies, case-control studies, retrospective and prospective cohorts, single-arm longitudinal studies that (1) enroll older adults (≥ 50 years) undergoing elective or urgent surgery, (2) assess preoperative risk factors for postoperative delirium, and (3) measure the incidence of delirium (up to 1 week post-surgery) using the Diagnostic and Statistical Manual of Mental Disorders (DSM) criteria by a trained individual, Confusion Assessment Method (CAM) or CAM-ICU, or other validated delirium assessment tools. We will exclude studies that evaluated delirium retrospectively, studies conducted in the ICU setting, and studies that address delirium tremens. In the case of studies investigating heterogeneous patient populations, we will only use data from eligible patients for the analysis. We will not restrict our study selection based on language of publication.
Eligible preoperative risk factors for this review are: age, sex, education, body mass index, type of surgery, frailty, cognitive impairment, comorbidities (such as diabetes, renal insufficiency, cerebrovascular disease, coronary artery disease, myocardial infarction, neurological disorders, dyslipidemia, hypertension, and obstructive lung disease), hypoalbuminemia, psychotropic medication use, history of psychiatric disorders and depression, impairment of activities of daily living, smoking status, alcohol consumption, American Society of Anaesthesiologists physical status classification, Charlson Comorbidity Index, caregiver support, type of anesthesia, and pre-hospitalization.
Pairs of reviewers will independently screen titles, abstracts, and full-text articles of records retrieved through the searches using standardized, pilot-tested forms in Covidence, an online systematic review software (https://www.covidence.org). Any disagreements between reviewers will be resolved through discussion, and if necessary, through participation of a third reviewer.
Collection of study-level data and data storage
We will contact principal investigators or corresponding authors of eligible studies to inform them about the study and ask if they are willing to share IPD. Those who express an interest in collaboration will be invited to read the protocol and to discuss the requirements for data sharing. The data custodian/representative of the institution will then be invited to sign a data sharing agreement, which specifies the data requested, obligations, ownership of data, terms, and authorship of potential publications. We have developed a specific web link for collaborators with limited access to acquire more information and access the relevant information (https://www.pipra.ch/collaboration.html). We will request authors of eligible studies to provide ethics-approved de-identified data as an encrypted file. All cleaned datasets will be stored in password-protected files on a secured server at McMaster University only accessible to members of the IPD meta-analysis group. All datasets will be in their original formats and will be converted to a master dataset for analysis. Additional file 2 provides a draft copy of our data sharing agreement.
Study authors will be asked to share relevant data regarding candidate predictors and delirium outcomes regardless of whether such data has previously reported in relevant study publication(s). The IPD received will not be used for any other research apart from that described in the data sharing agreement. All collaborators (one representative per study) will be invited to be co-authors on manuscripts describing the principal IPDMA analyses, for which their data contributed, as outlined in this protocol, subject to them meeting the International Committee of Medical Journal Editors (ICMJE) criteria for authorship.
Risk of bias assessment
We will evaluate validity and bias in studies of prognostic factors using Quality In Prognosis Studies (QUIPS) tool . We will assess the study risk of bias using five domains (study participation, study attrition, prognostic factors, outcome measurement, and study confounding). We will use a modified QUIPS tool to rate each domain as low or high risk of bias as opposed to the original low, medium, and high risk of bias. We will use the individual domains, rated as low, or high risk of bias, to inform the overall risk of bias in each study. Studies with four or five low-risk domains will be considered at overall low risk of bias, and studies with two or more high-risk domains will be considered at overall high risk of bias. Risk of bias assessments will be performed in duplicate and independently.
Data synthesis and analysis
Data will be inspected for missing data and unusual outliers via range check for all included variables. We will resolve any issues with the data provided through communication and in collaboration with the original authors. Datasets will be accepted in any form, provided that all data are anonymized, and variables and categories are adequately labeled in English. Following satisfactory data control, each dataset will be converted to a common format and variables will be renamed in a consistent manner. The original scales of covariate measurements that are reported will be utilized, where possible. To ensure compatibility across studies, when required, attempts will be made to convert variables to the same scale for all studies. Once each study data is cleaned and standardized, individual study datasets will then be combined to form a new master dataset with a variable added to indicate the original study.
IPD meta-analysis can be conducted using either a one-stage or two-stage approach [34, 35]. Random-effects linear regression fitted with mixed or logistic two-level regression model (with patients nested within studies) will be used in the one-stage approach (using ipdforst package in Stata). In this approach, the IPD from all studies will be pooled in a single step, while accounting for clustering of patients within studies. This approach is preferred when few studies or few patients per study are available for synthesis [34, 36].
Two-stage IPD meta-analysis methods can also incorporate covariates and interactions; however, the one-stage approach is likely to be more flexible and practical for modeling of non-linear associations of candidate predictors with outcome. Therefore, our primary analysis will be conducted using the one-stage approach (hierarchical model which will include both study-level and patient-level covariates in the same model). We will use two-stage approach as a sensitivity analysis on the final dataset. All models will allow for random effects and will be estimated using restricted maximum likelihood. Our outcome of interest is postoperative delirium, and we will estimate odds ratios with 95% confidence intervals to quantify the magnitude of outcome-factor associations. There will be no subgroup analyses required. We will use Stata (StataCorp., Release 15.1. College Station, TX) for all data analyses.
Assessment of certainty in evidence
For assessing our certainty in the prognostic value of the predictors, we will use the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach for prognostic factors . Based on GRADE guidance for prognostic studies because we are addressing the issue of prognosis and not causation, observational studies will start as high certainty but may be rated down based on the limitations in risk of bias, imprecision, inconsistency, indirectness, and publication bias [37, 38]. Certainty can be rated as high, moderate, low, or very low. The GRADE approach is typically applied at the outcome level. Since the focus of our review is prognostic factors for the same outcome, assessment of our certainty will be applied at the level of each individual prognostic factor.
This IPD meta-analysis met the criteria for waiver of ethical approval as defined by McMaster University Ethics Board as it will use existing anonymized data. The prognostic factors identified from our IPD meta-analysis will help to inform the development of a more sophisticated risk prediction model for assessing risk of postoperative delirium in older surgical patients. This will ultimately be used to guide clinical decisions about the most efficient way to prevent postoperative delirium. We will publish the results of our study in an open-access scientific journal and will disseminate our findings in relevant national and international conferences.
Availability of data and materials
All supplementary data are made available.
Individual participant data
Randomized controlled trials
Non-randomized studies of interventions
Diagnostic and Statistical Manual of Mental Disorders
International Committee of Medical Journal Editors
Quality in Prognostic Studies
Grading of Recommendations Assessment, Development and Evaluation
Story DA, Leslie K, Myles PS, Fink M, Poustie SJ, Forbes A, et al. Complications and mortality in older surgical patients in Australia and New Zealand (the REASON study): a multicentre, prospective, observational study. Anaesthesia. 2010;65(10):1022–30.
Evered L, Silbert B, Knopman DS, Scott DA, DeKosky ST, Rasmussen LS, et al. Recommendations for the nomenclature of cognitive change associated with anaesthesia and surgery-2018. Anesthesiology. 2018;129(5):872–9.
Sanders RD, Pandharipande PP, Davidson AJ, Ma D, Maze M. Anticipating and managing postoperative delirium and cognitive decline in adults. BMJ. 2011;343:d4331.
Witlox J, Eurelings LSM, de Jonghe JFM, Kalisvaart KJ, Eikelenboom P, van Gool WA. Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: a meta-analysis. JAMA. 2010;304(4):443–51.
Inouye SK, Westendorp RG, Saczynski JS. Delirium in elderly people. Lancet (London, England). 2014;383(9920):911–22.
Raats JW, van Eijsden WA, Crolla RM, Steyerberg EW, van der Laan L. Risk factors and outcomes for postoperative delirium after major surgery in elderly patients. PLoS One. 2015;10(8):e0136071.
Bickel H, Gradinger R, Kochs E, Förstl H. High risk of cognitive and functional decline after postoperative delirium. Dement Geriatr Cogn Disord. 2008;26(1):26–31.
Saczynski JS, Marcantonio ER, Quach L, Fong TG, Gross A, Inouye SK, et al. Cognitive trajectories after postoperative delirium. N Engl J Med. 2012;367(1):30–9.
Inouye SK, Bogardus ST, Charpentier PA, Leo-Summers L, Acampora D, Holford TR, et al. A multicomponent intervention to prevent delirium in hospitalized older patients. N Engl J Med. 1999;340(9):669–76.
Zhu Y, Wang G, Liu S, Zhou S, Lian Y, Zhang C, et al. Risk factors for postoperative delirium in patients undergoing major head and neck cancer surgery: a meta-analysis. Jpn J Clin Oncol. 2017;47(6):505–11.
Kalisvaart KJ, Vreeswijk R, De Jonghe JFM, Van Der Ploeg T, Van Gool WA, Eikelenboom P. Risk factors and prediction of postoperative delirium in elderly hip-surgery patients: implementation and validation of a medical risk factor model. J Am Geriatr Soc. 2006;54(5):817–22.
Greaves D, Psaltis PJ, Ross TJ, Davis D, Smith AE, Boord MS, et al. Cognitive outcomes following coronary artery bypass grafting: A systematic review and meta-analysis of 91,829 patients. Int J Cardiol. 2019;289:43–9.
Lin Y, Chen J, Wang Z. Meta-analysis of factors which influence delirium following cardiac surgery. J Card Surg. 2012;27(4):481–92.
Liu X, Yu Y, Zhu S. Inflammatory markers in postoperative delirium (POD) and cognitive dysfunction (POCD): A meta-analysis of observational studies. PLoS One. 2018;13(4):e0195659.
Scholz A, Oldroyd C, McCarthy K, Quinn T, Hewitt J. Systematic review and meta-analysis of risk factors for postoperative delirium among older patients undergoing gastrointestinal surgery. Br J Surg. 2016;103(2):e21–e8.
Smith TO, Cooper A, Peryer G, Griffiths R, Fox C, Cross J. Factors predicting incidence of post-operative delirium in older people following hip fracture surgery: a systematic review and meta-analysis. Int J Geriatr Psychiatry. 2017;32(4):386–96.
Watt J, Tricco AC, Talbot-Hamon C, Pham B, Rios P, Grudniewicz A, et al. Identifying older adults at risk of delirium following elective surgery: a systematic review and meta-analysis. J Gen Intern Med. 2018;33(4):500–9.
Yang Y, Zhao X, Dong T, Yang Z, Zhang Q, Zhang Y. Risk factors for postoperative delirium following hip fracture repair in elderly patients: a systematic review and meta-analysis. Aging Clin Exp Res. 2017;29(2):115–26.
Zhu C, Wang B, Yin J, Xue Q, Gao S, Xing L, Wang H, Liu W, Liu X. Risk factors for postoperative delirium after spinal surgery: a systematic review and meta-analysis. Aging Clin Exp Res. 2020;32(8):1417–34. https://doi.org/10.1007/s40520-019-01319-y.
Raats J, Steunenberg S, De Lange D, Van Der Laan L. Risk factors of post-operative delirium after elective vascular surgery in the elderly: a systematic review. Int J Surg. 2016;35:1–6.
Oldroyd C, Scholz AF, Hinchliffe RJ, McCarthy K, Hewitt J, Quinn TJ. A systematic review and meta-analysis of factors for delirium in vascular surgical patients. J Vasc Surg. 2017;66(4):1269–79. e9.
Riley RD, Abrams KR, Sutton AJ, Lambert PC, Jones DR, Heney D, et al. Reporting of prognostic markers: current problems and development of guidelines for evidence-based practice in the future. Br J Cancer. 2003;88(8):1191–8.
Abo-Zaid G, Sauerbrei W, Riley RD. Individual participant data meta-analysis of prognostic factor studies: state of the art? BMC Med Res Methodol. 2012;12:56.
Trivella M, Pezzella F, Pastorino U, Harris AL, Altman DG. Microvessel density as a prognostic factor in non-small-cell lung carcinoma: a meta-analysis of individual patient data. Lancet Oncol. 2007;8(6):488–99.
Riley RD, Sauerbrei W, Altman DG. Prognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond. Br J Cancer. 2009;100(8):1219–29.
Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ. 2010;340:c221.
Inouye SK. Prevention of delirium in hospitalized older patients: risk factors and targeted intervention strategies. Ann Med. 2000;32(4):257–63.
Freter SH, Dunbar MJ, MacLeod H, Morrison M, MacKnight C, Rockwood K. Predicting post-operative delirium in elective orthopaedic patients: the Delirium Elderly At-Risk (DEAR) instrument. Age Ageing. 2005;34(2):169–71.
Marcantonio ER, Goldman L, Mangione CM, Ludwig LE, Muraca B, Haslauer CM, et al. A Clinical Prediction Rule for Delirium After Elective Noncardiac Surgery. JAMA. 1994;271(2):134–9.
Berger M, Schenning KJ, Brown CH, Deiner SG, Whittington RA, Eckenhoff RG, et al. Best Practices for Postoperative Brain Health: Recommendations From the Fifth International Perioperative Neurotoxicity Working Group. Anesth Analg. 2018;127(6):1406–13.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.
Stewart LA, Clarke M, Rovers M, Riley RD, Simmonds M, Stewart G, et al. Preferred reporting items for systematic review and meta-analyses of individual participant data: the PRISMA-IPD Statement. JAMA. 2015;313(16):1657–65.
Hayden JA, van der Windt DA, Cartwright JL, Cote P, Bombardier C. Assessing bias in studies of prognostic factors. Ann Intern Med. 2013;158(4):280–6.
Burke DL, Ensor J, Riley RD. Meta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ. Stat Med. 2017;36(5):855–75.
Stewart GB, Altman DG, Askie LM, Duley L, Simmonds MC, Stewart LA. Statistical analysis of individual participant data meta-analyses: a comparison of methods and recommendations for practice. PLoS One. 2012;7(10):e46042.
Debray TP, Moons KG, Abo-Zaid GM, Koffijberg H, Riley RD. Individual participant data meta-analysis for a binary outcome: one-stage or two-stage? PLoS One. 2013;8(4):e60650.
Foroutan F, Guyatt G, Zuk V, Vandvik PO, Alba AC, Mustafa R, et al. GRADE Guidelines 28: Use of GRADE for the assessment of evidence about prognostic factors: rating certainty in identification of groups of patients with different absolute risks. J Clin Epidemiol. 2020;121:62–70.
Iorio A, Spencer FA, Falavigna M, Alba C, Lang E, Burnand B, et al. Use of GRADE for assessment of evidence about prognosis: rating confidence in estimates of event rates in broad categories of patients. Bmj. 2015;350:h870.
The authors would like to thank Cochrane Anesthesia Group and Ms. Teo Wasteneys Quay for their technical assistance.
PIPRA AG, Josefstrasse 219, 8005 Zürich, Switzerland. https://www.pipra.ch.
Ethics approval and consent to participate
Local ethics approval is not required for this study. The authors of eligible studies will be asked to provide ethics-approved de-identified data as an encrypted file.
Consent for publication
Consent for publication is not required for this study. The authors of eligible studies will confirm that consent was obtained in the primary study as per local ethics requirements.
PIPRA AG will develop a commercial presurgical risk assessment tool based on the findings of this meta-analysis. BS and LM received funding from PIPRA AG for conducting this systematic review and IPD meta-analysis. BS is a member of GRADE Working Group. NG has received consultancy fees from PIPRA AG. NS and BTD are founders, shareholders, and employees of PIPRA AG.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Buchan, T.A., Sadeghirad, B., Schmutz, N. et al. Preoperative prognostic factors associated with postoperative delirium in older people undergoing surgery: protocol for a systematic review and individual patient data meta-analysis. Syst Rev 9, 261 (2020). https://doi.org/10.1186/s13643-020-01518-z
- Prognostic factors
- Individual patient data meta-analysis