Systematic reviews of observational studies of Risk of Thrombosis and Bleeding in General and Gynecologic Surgery (ROTBIGGS): introduction and methodology
Systematic Reviews volume 10, Article number: 264 (2021)
Venous thromboembolism (VTE) and bleeding are serious and potentially fatal complications of surgical procedures. Pharmacological thromboprophylaxis decreases the risk of VTE but increases the risk of major post-operative bleeding. The decision to use pharmacologic prophylaxis therefore represents a trade-off that critically depends on the incidence of VTE and bleeding in the absence of prophylaxis. These baseline risks vary widely between procedures, but their magnitude is uncertain. Systematic reviews addressing baseline risks are scarce, needed, and require innovations in methodology. Indeed, systematic summaries of these baseline risk estimates exist neither in general nor gynecologic surgery. We will fill this knowledge gap by performing a series of systematic reviews and meta-analyses of the procedure-specific and patient risk factor stratified risk estimates in general and gynecologic surgeries.
We will perform comprehensive literature searches for observational studies in general and gynecologic surgery reporting symptomatic VTE or bleeding estimates. Pairs of methodologically trained reviewers will independently assess the studies for eligibility, evaluate the risk of bias by using an instrument developed for this review, and extract data. We will perform meta-analyses and modeling studies to adjust the reported risk estimates for the use of thromboprophylaxis and length of follow up. We will derive the estimates of risk from the median estimates of studies rated at the lowest risk of bias. The primary outcomes are the risk estimates of symptomatic VTE and major bleeding at 4 weeks post-operatively for each procedure stratified by patient risk factors. We will apply the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to rate evidence certainty.
This series of systematic reviews, modeling studies, and meta-analyses will inform clinicians and patients regarding the trade-off between VTE prevention and bleeding in general and gynecologic surgeries. Our work advances the standards in systematic reviews of surgical complications, including assessment of risk of bias, criteria for arriving at the best estimates of risk (including modeling of the timing of events and dealing with suboptimal data reporting), dealing with subgroups at higher and lower risk of bias, and use of the GRADE approach.
Systematic review registration
Surgeons perform over 300 million operations annually worldwide . Venous thromboembolism (VTE) encompasses two related conditions: deep venous thrombosis (DVT) and pulmonary embolism (PE). These represent severe and sometimes fatal complications of surgery . VTE has earlier been described as the leading cause of preventable hospital-related death [3, 4]. It has been suggested that the mortality burden of VTE could be as high as 500,000 deaths in Europe and 100,000 to 300,000 deaths in the USA every year . In contrast, some studies have suggested a substantial overdiagnosis and overtreatment of VTE [6, 7]. Post-operative bleeding can lead to transfusion and/or reoperation, and is associated with a higher risk of death and complications as well as longer hospital stay and increased health care costs [8, 9].
An earlier systematic review and meta-analysis that pooled general, urologic, and gynecologic surgery patients suggested that pharmacological prophylaxis decreases the risk of VTE by approximately 50%, while increasing the risk of major post-operative bleeding by a similar percentage [10,11,12]. The decision to use thromboprophylaxis represents, therefore, a trade-off between the decreased risk of VTE and the increased risk of bleeding.
This trade-off depends crucially on the risk of VTE and major bleeding when the patient is not receiving anticoagulation (we refer these risks baseline risks) . When the baseline risk for VTE is high and the risk for bleeding is low, a 50% reduction in VTE represents a substantial benefit. The impact of prophylaxis will, however, result in net harm for patients with low risk of VTE and high risk of bleeding. In urology, the baseline risks for VTE and bleeding vary according to procedure-specific factors [10,11,12]. The risks also vary between different general and gynecologic procedures [14, 15]; the magnitude of this variation is, however, uncertain. This makes the decision regarding the use of thromboprophylaxis difficult.
Table 1 presents major guidelines addressing the use of thromboprophylaxis for abdominal and/or pelvic surgery [2, 10, 16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. Thromboprophylaxis guidelines in general (abdominal) or gynecologic surgery have not generally made procedure-specific recommendations (Table 1). There are three exceptions in abdominal and pelvic surgery, two of them in general or gynecologic surgery: (i) American Society of Hematology (ASH) 2019 guidelines gave procedure-specific recommendation for laparoscopic cholecystectomy , and (ii) Enhanced Recovery After Surgery Society (ERAS) gave procedure- (but not approach-) specific recommendations for pancreaticoduodenectomy [29, 30]. The only completely procedure- (and approach-) specific guideline in abdominal and/or pelvic surgery is the European Association of Urology (EAU) guidelines, providing procedure-specific thromboprophylaxis recommendations for urologic surgery procedures . Overall, experts have failed to achieve a consensus regarding the use of VTE prophylaxis in general and gynecologic surgery [2, 10, 16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. The significant practice variation within and between countries is therefore unsurprising [35,36,37].
Before initiating this review, our research group has completed series of systematic reviews in urology that informed the first ever patient risk and procedure-specific guideline, the European Association of Urology (EAU) Guideline on Thromboprophylaxis in Urological Surgery [11, 12, 38]. Therefore, the fact that general and gynecologic surgical thromboprophylaxis guidelines are not procedure-specific (Table 1) is unsurprising. The key reason for this lack of procedure-specific guidance is the absence of high-quality systematic reviews providing procedure-specific estimates of VTE and bleeding risk. We aim to fill this knowledge gap by performing a series of systematic reviews, modeling studies and meta-analyses informing clinicians and patients about the trade-off between VTE prevention and bleeding in general and gynecologic surgeries. We call this initiative the Risk Of Thrombosis and Bleeding In General and Gynecologic Surgery (ROTBIGGS). Each review will summarize the evidence of the procedure-specific frequencies of VTE and major bleeding in general (abdominal) and gynecologic surgeries. Our work will also advance the methods of systematic reviews of surgical complications. In this article, we describe the specific methods used in our upcoming systematic reviews.
Our study protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO CRD42021234119). We have adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) guidance  to report this protocol (Additional file 1).
We will include retrospective and prospective observational studies and case series enrolling adult patients undergoing a target procedure in general or gynecologic surgery but exclude randomized trials. Observational studies of unselected patients are likely the best sources of estimates of VTE and bleeding [40, 41]. We will not include randomized controlled trials (RCTs); although RCTs provide the best estimates of treatment efficacy, they do not provide best estimates about the baseline risks of patients in routine practice. Although randomization minimizes the bias in allocating the patients to the intervention and control groups, there are other biases inherent to RCTs that limit their generalizability. Inclusion and exclusion criteria of the trials often lead to highly selected patient populations, and RCTs may therefore be limited when estimating baseline risks. For instance, patients with advanced age and greater comorbidity as well as those from lower socioeconomic status are under-represented in RCTs [42, 43].
Expert panels have already selected the most relevant procedures for this study (Table 2, see additional files for classification and related terms used). The expert panelists were experienced consultant surgeons from Canada, Finland, and the UK representing general, colorectal, HPB, and upper-GI surgery (V.J.S., P.J.K., K.A., I.B-L., A.J.K., H.L., A.K.M., T.P.N., S.P.); cancer and non-cancer gynecology (ALL, IEJK, RC, RLA, KMA, JLC, PJG, MLI-K, KMJ, PKK, SMO, RMT); and (clinician-)methodologists (LIL, GHG, KAOT). We will include studies with patients undergoing at least one of these procedures (Table 2). We will further stratify these procedures by approach (such as open, laparoscopic or robotic) and other criteria, if we find enough studies providing these estimates. As we did not include obstetric surgery, we will exclude peripartum procedures or surgeries performed due to obstetric reasons. We will exclude studies in which over 10% of participants underwent any other procedure than the procedure of interest, when the outcomes of interest are not stratified between procedures/approaches.
We will only include studies with at least 50 adult patients per target procedure. Small studies tend to show different, often greater, treatment effects than larger studies . There are many possible reasons for these discrepancies such as publication bias, selective reporting of results and higher risk of bias [45, 46].
We will include studies that report at least one absolute risk estimate of our outcomes: fatal PE, symptomatic non-fatal PE, symptomatic DVT, symptomatic VTE, major bleeding, or fatal bleeding. Absolute estimates include the percentages (e.g., 2.0%), proportions (e.g., 0.01), natural units or natural frequency (e.g., 2 in 1000 patients), and natural frequency per time (e.g., 4 in 1000 patient years).
Studies must also be generalizable to the population of interest (that is, adult patients undergoing a target procedure). To assess the applicability and representativeness of each study, and the heterogeneity between the estimates, we will record the mean age of the study population and the proportion of patients with malignant disease. We will exclude studies with atypical populations for either of these factors when clear outliers exist. We will also exclude studies with high risk of bias when enough studies with low risk of bias for a target procedure are identified for a target procedure (“Final selection of eligible studies (risk of bias and outliers)” section). Finally, in case of overlapping study populations, we will primarily include the article with lowest risk of bias and secondarily the article with greater number of patients.
The primary outcomes will be the procedure-specific absolute risks of symptomatic VTE and major bleeding. While conducting our earlier systematic reviews on procedure-specific risks of thrombosis and bleeding in urology, we recognized substantial heterogeneity in the definitions of major bleeding across different studies [11, 12, 38]. Based on the bleeding features independently associated with 30-day mortality  and iterative discussion, we will use three different major bleeding definitions: (1) bleeding requiring reoperation (including exploration and angioembolization), (2) bleeding leading to the transfusion of one or more units of red blood cells, and (3) bleeding leading to post-operative hemoglobin below 70 g/L. In addition, we will measure the absolute risks of fatal pulmonary embolism and fatal bleeding.
We will use cumulative risk estimates at post-operative day 28. We chose this 4-week time frame for estimates of risks of thrombosis and bleeding because this is a feasible and frequently selected time frame for prophylaxis [48, 49]. When the authors present the frequency of events at more than one time point, we will record the number of events up to three months and use the absolute risk closest to 4 weeks. All outcomes will be extracted and analyzed separately for each procedure. Surrogate outcomes such as asymptomatic DVT and the amount of estimated blood loss during the operation are of questionable importance to patients , and we will not collect data on such events.
Study selection and data abstraction
Literature search, study selection, application of eligibility criteria, and data abstraction
We will perform comprehensive searches separately for general and gynecologic surgeries with the aid of an information specialist (R.J.C.). A combination of keyword and medical subject headings (MeSH) search will include the post-operative complications and VTE block combined with the surgery block (including the target surgery subfield terms combined with the target procedure and body part terms).
Our searches will include Embase, MEDLINE, Web of Science, and Google Scholar from January 1, 2004, until the present for general surgery and from January 1, 2000 until the present for gynecologic surgery. We limit our searches to contemporary studies, because the baseline risks of VTE and bleeding have likely changed over time [51,52,53]. The update search is planned for 1 year before estimated publication date of results articles.
We will also search for any reviews (found by our search) that may include observational studies of our interest. We will review these for possible eligible studies and add identified studies to selection process. We will further identify articles for procedures by reviewing the reference lists of the included studies. Finally, we will include articles that were not yielded by the search but are known to the experts in the panel to the full text screening.
We developed piloted, standardized data forms for screening articles and data extraction. Methodologically trained reviewers will apply these forms, guided with written instructions, to screen study reports for eligibility and extract data from eligible reports. The reviewers will conduct pilot screening and data extraction exercises to achieve a high level of agreement. Reviewers will screen abstracts in DistillerSR (Evidence Partners, Ottawa, Canada), an online systematic review software program. Reviewers will first screen titles and abstracts to select papers for full-text assessment and then full-text papers to confirm the eligibility of the articles (Fig. 1). All screening and data extraction will be completed independently and in duplicate. In every full-text screening pair, there will be at least one clinician expert (general/abdominal surgeon in general surgery and gynecologic surgeon in gynecologic surgery). An adjudicator (lead author or clinician-methodologist) will resolve any disagreement on eligibility or data extraction.
Because of the very large number of studies, our data extraction will be conducted in two phases. In the first phase, we will assess the risk of bias and classify studies as having very low, low, moderate or high risk of bias (“Assessment of risk of bias and outliers (final selection of eligible studies)” section). In this first phase, we will also extract data regarding procedure characteristics: procedure name, number of patients and outcomes reported for each procedure. In the second phase, (i) if we have at least 1000 patients and five articles for a target procedure in studies with very low and low risk of bias, we will exclude studies with moderate and high risk of bias; (ii) if we have at least 2000 patients and 10 articles for a certain target procedure in studies with very low, low, or moderate risk of bias, we will exclude studies with high risk of bias; and (iii) in other situations, we will use all studies irrespective of their risk of bias. These thresholds will be specific for approach of the target procedure. Finally, we will conduct these aforementioned steps separately for each outcomes of interest.
For all eligible studies, we will collect information on several other characteristics of the studies and their populations that may be predictive of VTE or major bleeding (Table 3). Finally, we will send our consensus of data extraction to the original authors of each article for confirmation or correction. When necessary, we will ask the authors to clarify details regarding the thromboprophylaxis, surgical technique, and other missing or unclear information.
Assessment of risk of bias and outliers (final selection of eligible studies)
We will assess the methodological features that could potentially bias the estimates of VTE or bleeding risk. Criteria for risk of bias are still poorly established for studies on baseline risk compared to studies on therapeutic interventions [54,55,56,57]. Risk of bias criteria are also dependent on the outcomes of interest and other factors specific to this study. Through iterative discussion and consensus-building and informed by the prior literature [11, 12, 38, 58,59,60], we developed an instrument for the risk of bias assessment to allow classifying studies as having very low, low, moderate, or high risk of bias (Table 4). The criteria for the overall risk of bias are based on the number of individual risk of bias domains that are judged as having high risk of bias (Table 4).
Because the baseline risks of VTE and bleeding are likely to have changed over time [61,62,63], older studies present potential risk of bias when estimating the present baseline risks. The complication estimates depend on the length of follow-up and studies that do not clearly define the time period of follow-up may therefore be biased. In addition, the details of thromboprophylaxis are sometimes insufficiently reported in available studies, which may also bias the results. We will estimate the thromboprophylaxis used based on information from the authors and, if not directly provided, on data on the type of thromboprophylaxis typically used in the country during the study period. Since the exclusion criteria include atypical and selected populations, we will not assess risk of bias resulting from the exclusion of patients.
Choosing the best estimate
To assess the baseline risks of VTE and major bleeding, we will use the median values of estimates from the eligible studies. The medians were chosen over pooled estimates across studies, because the pooled estimates would give more weight to larger studies. However, very large studies are also likely to have factors idiosyncratic to that population and setting, influencing the risks of both VTE and bleeding. Very large study may have poor methodological quality and dominate the smaller studies at less risk of bias. Thus, there is little reason to allow the large studies to have substantially more weight than the small ones. Heterogeneity in a systematic review of observational studies is greater than in a systematic review of randomized trials and, thus, included studies may not be similar enough to justify pooling . Under these circumstances, the median is likely to provide better estimates of typical risk than is the pooled estimate .
Modeling the risk of VTE over time
We will use cumulative risk estimates at post-operative day 28 for our procedure-stratified estimates for the risks of VTE and major bleeding. For the studies that do not report VTE estimates using this interval, we will use a similar method described in our earlier systematic reviews to adjust the absolute VTE risk by post-operative day [11, 12, 38].
To improve the trustworthiness of our VTE risk over time model, we will conduct a separate systematic review and update this (VTE risk over time) model based on the best available evidence regarding the risk and time course of VTE by post-operative day. We will include prospective studies that report at least 20 symptomatic, post-operative VTE (or DVT/PE) events for at least two time points within 90 days post-surgery. We will include studies in which at least 95% of patients probably underwent a surgical procedure in one or more of the following fields/specialties: orthopedics, general/gastrointestinal surgery, thoracic surgery, urologic surgery, gynecologic surgery (excluding obstetrics), plastic surgery, hand surgery, breast surgery, endocrine surgery, and/or transplant surgery. We will include only studies that recruited patients in the year 2000 or later.
In this VTE risk over time model, primary outcome will be the occurrence of VTE on each of the 28 days (4 weeks) following surgery. Secondary outcomes include (i) occurrence of VTE on each of the 90 days (3 months) following surgery, (ii) occurrence of DVT on each day of the 28 days following surgery, and (iii) occurrence of PE on each day of the 28 days following surgery. We will record the timing of VTE by day as reported in each individual study. We will then model the timing of VTE for each individual study using natural cubic spline interpolation and R data analysis language. We will pool these models to a single model using the random effects inverse variance method. In our main model, we will adjust for the thromboprophylaxis use. In addition, we will perform a secondary analysis without any adjustments as well as sensitivity analyses in which we will revise the reported results in each study modeling what would have happened under various conditions of thromboprophylaxis. We will perform three such sensitivity analyses by assuming (i) 1 week of thromboprophylaxis for all patients, (ii) 2 weeks of thromboprophylaxis for all patients, and (iii) 3 weeks of thromboprophylaxis for all patients. If the study reports thromboprophylaxis, we will include the study only in the sensitivity analysis in which the practice corresponds most closely to the sensitivity analysis assumption.
Modeling the risk of bleeding over time
For the studies that do not report their bleeding estimates at 4 weeks, we will use the model previously described in our earlier systematic reviews to adjust the absolute bleeding risk by post-operative day [11, 12, 38]. This bleeding risk over time model shows that 90% of the 30-day bleeding events happen during the first week. Therefore, for studies providing bleeding estimates at time period of 31 to 90 days, we will assume constant risk of bleeding beyond the first post-operative week.
To produce up-to-date information, we will extract data from contemporary observational studies. However, the contemporary studies representing the current rates of VTE often include patients that receive thromboprophylaxis. In addition, the decreasing incidence of VTE, linked to improving surgical techniques, adopting early mobilization, and extended prophylaxis as the standard of care [51,52,53], represents a challenge in estimating the efficacy of thromboprophylaxis.
To adjust the reported risks of VTE and bleeding for the use of thromboprophylaxis, we will estimate the effectiveness of prophylaxis. To achieve this, we will update our previously conducted meta-analyses of placebo-controlled randomized trials on the relative risks of VTE and bleeding among those who receive prophylaxis [11, 12, 38]. We will estimate the effects of antithrombotic agents such as unfractionated heparin, low molecular weight heparin, direct oral anticoagulants, and aspirin as well as mechanical prophylaxis (Table 3).
We will then adjust the reported risk by multiplying the relative risk by the reported risk in the proportion of patients who received prophylaxis. For instance, if a study including only patients that receive thromboprophylaxis for 4 weeks (time point of our primary outcome) shows a VTE risk of 1%, assuming that the relative risk reduction with prophylaxis is approximately 50% (as stated earlier, we will update the systematic review on this issue and relative effect estimates may change), we will infer that the included patients would have experienced a 2% risk of VTE had they not received prophylaxis.
Similarly, if the same study shows the bleeding risk of 3%, and because anticoagulant prophylaxis increases this risk by approximately 50%, we will infer the bleeding risk of 2% without prophylaxis. If thromboprophylaxis is used for less than 4 weeks, we will estimate its impact using same rationale but will also consider the duration of thromboprophylaxis by using our bleeding risk over time model [11, 12, 38].
If the study does not provide estimates of VTE but only DVT, PE, or both, we will calculate the risk of VTE by using the following approach described in our earlier systematic reviews [11, 12, 38]. We will review data from studies that reported DVT, PE, and VTE totals and estimate the overlap (i.e., patients with both DVT and PE) from these studies. We will then apply the degree of overlap to estimate VTE frequency in studies that provided only separate reports of DVT, PE, or both.
Stratifying the risks of VTE and bleeding according to procedure risk factors
We will stratify the risks of VTE for each procedure (see Table 2), further stratifying these procedures according to approach used (open, laparoscopic, robotic) and other procedure specific factors (e.g., subtotal vs. total; minor vs. major; or elective vs. emergency). This stratification will depend on how the included studies stratify the procedures and on recommendations from methodologists and expert consultant surgeons.
Stratifying the risk of VTE and bleeding according to patient risk factors
After assessing the procedure-specific baseline risk of VTE, we will stratify the risk by patient-related risk factors. We will use the tool described in our earlier systematic reviews [11, 12, 38]. We will assess four risk factors: (1) age 75 or more, (2) obesity (body mass index of 35 or more), (3) VTE in a first degree relative (parents, full siblings, or children)—all of these increase the risk approximately two-fold—and (4) prior VTE, with risk ratio of approximately 4. Patients with any combination of two or more risk factors will be assumed to have a risk ratio of 4. Using these risk factors, we will then categorize risk of VTE as low, medium (risk ratio of 2), and high risk (risk ratio of 4).
To calculate the estimates of absolute risks for these groups, for each procedure we will estimate the proportion of patients having each of the risk factors using eligible studies. To estimate the proportion of patients aged 75 or more, we will first estimate the mean/median age and SD for a target procedure, and then assume a normal distribution and calculate the proportion of patients aged 75 or more. To estimate the proportion of patients with body mass index 35 or more, we will first estimate the mean/median age and SD for a target procedure, and then use population-based data on distribution of body mass index and calculate the proportion of and patients with body mass index 35 or more. We will calculate the proportion of those with a personal history of VTE by using population-based study providing cumulative risks of personal history of VTE by age. Finally, we will estimate the proportion of patients with family history of VTE by using data from Michigan Surgical Quality Collaborative study . Our earlier search did not reveal studies demonstrating convincing and replicable risk factors for bleeding . We will therefore not stratify bleeding risk by patient-specific factors.
We will also estimate case fatality rates for VTE and major bleeding. For the case fatality of VTE, we will divide the number of fatal PE by the number of symptomatic VTE using studies that provide both estimates. For the case fatality of major bleeding, we will divide the number of fatal bleeding by the number of major bleeding.
Certainty of estimates
We will use the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach to rate the certainty of evidence (also referred to as “quality of evidence” and “confidence in estimates”) [67,68,69]. The GRADE system classifies the certainty of evidence in one of four levels—high, moderate, low, and very low. For treatment effect, RCTs begin as high-quality evidence and observational studies as low-quality evidence. The certainty of evidence from observational studies addressing a question of prognosis (such as risk of VTE or bleeding post-surgery) begins as high quality but may be rated down for several reasons [57, 70]. We will assess and rate down for (i) risk of bias, (ii) inconsistency of results, (iii) indirectness of evidence, and (iv) imprecision, ending up rating overall certainty in estimates as very low, low, moderate, or high. We will also assess uncertainties in our study design and rate down the certainty of evidence accordingly: in all cases, we will rate down to moderate owing to potential uncertainties in our VTE and bleeding risk over time models and model of patient risk strata . We will not rate down for publication bias as it is very difficult both to determine the magnitude of such bias, and to place a threshold for its likely presence in observational research .
Two patient partners (T.K. and C.N.; one who had undergone a general surgery and one a gynecologic surgery procedure) participated in the designing of the project, especially in the selection of outcome measures. They will also participate in the designing of the upcoming plain language summaries and leaflets for dissemination of results to the public. Both are co-authors of this protocol article.
Our work will use rigorous methods to make the best use of available observational data. We have specified explicit eligibility criteria, conducted comprehensive searches, and created an instrument for risk of bias assessment specific for this review. Teams of two reviewers will independently assess eligibility, risk of bias, and extract data. At least one clinician expert will assess the eligibility for every article in the full text screening phase. The lead author or a clinician-methodologist will adjudicate any discrepancies and we will send our consensus of data extraction to the original authors of each article for confirmation or correction. We will carefully address the many challenges involved in generating baseline risks of VTE and bleeding from low-quality observational data. We will conduct meta-analyses to adjust for the use of thromboprophylaxis and differences in the length of follow up. We will also take into account patient risk factors of VTE and bleeding outcomes. We will exclude studies that would bias our results and, at the same time, find balance for the amount of data for estimates. Our research group has earlier performed this kind of endeavor in urologic surgery [11, 12]. This work informed the first ever procedure-specific thromboprophylaxis guideline in any field of surgery, endorsed by the European Association of Urology . Our current project will explore this very frequent clinical dilemma in two large-scale surgical specialties: general abdominal and gynecologic surgery. We will implement improvements to the prior endeavor methods, including conducting more comprehensive literature searches and updating the VTE risk over time model.
There will be limitations to our work. As our reviews will reflect the published literature, we are unable to exclude the possibility of publication bias completely. Second, there is uncertainty in our models to get estimates for baseline risks of VTE and bleeding. Third, the large number of patients in contemporary practice receiving some form of thromboprophylaxis, and the paucity of studies that used the same follow-up duration mandate use of modeling with its inherent limitations. Fourth, indexing of observational research is inferior to that of randomized trials, leaving possible that our search missed some relevant studies. Fifth, surgical studies often focus on disease-related outcomes and do not report VTE or bleeding complications. Moreover, even when articles report risks of VTE and bleeding, key information is often missing or unclear.
Appropriate use of thromboprophylaxis requires assessment of the procedure-specific baseline risks for VTE and bleeding . The absence of procedure-specific guidelines in general and gynecologic surgery is in considerable part due to the unavailability of credible baseline risk estimates. We will remedy this deficit by providing the first procedure and patient risk factor specific summaries for these fields. Our results will directly inform clinicians and guideline developers worldwide, resulting in rationalization of current practice and decrease in both under- and overuse of thromboprophylaxis, resulting finally in better patient outcomes and wiser use of limited resources .
We will communicate with key members of the societies (guideline organizations) and journals of general and gynecologic surgeries and present the results at major meetings. We will prepare “end of project packages” deliverable to these organizations and ensure that our dissemination strategy targets appropriate audiences. Where appropriate, our results will be packaged as actionable messages, including multiple versions from which the target audience can choose, “one sentence versions” highlighting implications, “one paragraph versions” reflecting importance, results, implications for decision-makers, and what should be done, full reports and decision aids. CLUE Working Group also has a website and YouTube channel, and we use Twitter for the dissemination of research findings.
Availability of data and materials
American Society of Hematology
Clinical Urology and Epidemiology
Deep vein thrombosis
European Association of Urology
Enhanced Recovery After Surgery
Grading of Recommendations Assessment, Development and Evaluation
Medical subject headings
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
International prospective register of systematic reviews
Randomized controlled trial
Risk of Thrombosis and Bleeding in Urological Surgery
Risk of Thrombosis and Bleeding in General and Gynecologic Surgery
Weiser TG, Haynes AB, Molina G, Lipsitz SR, Esquivel MM, Uribe-Leitz T, et al. Size and distribution of the global volume of surgery in 2012. Bull World Health Organ. 2016;94(3):201–209F. https://doi.org/10.2471/BLT.15.159293.
Anderson DR, Morgano GP, Bennett C, Dentali F, Francis CW, Garcia DA, et al. American Society of Hematology 2019 guidelines for management of venous thromboembolism: prevention of venous thromboembolism in surgical hospitalized patients. Blood Adv. 2019;3(23):3898–944. https://doi.org/10.1182/bloodadvances.2019000975.
Cohen AT, Tapson VF, Bergmann JF, Goldhaber SZ, Kakkar AK, Deslandes B, et al. Venous thromboembolism risk and prophylaxis in the acute hospital care setting (ENDORSE study): a multinational cross-sectional study. Lancet. 2008;371(9610):387–94. https://doi.org/10.1016/S0140-6736(08)60202-0.
American Public Health Association, Advancing awareness to protect patient lives. White Paper, in Public Health Leadership Conference on Deep-Vein Thrombosis. 2003.
The Lancet Haematology. Thromboembolism: an under appreciated cause of death. Lancet Haematol. 2015;2(10). https://doi.org/10.1016/S2352-3026(15)00202-1.
Klemen ND, Feingold PL, Hashimoto B, Wang M, Kleyman S, Brackett A, et al. Mortality risk associated with venous thromboembolism: a systematic review and Bayesian meta-analysis. Lancet Haematol. 2020;7(8):e583–93. https://doi.org/10.1016/S2352-3026(20)30211-8.
Kotaska A. Venous thromboembolism prophylaxis may cause more harm than benefit: an evidence-based analysis of Canadian and international guidelines. Thromb J. 2018;16(1):25. https://doi.org/10.1186/s12959-018-0180-6.
Roshanov PS, Eikelboom JW, Sessler DI, Kearon C, Guyatt GH, Crowther M, et al. Bleeding Independently associated with mortality after noncardiac surgery (BIMS): an international prospective cohort study establishing diagnostic criteria and prognostic importance. Br J Anaesth. 2020;126(1):163–71. https://doi.org/10.1016/j.bja.2020.06.051.
Vascular Events in Noncardiac Surgery Patients Cohort Evaluation (VISION) Study Investigators. Association between complications and death within 30 days after noncardiac surgery. Can Med Assoc J. 2019;191(30):E830–7. https://doi.org/10.1503/cmaj.190221.
Gould MK, Garcia DA, Wren SM, Karanicolas PJ, Arcelus JI, Heit JA, et al. Prevention of VTE in nonorthopedic surgical patients: antithrombotic therapy and prevention of thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines; 2012. p. e277S.
Tikkinen KAO, Craigie S, Agarwal A, Siemieniuk RAC, Cartwright R, Violette PD, et al. Procedure-specific risks of thrombosis and bleeding in urological non-cancer surgery: systematic review and meta-analysis. 2018;73:236–41. https://doi.org/10.1016/j.eururo.2017.02.025.
Tikkinen KAO, Craigie S, Agarwal A, Violette PD, Novara G, Cartwright R, et al. Procedure-specific risks of thrombosis and bleeding in urological cancer surgery: systematic review and meta-analysis. 2018;73:242–51. https://doi.org/10.1016/j.eururo.2017.03.008.
Tikkinen KAO, Guyatt GH. Baseline risks of venous thromboembolism and major bleeding are crucial in decision-making on thromboprophylaxis. Eur Urol. 2020;78(3):369–70. https://doi.org/10.1016/j.eururo.2020.05.032.
Graul A, Latif N, Zhang X, Dean LT, Morgan M, Giuntoli R, et al. Incidence of venous thromboembolism by type of gynecologic malignancy and surgical modality in the national surgical quality improvement program. Int J Gynecol Cancer. 2017;27(3):581–7. https://doi.org/10.1097/IGC.0000000000000912.
Mukherjee D, Lidor AO, Chu KM, Gearhart SL, Haut ER, Chang DC. Postoperative venous thromboembolism rates vary significantly after different types of major abdominal operations. J Gastrointest Surg Tract. 2008;12(11):2015–22. https://doi.org/10.1007/s11605-008-0600-1.
Altman AD, Robert M, Armbrust R, Fawcett WJ, Nihira M, Jones CN, et al. Guidelines for vulvar and vaginal surgery: Enhanced Recovery After Surgery Society recommendations. Am J Obstet Gynecol. 2020;223(4):475–85. https://doi.org/10.1016/j.ajog.2020.07.039.
Key NS, Khorana AA, Kuderer NM, Bohlke K, Lee AYY, Arcelus JI, et al. Venous thromboembolism prophylaxis and treatment in patients with cancer: ASCO Clinical Practice Guideline Update. J Clin Oncol. 2020;38(5):496–520. https://doi.org/10.1200/JCO.19.01461.
Farge D, Frere C, Connors JM, Ay C, Khorana AA, Munoz A, et al. 2019 international clinical practice guidelines for the treatment and prophylaxis of venous thromboembolism in patients with cancer. Lancet Oncol. 2019;20(10):e566–81. https://doi.org/10.1016/S1470-2045(19)30336-5.
Tikkinen KAO, Cartwright R, Gould MK, Naspro R, Novara G, Sandset PM, et al. EAU Guidelines on Thromboprophylaxis in Urological Surgery. EAU Guidelines Office. Arnhem, The Netherlands. 2017. https://uroweb.org/guideline/thromboprophylaxis/.
Gustafsson UO, Scott MJ, Hubner M, Nygren J, Demartines N, Francis N, et al. Guidelines for Perioperative Care in Elective Colorectal Surgery: Enhanced Recovery After Surgery (ERAS((R))) Society Recommendations: 2018. World J Surg. 2019;43(3):659–95. https://doi.org/10.1007/s00268-018-4844-y.
Schapkaitz E. Recommendations for thrombopropylaxis in obstetrics and gynaecology—a SASOG Guideline. South Afr J Obstet Gynaecol. 2018;24(1):27. https://doi.org/10.7196/sajog.1312.
National Guideline Centre (UK). Venous thromboembolism in over 16s: Reducing the risk of hospital-acquired deep vein thrombosis or pulmonary embolism. London: National Institute for Health and Care Excellence (UK); 2018. (NICE Guideline, No. 89.) https://www.ncbi.nlm.nih.gov/books/NBK493720/https://www.ncbi.nlm.nih.gov/books/NBK493720/.
Fleming F, Gaertner W, Ternent CA, Finlayson E, Herzig D, Paquette IM, et al. The American Society of Colon and Rectal Surgeons Clinical Practice Guideline for the Prevention of Venous Thromboembolic Disease in Colorectal Surgery. Dis Colon Rectum. 2018;61(1):14–20. https://doi.org/10.1097/DCR.0000000000000982.
Liew NC, Alemany GV, Angchaisuksiri P, Bang SM, Choi G, de Silva DA, et al. Asian venous thromboembolism guidelines: updated recommendations for the prevention of venous thromboembolism. Int Angiol. 2017;36(1):1–20. https://doi.org/10.23736/S0392-9590.16.03765-2.
Thrombosis Canada. Thromboprophylaxis: Non-Orthopedic Surgery. Thrombosis Canada: Clinical Guides. 2016. https://thrombosiscanada.ca/wp-content/uploads/2017/01/8.-Thromboprophylaxis-Non-Ortho-2016Dec07-FINAL-1.pdf. Accessed 15 Mar 2019.
Nelson G, Altman AD, Nick A, Meyer LA, Ramirez PT, Achtari C, et al. Guidelines for pre- and intra-operative care in gynecologic/oncology surgery: Enhanced Recovery After Surgery (ERAS®) Society recommendations — Part I. Gynecol Oncol. 2016;140(2):313–22. https://doi.org/10.1016/j.ygyno.2015.11.015.
Scottish Intercollegiate Guidelines Network Prevention and Management of Venous Thromboembolism: A National Clinical Guideline. SIGN publication No. 122. 2014.
Nygren J, Thacker J, Carli F, Fearon KC, Norderval S, Lobo DN, et al. Guidelines for Perioperative Care in Elective Rectal/Pelvic Surgery: Enhanced Recovery After Surgery (ERAS®) Society Recommendations. World J Surg. 2013;37(2):285–305. https://doi.org/10.1007/s00268-012-1787-6.
Lassen K, Coolsen MME, Slim K, Carli F, de Aguilar-Nascimento JE, Schäfer M, et al. Guidelines for Perioperative Care for Pancreaticoduodenectomy: Enhanced Recovery After Surgery (ERAS®) Society Recommendations. World J Surg. 2013;37(2):240–58. https://doi.org/10.1007/s00268-012-1771-1.
Cerantola Y, Valerio M, Persson B, Jichlinski P, Ljungqvist O, Hubner M, et al. Guidelines for perioperative care after radical cystectomy for bladder cancer: Enhanced Recovery After Surgery (ERAS((R))) society recommendations. Clin Nutr. 2013;32(6):879–87. https://doi.org/10.1016/j.clnu.2013.09.014.
Wickham N, Gallus AS, Walters BNJ, Wilson A, the NHMRC VTE Prevention Guideline Adaptation Committee. Prevention of venous thromboembolism in patients admitted to Australian hospitals: summary of National Health and Medical Research Council clinical practice guideline. Intern Med J. 2012;42(6):698–708. https://doi.org/10.1111/j.1445-5994.2012.02808.x.
Gould MK, Garcia DA, Wren SM, Karanicolas PJ, Arcelus JI, Heit JA, et al. Prevention of VTE in nonorthopedic surgical patients: antithrombotic therapy and prevention of thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest. 2012;141(2 Suppl):e227S–77S. https://doi.org/10.1378/chest.11-2297.
Forrest JB, Clemens JQ, Finamore P, Leveillee R, Lippert M, Pisters L, et al. AUA Best Practice Statement for the Prevention of Deep Vein Thrombosis in Patients Undergoing Urologic Surgery. J Urol. 2009;181(3):1170–7.. https://doi.org/10.1016/j.juro.2008.12.027.
Committee on Practice Bulletins--Gynecology, A.C.o.O. and Gynecologists. ACOG Practice Bulletin No. 84: Prevention of deep vein thrombosis and pulmonary embolism. Obstet Gynecol. 2007;110(2 Pt 1):429–40. https://doi.org/10.1097/01.AOG.0000263919.23437.15.
Hopkins L, Carrier M, Plante M, Luna V, Gotlieb W, Rambout L. Surgical venous thromboprophylaxis: a cross-sectional survey of canadian gynaecologic oncologists. J Obstet Gynaecol Can. 2012;34(7):673–7. https://doi.org/10.1016/S1701-2163(16)35321-X.
Krell RW, Scally CP, Wong SL, Abdelsattar ZM, Birkmeyer NJO, Fegan K, et al. Variation in Hospital Thromboprophylaxis Practices for Abdominal Cancer Surgery. Ann Surg Oncol. 2016;23(5):1431–9. https://doi.org/10.1245/s10434-015-4970-9.
Petch S, Norris L, O'Toole S, Gleeson N, Abu Saadeh F. Peri operative venous thromboembolism prophylaxis in gynaecological cancer patients. A survey of current practice. Thromb Res. 2016;145:126–8. https://doi.org/10.1016/j.thromres.2016.08.007.
Tikkinen KA, Agarwal A, Craigie S, Cartwright R, Gould MK, Haukka J, et al. Systematic reviews of observational studies of risk of thrombosis and bleeding in urological surgery (ROTBUS): introduction and methodology. Syst Rev. 2014;3(1):150. https://doi.org/10.1186/2046-4053-3-150.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. https://doi.org/10.1186/2046-4053-4-1.
Van Spall HG, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297(11):1233–40. https://doi.org/10.1001/jama.297.11.1233.
Heit JA. Estimating the incidence of symptomatic postoperative venous thromboembolism: the importance of perspective. JAMA. 2012;307(3):306–7. https://doi.org/10.1001/jama.2011.2013.
Booth CM, Tannock IF. Randomised controlled trials and population-based observational research: partners in the evolution of medical evidence. Br J Cancer. 2014;110(3):551–5. https://doi.org/10.1038/bjc.2013.725.
Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J. A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials. 2015;16(1):495. https://doi.org/10.1186/s13063-015-1023-4.
Sterne JAC, Gavaghan D, Egger M. Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):1119–29. https://doi.org/10.1016/S0895-4356(00)00242-0.
IntHout J, Ioannidis JPA, Borm GF, Goeman JJ. Small studies are more heterogeneous than large ones: a meta-meta-analysis. J Clin Epidemiol. 2015;68(8):860–9. https://doi.org/10.1016/j.jclinepi.2015.03.017.
Schwarzer G, Carpenter JR, Rücker G. Small-study effects in meta-analysis. In: Schwarzer G, Carpenter JR, Rücker G, editors. Meta-Analysis with R. Cham: Springer International Publishing; 2015. p. 107–41.
Roshanov PS, Eikelboom JW, Crowther M, Tandon V, Borges FK, Kearon C, et al. Bleeding impacting mortality after noncardiac surgery: a protocol to establish diagnostic criteria, estimate prognostic importance, and develop and validate a prediction guide in an international prospective cohort study. CMAJ Open. 2017;5(3):E594–e603. https://doi.org/10.9778/cmajo.20160106.
Felder S, Rasmussen MS, King R, Sklow B, Kwaan M, Madoff R, et al. Prolonged thromboprophylaxis with low molecular weight heparin for abdominal or pelvic surgery. Cochrane Database Syst Rev. 2019. https://doi.org/10.1002/14651858.CD004318.pub4.
Rausa E, Kelly ME, Asti E, Aiolfi A, Bonitta G, Winter DC, et al. Extended versus conventional thromboprophylaxis after major abdominal and pelvic surgery: Systematic review and meta-analysis of randomized clinical trials. Surgery. 2018;164(6):1234–40. https://doi.org/10.1016/j.surg.2018.05.028.
Calvert M, Brundage M, Jacobsen PB, Schünemann HJ, Efficace F. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes. 2013;11(1):184. https://doi.org/10.1186/1477-7525-11-184.
Carrier M, Altman AD, Blais N, Diamantouros A, McLeod D, Moodley U, et al. Extended thromboprophylaxis with low-molecular weight heparin (LMWH) following abdominopelvic cancer surgery. Am J Surg. 2019;218(3):537–50. https://doi.org/10.1016/j.amjsurg.2018.11.046.
Heit JA, Ashrani A, Crusan DJ, McBane R, Petterson TM, Bailey KR. Reasons for the persistent incidence of venous thromboembolism. Thromb Haemost. 2017;117(2):390–400. https://doi.org/10.1160/TH16-07-0509.
Vendler MMI, Haidari TA, Waage JE, Kleif J, Kristensen B, Gögenur I, et al. Incidence of venous thromboembolic events in enhanced recovery after surgery for colon cancer: a retrospective, population-based cohort study. Colorectal Dis. 2017;19(11):O393–401. https://doi.org/10.1111/codi.13910.
Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407–15. https://doi.org/10.1016/j.jclinepi.2010.07.017.
Ma LL, Wang YY, Yang ZH, Huang D, Weng H, Zeng XT. Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: what are they and which is better? Mil Med Res. 2020;7(1):7. https://doi.org/10.1186/s40779-020-00238-8.
Page MJ, McKenzie JE, Higgins JPT. Tools for assessing risk of reporting biases in studies and syntheses of studies: a systematic review. BMJ Open. 2018;8(3):e019703. https://doi.org/10.1136/bmjopen-2017-019703.
Pesonen JS, Vernooij RWM, Cartwright R, Aoki Y, Agarwal A, Mangera A, et al. The impact of nocturia on falls and fractures: a systematic review and meta-analysis. J Urol. 2020;203(4):674–83. https://doi.org/10.1097/JU.0000000000000459.
Hayden JA, van der Windt DA, Cartwright JL, Côté P, Bombardier C. Assessing bias in studies of prognostic factors. Ann Intern Med. 2013;158(4):280–6. https://doi.org/10.7326/0003-4819-158-4-201302190-00009.
Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016:i4919. https://doi.org/10.1136/bmj.i4919.
Kim SY, Park JE, Lee YJ, Seo HJ, Sheen SS, Hahn S, et al. Testing a tool for assessing the risk of bias for nonrandomized studies showed moderate reliability and promising validity. J Clin Epidemiol. 2013;66(4):408–14. https://doi.org/10.1016/j.jclinepi.2012.09.016.
Engel HJ, Tatebe S, Alonzo PB, Mustille RL, Rivera MJ. Physical therapist-established intensive care unit early mobilization program: quality improvement project for critical care at the University of California San Francisco Medical Center. Phys Ther. 2013;93(7):975–85. https://doi.org/10.2522/ptj.20110420.
Mont MA, Jacobs JJ, Boggio LN, Bozic KJ, Della Valle CJ, Goodman SB, et al. Preventing venous thromboembolic disease in patients undergoing elective hip and knee arthroplasty. J Am Acad Orthop Surg. 2011;19(12):768–76. https://doi.org/10.5435/00124635-201112000-00007.
Morris BA, Benetti M, Marro H, Rosenthal CK. Clinical practice guidelines for early mobilization hours after surgery. Orthop Nurs. 2010;29(5):290–316; quiz 317-8. https://doi.org/10.1097/NOR.0b013e3181ef7a5d.
The Cochrane Collaboration, Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. 2011.
Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, et al. GRADE guidelines: 12. Preparing summary of findings tables-binary outcomes. J Clin Epidemiol. 2013;66(2):158–72. https://doi.org/10.1016/j.jclinepi.2012.01.012.
Pannucci CJ, Laird S, Dimick JB, Campbell DA, Henke PK. A validated risk model to predict 90-day VTE events in postsurgical patients. Chest. 2014;145(3):567–73. https://doi.org/10.1378/chest.13-1553.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. https://doi.org/10.1136/bmj.39489.470347.AD.
Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, et al. What is “quality of evidence” and why is it important to clinicians? BMJ. 2008;336(7651):995–8. https://doi.org/10.1136/bmj.39490.551019.BE.
Hultcrantz M, Rind D, Akl EA, Treweek S, Mustafa RA, Iorio A, et al. The GRADE Working Group clarifies the construct of certainty of evidence. J Clin Epidemiol. 2017;87:4–13. https://doi.org/10.1016/j.jclinepi.2017.05.006.
Foroutan F, Guyatt G, Zuk V, Vandvik PO, Alba AC, Mustafa R, et al. GRADE Guidelines 28: Use of GRADE for the assessment of evidence about prognostic factors: rating certainty in identification of groups of patients with different absolute risks. J Clin Epidemiol. 2020;121:62–70. https://doi.org/10.1016/j.jclinepi.2019.12.023.
Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol. 2011;64(12):1277–82. https://doi.org/10.1016/j.jclinepi.2011.01.011.
Violette PD, Cartwright R, Devereaux PJ, Gross PL, Kaukonen K-M, Sandset PM, et al. ARTS: A large, international trial of thromboprophylaxis in intra-abdominal, gynecologic, and urologic surgery. Eur Urol Focus. 2021. In press. https://doi.org/10.1016/j.euf.2021.08.010.
The authors would like to thank Peter Gross and Philippe Violette for advice regarding data analysis and study design.
The Risk of Thrombosis and Bleeding in General and Gynecologic Surgery (ROTBIGGS) project was conducted by the Clinical Urology and Epidemiology (CLUE) Working Group and supported by the Academy of Finland (309387, 340957), Sigrid Jusélius Foundation and Competitive Research Funding of the Helsinki University Hospital (TYH2019321; TYH2020248). The sponsors had no role in the analysis and interpretation of the data or the manuscript preparation, review, or approval.
Ethics approval and consent to participate
Consent for publication
All authors agreed on approval for this manuscript to be submitted on finalization.
KMA received a research grant from Astra Zeneca, and is consultant for Gedeon Richter, and received reimbursement for attending a scientific meeting from GSK (Tesaro Bio). RMT received reimbursement for attending a scientific meeting from Olympus. LIL, GHG, YL, RC, ALL, VJS, IEJK, PJK, RJC, RLA, KA, KMA, IB-L, MHB, JLC, SC, PJG, HAG-P, FZG, HAG, LH, MLI-K, KMJ, PKK, NK, TPK, AJK, TK, HL, AKM, BTN, TPN, CN, SMO, SP, NP, CBBR, ARR, TS, RMT, RWMV, YW, YX, LY, JH, and KAOT have no financial conflicts of interest. GHG and RC were panel members of the European Association of Urology (EAU) ad hoc Guideline on Thromboprophylaxis in Urological Surgery. KAOT was chair of the European Association of Urology (EAU) ad hoc Guideline on Thromboprophylaxis in Urological Surgery and panel member of the American Society of Hematology (ASH) Guideline Panel on Prevention of Venous Thromboembolism (VTE) in Surgical Hospitalized Patients.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lavikainen, L.I., Guyatt, G.H., Lee, Y. et al. Systematic reviews of observational studies of Risk of Thrombosis and Bleeding in General and Gynecologic Surgery (ROTBIGGS): introduction and methodology. Syst Rev 10, 264 (2021). https://doi.org/10.1186/s13643-021-01814-2