Skip to main content
Download PDF
  • Systematic review update
  • Open access
  • Published:

Prediction models for breast cancer-related lymphedema: a systematic review and critical appraisal

Systematic Reviews volume 11, Article number: 217 (2022) Cite this article

Abstract

Purpose

The development of risk prediction models for breast cancer lymphedema is increasing, but few studies focus on the quality of the model and its application. Therefore, this study aimed to systematically review and critically evaluate prediction models developed to predict breast cancer-related lymphedema.

Methods

PubMed, Web of Science, Embase, MEDLINE, CNKI, Wang Fang DATA, Vip Database, and SinoMed were searched for studies published from 1 January 2000 to 1 June 2021. And it will be re-run before the final analysis. Two independent investigators will undertake the literature search and screening, and discrepancies will be resolved by another investigator. The Prediction model Risk Of Bias Assessment Tool will be used to assess the prediction models’ risk of bias and applicability.

Results

Seventeen studies were included in the systematic review, including 7 counties, of which 6 were prospective studies, only 7 models were validation studies, and 4 models were externally validated. The area under the curve of 17 models was 0.680~0.908. All studies had a high risk of bias, primarily due to the participants, outcome, and analysis. The most common predictors included body mass index, radiotherapy, chemotherapy, and axillary lymph node dissection.

Conclusions

The predictive factors’ strength, external validation, and clinical application of the breast cancer lymphedema risk prediction model still need further research. Healthcare workers should choose prediction models in clinical practice judiciously.

Systematic review registration

PROSPERO CRD42021258832

Peer Review reports

Background

In 2020, about 2.3 million new cases of female breast cancer were diagnosed and have surpassed lung cancer as the most commonly diagnosed in the world [1, 2]. Breast cancer-related lymphedema (BCRL) is a chronic complication that occurs after treatment for breast cancer, which can persist for a long-term and vicious circle. The incidence varies according to different study designs or timing, method of assessment, and relevant literature reports, and the incidence of BCRL is about 5–75.4% [3, 4]. The upper limb lymphedema can not only affect patients’ psychology with morphological changes, but accompanied by a series of symptoms can also bring life and work problems to patients [5]. At present, the treatment of chronic lymphedema is mainly to relieve symptoms, and the effect is not durable. Multiple studies have found that early detection and treatment of BCRL can prevent its progression and decrease the need for costly treatments [6, 7]. Therefore, there is a growing urgency to recognize and prevent BCRL early.

BCRL has different aspect risk factors, including demographic, physiological, biochemical, and treatment-related factors [8, 9]. In most of the studies, age is one of the risk factors for BCRL [10], but the predictor of age is not included in the BCRL prediction model in the study of prediction models commonly [11,12,13,14]. It may be related to the age of each included population and the different age stratification of each study. The impact of body mass index on BCRL has been confirmed in various studies, such as risk factors, model studies, and meta-analyses. Related studies have found that the occurrence of BCRL is closely related to serum phospholipid fatty acid composition and phenotype [15, 16]. Axillary radiotherapy and axillary lymph node dissection are considered to be the most important risk factors for lymphedema resulting from disruption of the lymphatic system [17, 18]. The effect of chemotherapy on BCRL is controversial. Norman et al. [19] found the lowest incidence occurs after SLNB and no chemotherapy. But the discussion in the study of Tsai et al. [20] shows that chemotherapy was not the direct cause of BCRL, and breast cancer patients receiving chemotherapy were more likely to receive invasive surgery and postoperative radiotherapy. Other risk factors such as edema within 3 months, lymphatic obstruction, inflammation, immune response, complement activation, wound healing, and fibrosis will affect the occurrence and development of lymphedema [21, 22]. In addition, there are many controversial risk factors and different research results.

A prediction model is a formal combination of multiple predictors. It calculates specific risk values for individuals so that it can predict the risk of related outcomes with intuitive data through quantitative methods [23]. It is a powerful tool for individualized diagnosis and treatment. In recent years, the development of the BCRL prediction model has gradually increased, but the study quality and results are different. Therefore, we aimed to systematically review and critically appraise all current prediction models for BCRL and provide a reference for clinical practice and future research.

Materials and methods

All steps of this study were carried out according to the guide to systematic review and meta-analysis of the prediction model [24]. This systematic review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [25, 26] and registered on the International Prospective Register of Systematic Reviews PROSPERO (CRD42021258832), and the difference with registration is we added the Embase database.

Information sources and search strategy

PubMed, Web of Science, Embase, MEDLINE, CNKI, Wang Fang DATA, Vip Database, and SinoMed were searched for studies published on 1 January 2000 and updated on 1 June 2021 in English and Chinese. We combined the following search terms which were used in referring to the PICOTS framework: the population (Breast Cancer), exposure (Lymphedema), and intervention (prediction model). Keywords were adjusted across databases. More details of the search strategy are given in the supplemental file. And it will be re-run before the final analysis.

Selection criteria and data extraction

The review question was defined according to the PICOTS framework (see Table 1). In brief, any studies of a prediction model to predict the risk of the second lymphedema were included. Exclusion criteria were (1) only studied independent risk factors, (2) informal publication, and (3) systematic reviews or meta-analyses. Study screening mainly includes three steps. Firstly, the retrieval is imported into EndNotesX9 for duplicate data deletion, further screening through titles and abstracts (step 2), reading the full text (step 3), and screening the literature according to the inclusion and exclusion criteria by two independent reviewers (QL, YMD). And any conflicts are resolved by an independent reviewer (TY).

Table 1 Key items for framing the aim, search strategy, and study inclusion and exclusion criteria for systematic review
Full size table

Data extraction will be conducted using a standardized data extraction form by two independent reviewers (QL, YMD) based on the recommendations in the Checklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS). Any disagreement between reviewers was resolved by consensus. The key items to be extracted from each included study are 11 domains, including the source of data, participants, outcome(s) to be predicted, candidate predictors, sample size, missing data, model development, model performance, model evaluation, results, interpretation, and discussion; this information can be used to describe or assess the risk of bias or applicability. In addition, we extracted the general characteristics of the included studies, including author, publication year, and presentation of the model.

Assessment of risk of bias and applicability

The bias risk and applicability of the study are evaluated by the bias risk assessment tool of the prediction model (PROBAST) [27]. The risk assessment of bias includes 20 questions in four domains: participants—concerned with the potential sources of bias and applicability related to the data sources used and participants’ selected, predictor—concerned with the potential sources of bias and applicability related to the definition and measurement of the predictors, outcome—concerned with the potential sources of bias and applicability related to the definition and determination of the outcome, and analysis—covers potential sources of bias and applicability concerns related to the analysis methods or statistical considerations. The answer to each question can be “yes,” “probably yes,” “probably no,” “no,” or “no information.” If a question has “no” or “probably no,” the risk of bias in related fields is high, and there is a high risk of bias in any field, then the overall risk of bias is high. Applicability assessment involved three domains, participants, predictors, and outcome. Each question was answered as “low concern regarding applicability,” “high concern regarding applicability,” and “unclear concern regarding applicability.” The domain of analysis is only assessed for risk of bias, having no applicability section [27].

Results

Study selection

The study retrieved 5668 titles through a systematic search. After the title and abstract were screened, twenty-seven studies were retained for full test assessment and 17 prediction models were ultimately selected for inclusion (see Fig. 1).

Fig. 1
figure 1

Identification of studies for the systematic review

Full size image

Study characteristics

The study included 19,224 breast cancer patients from 7 countries (see Table 2). Most of BCRL prediction models were based on Chinese people (n=9, 52.94%) and 12 studies were published in the past 5 years. Most studies included various factors to establish the prediction model of breast cancer lymphedema: Yuan et al.’s study [14] was based on the normal level of lymphatic vessels, and Penn et al. [32] studied the prediction model of persistent lymphedema. Wei et al. [28] used symptoms as predictors to develop a risk prediction model for the early detection of lymphedema. Of the 17 studies, most were prospective cohorts (n=6, 35.29%), six were retrospective cohort studies, four were cross-sectional studies, and one was a randomized controlled trial.

Table 2 Characteristics of included studies
Full size table

There are different outcome diagnostic criteria for each model study. Ten studies were evaluated by the perimeter measurement; Penn et al. [32] set the boundary value at 1 cm and diagnosed combined with symptoms of BCRL. Although the measurement positions of other researchers were different, they all set the boundary value at 2 cm. Kim et al. [39] diagnosed lymphedema with swelling of the affected arm exceeding 5% of the circumference difference; 5 studies used the capacity difference to diagnose BCRL, which also had a threshold difference. Li and Bevilacqua et al. [30, 40] indicated that the volume difference between the arms was greater than 200 mL, and Yuan et al. [14] indicated that the volume difference was more than 10%, which was diagnosed as lymphedema.

Development and validation of the model

The modeling method of BCRL prediction models used mostly was logistic regression analysis (n=10, 58.82%). Other studies were five Cox models, one used linear regression, and one used machine learning to estimate the probability of lymphedema (see Table 3). The candidate variables of each study can be divided into treatment-related, self-related, and behavior variables. Most of the studies focus on the treatment methods of diseases and the physiological conditions of patients. Compared with foreign countries, Chinese researchers focus on the influence of patients’ behavior on lymphedema. For example, Liu et al. and Li et al. [12, 38] include the exercise of the affected arm and the level of physical activity. The predictors included from 3 to 7 in the study. The most common risk factors included were BMI, radiotherapy, chemotherapy, and axillary lymph node dissection.

Table 3 Characteristics of studies included in the development and validation of the model
Full size table

Of all models included, only 10 (58.82%) models were internally validated, including 6 (35.29%) bootstrap validation, 2 (12.5%) random split-sample validation, and 2 cross-validation. Four (23.53%) models were externally validated. Most studies assessed discrimination with concordance statistics (c-statistic) or the receiver operating characteristic (ROC) curve, and the ROC was 0.68~0.96 in the training cohort and 0.702~0.804 in the validation cohort. Only 11 (64.70 %) reported calibration, 5 studies assessed calibration with Hosmer–Lemeshow tests, and only the study of Wei et al. [28] assessed calibration with Brier scores to quantify calibration.

Risk of bias and applicability

More than half of the studies were at high risk of bias principally due to issues in the participants’ domain and analysis domain. The overall and domain-specific ratings for risk of bias and applicability are reported in Fig. 2.

Fig. 2
figure 2

Risk of bias and applicability assessment

Full size image

Domain 1: Participants

Although most of the data sources of the study were cohort studies (n=12, 70.59%), there is a high risk in the bias risk of the criteria for participant selection (see Fig. 2). For example, the study by Liu et al. [12] limited population and included those who had completed breast cancer surgery at least 6 months, and patients who had not been included in the study within 6 months after surgery probably cause selection bias. The study by Gross et al. [11] used a data derived from randomized controlled trials. The participants were only included if they received radiotherapy, and those who did not receive radiotherapy were not included in the study.

Domain 2: Predictors

Bias in the predictors’ domain mostly was a low concern for risk (n=10, 58.82%). For the risk of bias caused by different definitions and measurements of the predictors, the source data are mainly multi-center study data, and the model included in this study has no multi-center research data, and some studies have clarified the definition of relevant predictors. In this domain, there is a high risk of bias from the evaluation of predictive factors about knowledge of outcome data, and there is no “blinding” for predictor assessments [27, 41, 42]. The study by Yang et al. [33] is a retrospective cohort study, and it is not known whether the researchers evaluate the predictive factors in the case of unclear patient outcome data. However, the assessment of patients with lymphedema probably has bias. Kwan et al. [31] conducted a prospective cohort study and did not have an outcome in advance, and there was no risk of bias in the assessment of predictors.

Domain 3: Outcome

Of all studies, most were unclear for risk in the outcome domain (n=10, 58.82%). The unclear items mainly focus on the researchers who are unclear about the information of predictors and whether the interval between predictor assessment and outcome determination is appropriate. The included studies do not mention these two parts. Knowledge of predictor results may influence determination and lead to bias [27, 43, 44]. Most of the studies (n=10, 58.82%) used the circumference difference to diagnose lymphedema, which was a semi-objective indicator. There is no clear definition of the follow-up interval and the time to determine the outcome. The follow-up time of Penn et al. [32] was every 3 months in the first 2 years after surgery and every 6 months in the third to fifth years and once per year after that. According to related research, the follow-up interval and the time to determine the outcome is appropriate.

Domain 4: Analysis

All studies received a high concern for risk in the analysis domain. Nine signaling questions facilitate the risk of bias judgment for this domain. The risk of bias was mainly derived from questions 1, 4, 5, 6, and 8, of which 1 was the sample size, and the researchers believed the number of events per variable (EPV) should be at least 20 [45, 46]. And in Liu et al., Kim et al., Wang et al., Penn et al., Basta et al., Byun et al., and Martinez-Jaimez et al. [13, 29, 30, 32, 35, 36, 39], EPV was higher than 20. Question 4 is about participants with missing data handled: most studies did not report changes in follow-up data; only Yuan et al., Liu et al., and Li et al. [12, 14, 30] were at a low-bias risk; the study of Yuan et al. [14] has no missing data; and Liu et al. and Li et al. [12, 30] are cross-sectional analysis without missing data. Question 5 is about the selection of predictors, and only Gross et al. and Martinez-Jaimez et al. [11, 13] avoided selecting the predictors with a statistically significant univariable association. Question 8 is about the model performance. Most studies have internally validated the use of the training data indirectly, while Li et al. and Kwan et al. [30, 31] were only randomly split-sample for validation.

Applicability

The applicability of the study is assessed for the participants, predictors, and outcome domains. Only one of the models included in this study is of low concern regarding applicability. The models established by Yuan et al., Wang et al., Kwan et al., and Basta et al. [14, 31, 35, 36] were of unclear concerns regarding applicability and Kim et al. [39] were of low concerns regarding applicability. The remaining 12 studies were of high concern regarding applicability.

Discussion

In this systematic review of BCRL prediction models, we identified 17 model development studies. The development of the prediction model included was deemed to be at a high risk of bias owing to a combination of poor reporting and methodological conduct for participant selection, predictor description, and statistical methods used, but most models reported moderate to excellent predictive performance.

Several aspects could influence the occurrence of lymphedema for breast cancer. Due to the different populations, candidate predictors, and modeling methods in the primary studies, the final predictors are included in prediction models. More importantly, the methods for handling continuous and categorical predictors included in each study are different. For the level of lymph node dissection, most are divided into I~III; this classification is rarely applied in clinical practice at present. There are studies on the number of lymph node dissection stratification, but the number is very different. For example, Kim et al.’s study [39] is bounded by the number of dissections 10, and Yang et al.’s study [33] is leveled by the number of dissections 7 and 15. For radiotherapy, it can be divided into whether radiotherapy and radiotherapy area, the study of Yuan et al., Liu et al., and Gross et al. [11, 12, 14]. BMI was presented as a continuous variable, while Yang et al. [33] classified it by 18.5 and 22.9. However, most of the prediction models included easy-to-measure predictors, enhancing their applicability to clinic practice and self-management of breast cancer patients.

In recent years, there are more and more researches on predictive models in medicine [47]. However, few were validated in external populations. In our study, there are 12 BCRL prediction models in the past 5 years [11,12,13,14, 28,29,30,31,32,33,34,35], which indicate that the research on this risk prediction model is still in the progress stage. The study of the prediction model includes a search for prognostic and diagnostic factors, research on the development of the prediction model without external validation, the development of the prediction model with external validation, validation study of the prediction model, and the influence of the prediction model. External validation uses independent data to evaluate the calibration and discrimination of the model, which can include external verification types of a different time, different space, and different scenarios [48, 49]. Due to time, resources, and other reasons, researchers generally cannot access multiple data, and external validation might be limited. And data sharing is proposed to offer the possibility of making full use of all available data [50]. The model developed by Bevilacqua is a widely used prediction model, Du et al. [51] validated it by applying to 203 breast cancer patients for retrospective analysis. The results showed that the AUC value was 0.711, indicating that the model had a good discrimination ability.

The external validation of the model by different authors is one of the methods to promote the application of the model in clinical practice, but the operability of the model is worth thinking about. The comprehensive report of the parameters of the model is the primary condition for other researchers to use the existing model, and the TRIPOD statement also has corresponding requirements for presenting important data so that the model can facilitate external validation by other researchers after publication [49], such as all regression coefficients and model intercept or baseline survival at a given time point. Gross et al. [11] directly present the nomogram, and the regression coefficient or the weight of the calculation method of risk score was not reported. The Cox model constructed by Li et al. [30] only reported the calculation method of risk score, model intercept, or basic survival probability. At present, the risk prediction model mainly includes a nomogram, equation, and table. Most of the prediction models in our study included are nomograms; the studies of Martinez-Jaimez et al., Penn et al., and Kim et al. [13, 32, 39] only report the final included predictors, without the specific content of the prediction model. In addition, the detailed description of the risk prediction model can promote its clinical application. Although researchers can determine the applicability of the model by reading the research methods of the model and the explanation of the included predictors, it is more important for potential users to visually present information.

Strength and limitations

To our best knowledge, this study is the first to systematically review and appraise the prediction model for breast cancer-related lymphedema. And in our study, the research plan and information registration are carried out before the study, and the normative research and report are carried out through the Cochrane manual and CHARMS.

There are potential limitations to our study. First, due to the differences in diagnostic criteria, included predictive factors, modeling methods, and evaluation indexes, it is inappropriate to carry out the meta-analysis. Second, all model studies on BCRL prediction were included at different modeling methods, and PROBAST might not be suitable for the model evaluation of machine learning. Finally, we restricted our focus to Chinese- and English-related databases; there may be prediction models for other languages that are not examined here.

Conclusions

Several prediction models for BCRL are currently available and they all report good discriminative performance. However, these models have a high risk of bias and lack external validation. Therefore, further studies aimed at validating models externally to evaluate the extrapolation of the model. And the development of prediction models is expected to improve the transparent reporting of the study, so that the model will facilitate external validation by other researchers and contribute to the clinical application after publication. Eligible prediction models will help to identify high-risk groups of breast cancer lymphedema early, can enhance patient care, and promote rational allocation of limited medical resources.

Availability of data and materials

We have control of all data and agree to allow the journal to review our data if required.

Abbreviations

BCRL:

Breast cancer-related lymphedema

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

CHARMS:

Checklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies

PROBAST:

Prediction model Risk Of Bias Assessment Tool

ROC:

Receiver operating characteristic

AUC:

Area under the curve

TRIPOD:

Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis

References

  1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.

    Article  PubMed  Google Scholar 

  2. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021:209-249.

  3. Armer JM, Ballman KV, McCall L, Armer NC, Sun Y, Udmuangpia T, et al. Lymphedema symptoms and limb measurement changes in breast cancer survivors treated with neoadjuvant chemotherapy and axillary dissection: results of American College of Surgeons Oncology Group (ACOSOG) Z1071 (Alliance) substudy. Support Care Cancer. 2019;27:495–503.

    Article  PubMed  Google Scholar 

  4. Chachaj A, Malyszczak K, Pyszel K, Lukas J, Tarkowski R, Pudelko M, et al. Physical and psychological impairments of women with upper limb lymphedema following breast cancer treatment. Psychooncology. 2010;19:299–305.

    Article  PubMed  Google Scholar 

  5. Ao L, Li HM. Qualitative studies on the psychological experience of post-operative patients with breast cancer-related lymphedema: a systematic review. Nurs J Chin PLA. 2018;5:23–8.

    Google Scholar 

  6. Stout Gergich NL, Pfalzer LA, McGarvey C, Springer B, Gerber LH, Soballe P. Preoperative assessment enables the early diagnosis and successful treatment of lymphedema. Cancer. 2008;112:2809–19.

    Article  PubMed  Google Scholar 

  7. Torres Lacomba M, Yuste Sánchez MJ, Zapico Goñi A, Prieto Merino D, Mayoral del Moral O, Cerezo Téllez E, et al. Effectiveness of early physiotherapy to prevent lymphoedema after surgery for breast cancer: randomised, single blinded, clinical trial. BMJ (Clinical research ed). 2010;340:b5396.

    Article  PubMed Central  Google Scholar 

  8. Paolucci T, Bernetti A, Bai AV, Capobianco SV, Bonifacino A, Maggi G, et al. The recovery of reaching movement in breast cancer survivors: two different rehabilitative protocols in comparison. Eur J Phys Rehabil Med. 2021;57:137–47.

    Article  PubMed  Google Scholar 

  9. Paolucci T, Bernetti A, Bai AV, Segatori L, Monti M, Maggi G, et al. The sequelae of mastectomy and quadrantectomy with respect to the reaching movement in breast cancer survivors: evidence for an integrated rehabilitation protocol during oncological care. Support Care Cancer. 2021;29:899–908.

    Article  PubMed  Google Scholar 

  10. Lin Q, Yang T, Yongmei J, Maodie Y. Risk factors associated with breast cancer-related lymphedema: a systematic review and meta-analysis. J Gynecol Reprod Med. 2022;6:119–38.

    Google Scholar 

  11. Gross JP, Whelan TJ, Parulekar WR, Chen BE, Rademaker AW, Helenowski IB, et al. Development and validation of a nomogram to predict lymphedema after axillary surgery and radiation therapy in women with breast cancer from the NCIC CTG MA.20 randomized trial. Int J Radiat Oncol Biol Phys. 2019;105:165–73.

    Article  PubMed  Google Scholar 

  12. Liu YF, Liu JE, Zhu Y, Mak YW, Qiu H, Liu LH, et al. Development and validation of a nomogram to predict the risk of breast cancer-related lymphedema among Chinese breast cancer survivors. Support Care Cancer. 2021;29:5435–45.

    Article  PubMed  Google Scholar 

  13. Martinez-Jaimez P, Armora Verdu M, Forero CG, Alvarez Salazar S, Fuster Linares P, Monforte-Royo C, et al. Breast cancer-related lymphoedema: risk factors and prediction model. J Adv Nurs. 2021;78:765–75.

    Article  PubMed  Google Scholar 

  14. Yuan Q, Hou J, Zhou R, Liao Y, Zheng L, Jiao C, et al. Development and validation of an intraoperative nomogram to predict breast cancer-related lymphedema based on the arm lymphatics distribution. Ann Surg Oncol. 2021;28:7319–28.

    Article  PubMed  Google Scholar 

  15. Ryu E, Yim SY, Do HJ, Lim JY, Yang EJ, Shin MJ, et al. Risk of secondary lymphedema in breast cancer survivors is related to serum phospholipid fatty acid desaturation. Support Care Cancer. 2016;24:3767–74.

    Article  PubMed  Google Scholar 

  16. Fu MR, Conley YP, Axelrod D, Guth AA, Yu G, Fletcher J, et al. Precision assessment of heterogeneity of lymphedema phenotype, genotypes and risk prediction. Breast. 2016;29:231–40.

    Article  PubMed  Google Scholar 

  17. Torgbenu E, Luckett T, Buhagiar MA, Chang S, Phillips JL. Prevalence and incidence of cancer related lymphedema in low and middle-income countries: a systematic review and meta-analysis. BMC Cancer. 2020;20:604.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Rupp J, Hadamitzky C, Henkenberens C, Christiansen H, Steinmann D, Bruns F. Frequency and risk factors for arm lymphedema after multimodal breast-conserving treatment of nodal positive breast cancer - a long-term observation. Radiat Oncol. 2019;14:39.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Norman SA, Localio AR, Kallan MJ, Weber AL, Torpey HA, Potashnik SL, et al. Risk factors for lymphedema after breast cancer treatment. Cancer Epidemiol Biomarkers Prev. 2010;19:2734–46.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Tsai RJ, Dennis LK, Lynch CF, Snetselaar LG, Zamba GK, Scott-Conner C. The risk of developing arm lymphedema among breast cancer survivors: a meta-analysis of treatment factors. Ann Surg Oncol. 2009;16:1959–72.

    Article  PubMed  Google Scholar 

  21. McLaughlin SA, Staley AC, Vicini F, Thiruchelvam P, Hutchison NA, Mendez J, et al. Considerations for clinicians in the diagnosis, prevention, and treatment of breast cancer-related lymphedema: recommendations from a multidisciplinary expert ASBrS panel: part 1: definitions, assessments, education, and future directions. Ann Surg Oncol. 2017;24:2818–26.

    Article  PubMed  Google Scholar 

  22. Ferguson CM, Swaroop MN, Horick N, Skolny MN, Miller CL, Jammallo LS, et al. Impact of ipsilateral blood draws, injections, blood pressure measurements, and air travel on the risk of lymphedema for patients treated for breast cancer. J Clin Oncol. 2016;34:691–8.

    Article  PubMed  Google Scholar 

  23. Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S, et al. Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med. 2013;10:e1001381.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Debray TP, Damen JA, Snell KI, Ensor J, Hooft L, Reitsma JB, et al. A guide to systematic review and meta-analysis of prediction model performance. BMJ (Clinical research ed). 2017;356:i6460.

    Google Scholar 

  25. Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014;11:e1001744.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6:e1000100.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Int Med. 2019;170:W1–W33.

    Article  PubMed  Google Scholar 

  28. Wei X, Lu Q, Jin S, Li F, Zhao Q, Cui Y, et al. Developing and validating a prediction model for lymphedema detection in breast cancer survivors. Eur J Oncol Nurs. 2021;54:102023.

    Article  PubMed  Google Scholar 

  29. Byun HK, Chang JS, Im SH, Kirova YM, Arsene-Henry A, Choi SH, et al. Risk of lymphedema following contemporary treatment for breast cancer: an analysis of 7617 consecutive patients from a multidisciplinary perspective. Ann Surg. 2021;274:170–8.

    Article  PubMed  Google Scholar 

  30. Li F, Lu Q, Jin S, Zhao Q, Qin X, Jin S, et al. A scoring system for predicting the risk of breast cancer-related lymphedema. Int J Nurs Sci. 2020;7:21–8.

    PubMed  Google Scholar 

  31. Kwan JYY, Famiyeh P, Su J, Xu W, Kwan BYM, Jones JM, et al. Development and validation of a risk model for breast cancer-related lymphedema. JAMA Network Open. 2020;3:e2024373.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Penn IW, Chang Y-C, Chuang E, Chen C-M, Chung C-F, Kuo C-Y, et al. Risk factors and prediction model for persistent breast-cancer-related lymphedema: a 5-year cohort study. Support Care Cancer. 2019;27:991–1000.

    Article  PubMed  Google Scholar 

  33. Yang X. Risk grade prediction model for breast cancer-related lymphedema. Nanjing: Nanjing Medical University; 2019.

    Google Scholar 

  34. Fu MR, Wang Y, Li C, Qiu Z, Axelrod D, Guth AA, et al. Machine learning for detection of lymphedema among breast cancer survivors. mHealth. 2018;4:17.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Basta MN, Wu LC, Kanchwala SK, Serletti JM, Tchou JC, Kovach SJ, et al. Reliable prediction of postmastectomy lymphedema: the risk assessment tool evaluating lymphedema. Am J Surg. 2017;213:1125.

    Article  PubMed  Google Scholar 

  36. Wang L, Li HP, Liu AN, Wang DB, Yang YJ, Duan YQ, et al. A scoring system to predict arm lymphedema risk for individual Chinese breast cancer patients. Breast care (Basel, Switzerland). 2016;11:52–6.

    Article  PubMed Central  Google Scholar 

  37. Dou WJ. Establishment and evaluation of prediction models for predictng breast cancer related lymphedema. Anhui: Anhui Medical University; 2016.

    Google Scholar 

  38. Li HP, Wang L, Yang YJ, Su D. The establishment and evaluation of scoring system for predicting the risk of postoperative breast cancer-related lymphedema. Chinese. General Practice. 2014;17:2056–2061+2069.

    Google Scholar 

  39. Kim M, Kim SW, Lee SU, Lee NK, Jung SY, Kim TH, et al. A model to estimate the risk of breast cancer-related lymphedema: combinations of treatment-related factors of the number of dissected axillary nodes, adjuvant chemotherapy, and radiation therapy. Int J Radiat Oncol Biol Phys. 2013;86:498–503.

    Article  PubMed  Google Scholar 

  40. Bevilacqua JL, Kattan MW, Changhong Y, Koifman S, Mattos IE, Koifman RJ, et al. Nomograms for predicting the risk of arm lymphedema after axillary dissection in breast cancer. Ann Surg Oncol. 2012;19:2580–9.

    Article  PubMed  Google Scholar 

  41. Begg CB, McNeil BJ. Assessment of radiologic tests: control of bias and other design considerations. Radiology. 1988;167:565–9.

    Article  CAS  PubMed  Google Scholar 

  42. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Group Q-S. A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. J Clin Epidemiol. 2013;66:1093–104.

    Article  PubMed  Google Scholar 

  43. Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988;240:1285–93.

    Article  CAS  PubMed  Google Scholar 

  44. Jaeschke R, Guyatt G, Sackett DL. Users’ guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid? Evidence-Based Medicine Working Group. Jama. 1994;271:389–91.

    Article  CAS  PubMed  Google Scholar 

  45. van Smeden M, de Groot JA, Moons KG, Collins GS, Altman DG, Eijkemans MJ, et al. No rationale for 1 variable per 10 events criterion for binary logistic regression analysis. BMC Med Res Methodol. 2016;16:163.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Ogundimu EO, Altman DG, Collins GS. Adequate sample size for developing prediction models is not simply related to events per variable. J Clin Epidemiol. 2016;76:175–82.

    Article  PubMed  PubMed Central  Google Scholar 

  47. de Jong Y, Ramspek CL, Zoccali C, Jager KJ, Dekker FW, van Diepen M. Appraising prediction research: a guide and meta-review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Nephrology (Carlton). 2021;26:939–47.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Moons KG, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman DG, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart. 2012;98:691–8.

    Article  PubMed  Google Scholar 

  49. Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Int Med. 2015;162:W1–73.

    Article  PubMed  Google Scholar 

  50. Choi YI, Park SJ, Chung JW, Kim KO, Cho JH, Kim YJ, et al. Development of machine learning model to predict the 5-year risk of starting biologic agents in patients with inflammatory bowel disease (IBD): K-CDM network study. J Clin Med. 2020;9:3427.

    Article  CAS  PubMed Central  Google Scholar 

  51. Du YQ, Guan X, Chang DF, Du YY, Li ZJ. Clinical investigation of the risk prediction of postoperative lymphedema in patients after breast conserving surgery for breast cancer based on Bevilacqua model. Chin J Oper Proc Gen Surg( Electronic Edition). 2021;15:4.

    Google Scholar 

Download references

Code availability

Not applicable.

Funding

Shanghai Pudong New Area Science and Technology Development Fund Special Fund for People's Livelihood Research Medical and Health Projects (PKJ2019-Y14); Scientific research project of the Shanghai Health Commission (201940502).

Author information

Authors and Affiliations

  1. Department of Nursing, 7th Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, Shanghai, China

    Qiu Lin, Jin Yongmei & Ye Mao Die

  2. Department of Nail-Breast Hernia Surgery, 7th Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, Shanghai, China

    Tong Yang

Authors
  1. Qiu Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Yongmei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ye Mao Die
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

QL: conception, design, literature search, formal analysis, project administration, and writing—original draft; TY: formal analysis, supervision, and writing—review and editing; JYM: conception, supervision, and writing—review and editing; YMD: literature search, formal analysis. All authors approved the final version of the manuscript.

Corresponding author

Correspondence to Jin Yongmei.

Ethics declarations

Ethics approval consent to participate

This project is a systematic review, and thus, ethics approval is not applicable. Not applicable.

Consent for publication

All authors agreed in publishing this work.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

 Database Search Strategy in English.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, Q., Yang, T., Yongmei, J. et al. Prediction models for breast cancer-related lymphedema: a systematic review and critical appraisal. Syst Rev 11, 217 (2022). https://doi.org/10.1186/s13643-022-02084-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-022-02084-2

Keywords

Systematic Reviews

ISSN: 2046-4053