Research | Open | Open Peer Review | Published:
Survival of patients with non-small cell lung cancer without treatment: a systematic review and meta-analysis
Systematic Reviewsvolume 2, Article number: 10 (2013)
Lung cancer is considered a terminal illness with a five-year survival rate of about 16%. Informed decision-making related to the management of a disease requires accurate prognosis of the disease with or without treatment. Despite the significance of disease prognosis in clinical decision-making, systematic assessment of prognosis in patients with lung cancer without treatment has not been performed. We conducted a systematic review and meta-analysis of the natural history of patients with confirmed diagnosis of lung cancer without active treatment, to provide evidence-based recommendations for practitioners on management decisions related to the disease. Specifically, we estimated overall survival when no anticancer therapy is provided.
Relevant studies were identified by search of electronic databases and abstract proceedings, review of bibliographies of included articles, and contacting experts in the field. All prospective or retrospective studies assessing prognosis of lung cancer patients without treatment were eligible for inclusion. Data on mortality was extracted from all included studies. Pooled proportion of mortality was calculated as a back-transform of the weighted mean of the transformed proportions using the random-effects model. To perform meta-analysis of median survival, published methods were used to pool the estimates as mean and standard error under the random-effects model. Methodological quality of the studies was examined.
Seven cohort studies (4,418 patients) and 15 randomized controlled trials (1,031 patients) were included in the meta-analysis. All studies assessed mortality without treatment in patients with non-small cell lung cancer (NSCLC). The pooled proportion of mortality without treatment in cohort studies was 0.97 (95% CI: 0.96 to 0.99) and 0.96 in randomized controlled trials (95% CI: 0.94 to 0.98) over median study periods of eight and three years, respectively. When data from cohort and randomized controlled trials were combined, the pooled proportion of mortality was 0.97 (95% CI: 0.96 to 0.98). Test of interaction showed a statistically non-significant difference between subgroups of cohort and randomized controlled trials. The pooled mean survival for patients without anticancer treatment in cohort studies was 11.94 months (95% CI: 10.07 to 13.8) and 5.03 months (95% CI: 4.17 to 5.89) in RCTs. For the combined data (cohort studies and RCTs), the pooled mean survival was 7.15 months (95% CI: 5.87 to 8.42), with a statistically significant difference between the two designs. Overall, the studies were of moderate methodological quality.
Systematic evaluation of evidence on prognosis of NSCLC without treatment shows that mortality is very high. Untreated lung cancer patients live on average for 7.15 months. Although limited by study design, these findings provide the basis for future trials to determine optimal expected improvement in mortality with innovative treatments.
Cancer is a major public health concern globally. It is the most frequent cause of death in economically developed countries . Among all cancers, lung cancer is the leading cause of cancer deaths worldwide . In the United States, approximately 221,130 new cases of lung cancer (14% of all cancer diagnoses) are expected in 2011 out of which 156,940 deaths (27% of cancer deaths) are estimated due to lung cancer . Given the incurable nature of lung cancer, it is considered a terminal illness with a five-year survival rate of approximately 16% .
Patients diagnosed with terminal illness such as lung cancer confront several decisions related to management of the disease. Opting for treatment (for example, chemotherapy, radiotherapy, or surgery) instead of palliation, or vice versa, is one such critical decision. Depending on the stage of the disease, potential benefits of anticancer therapy intended to palliate specific tumor-related symptoms may be at the expense of treatment-related harms and the inconvenience associated with undergoing treatment. At other times, palliative care (for example, pain medications or low dose radiotherapy)  rather than anticancer therapy may be preferable. Informed decision-making related to the management of a terminal disease thus requires accurate prognosis of the disease with or without treatment.
Briefly, prognosis refers to the likelihood of an individual developing a particular health outcome over a given period of time, based on the individual’s clinical and non-clinical profile . Accurate assessment of prognosis is key to informed decision-making. For example, if a patient is diagnosed with a terminal illness such as lung cancer, a prognostic question of critical concern to the patient, family, and the physician is how long the patient is expected to live. Other important outcomes may include disease progression, health-related quality of life, and treatment-related harms. Reliable prognostication of life expectancy can prevent subjecting patients to costly and unnecessary treatment for an unduly long period before transitioning to hospice care . This in turn can help patients and their families prepare for the impending events and plan for the patient’s remaining lifespan . Accurate prognostic information can also help physicians decide on choice of curative versus palliative treatments. For instance, if evidence shows no effect of curative treatment on disease progression, significant treatment-related harms can be avoided in favor of palliative treatments . It can help investigators avoid optimism bias, the ‘unwarranted belief in the efficacy of new therapies’  or making ‘overly optimistic assumptions regarding treatment benefits when designing RCTs’ . Accurate disease prognosis thus underpins all management decisions related to the disease, including choice of treatment, planning of supportive care, as well as allocation of resources.
Despite the significance of disease prognosis in clinical decision-making, systematic assessment of prognosis in patients with lung cancer without treatment has not been performed. We are aware of only one narrative review on the subject [4, 10]. Accordingly, this systematic review was undertaken to assess the survival of patients with a confirmed diagnosis of lung cancer without active treatment. Specifically, our aim was to estimate overall survival in lung cancer when no anticancer therapy is provided.
This systematic review was conducted as per the methods elaborated in a protocol that was developed a priori. The results are reported according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement . An ideal study design to assess the natural history of a terminal disease such as lung cancer is a cohort study. Specifically, an inception cohort, whereby a well-defined group of patients at the same disease stage is assembled at first diagnosis and followed for a defined period of time [12–14]. However, given the availability of treatments for lung cancer in recent years, it would be unethical and logistically challenging to conduct such a study. An alternative approach is to assess prognosis from retrospective lung cancer registries, case series or from the control arm of individual RCTs that compare active treatment with either no treatment, placebo, or best supportive care [5, 15].
In this review, any retrospective or prospective cohort study assessing prognosis in lung cancer without treatment and any RCT assessing the role of treatment versus no treatment, were eligible for inclusion. A study was eligible for inclusion irrespective of language or publication type.
We conducted a systematic search of MEDLINE and Cochrane library electronic databases, proceedings of major scientific meetings, and bibliographies of eligible studies to identify all relevant studies. To retrieve lung cancer prognosis studies in PubMed, we employed search strategies suggested by Wilczynski  that optimizes search sensitivity and specificity. Search details used included: ("lung neoplasms" [MeSH Terms] AND "prognosis" [All Fields] AND "cohort" [All Fields] AND "mortality" [Subheading] OR "natural course" [All Fields] OR "mortality" [All Fields] OR "survival" [All Fields] OR "survival" [MeSH Terms]). To retrieve RCTs in PubMed, we employed strategies suggested by Haynes  with the following search details: ("lung neoplasms" [MeSH Terms] AND "randomized controlled trial" [Publication Type]) AND ("palliative care" [All Fields] OR "hospice care" [All Fields] OR "supportive care" [All Fields] OR "best supportive care" [All Fields] OR "placebo" [All Fields] OR "symptomatic treatment" [All Fields] OR "no chemotherapy" [All Fields] OR "no treatment" [All Fields]). In the Cochrane library, we utilized a free text search using the term “Lung cancer” to identify RCTs focusing on lung cancer. We manually searched abstracts of the American Society of Clinical Oncology and American Society of Hematology meetings and utilized the snowballing procedure to identify other relevant studies. Studies published until June 2011 were included. No restrictions were made regarding the language of the publication.
Inclusion and exclusion criteria
A prospective or retrospective cohort study assessing overall survival as an outcome in lung cancer patients without treatment was eligible for inclusion. A RCT was included if it enrolled patients with confirmed diagnosis of lung cancer, compared treatment versus no treatment (for example, supportive care, best supportive care, palliative care, placebo, and so on), and assessed overall survival as an outcome. A study in which patients had anticancer treatment prior to enrollment and subgroup analyses were excluded. Additionally, RCTs comparing two active treatments were excluded. Two reviewers read the titles and abstracts of identified citations to identify potentially eligible studies. Full text of potentially relevant reports were retrieved and examined for eligibility. Disagreements about study inclusion or exclusion were resolved via discussion until a consensus was reached.
Data extraction was performed using a standardized data extraction form. Two reviewers independently extracted the following information from each included study: number of patients enrolled, number of deaths, median survival, funding source (industry versus public, and so on), type of centers involved (single versus multicenter, and so on.), patient demographics, patients’ baseline clinical characteristics, and type of control arm (for RCTs only). For cohort studies, we extracted data on the number of deaths and total number of patients diagnosed with lung cancer. For RCTs, we extracted data on the number of deaths (all-cause mortality) and number of participants randomized to the control arm.
Assessment of methodological quality
To evaluate the methodological quality of included studies, a modified checklist of predefined criteria was developed on four methodological domains pertinent to minimization of bias. This modified checklist uses applicable elements from existing tools (Quality in Prognosis Studies tool , Evidence-Based Medicine Group criteria for prognostic studies , Newcastle-Ottawa Quality Assessment Scale , Cochrane Collaboration risk of bias criteria ) and related studies (Hudak et al.  and Altman ). The four domains included ‘participation bias’ (extent to which study sample represents the population of interest on key characteristics), ‘attrition bias’ (extent to which loss to follow-up of the sample was not associated with key characteristics), ‘outcome measurement’ (extent to which outcome of interest is adequately measured in study participants), ‘data analysis’ and ‘reporting’ (extent to which statistical analysis and data reporting are appropriate for the study design). The modified checklist contains 11 items for cohort studies and 14 items for RCTs. For each item, a study either fulfilled a certain criterion (scored ‘Yes’) or failed to fulfill the criterion (scored ‘No’). To assess methodological quality of the studies included, we focused on the proportion that fulfilled each quality criterion (Table 1).
Data synthesis was conducted according to the study design separately as well as combined in the final stage (that is, retrospective cohort and RCT). For the purpose of meta-analysis, we used methods by Stuarts et al.  to transform the proportions into a quantity according to the Freeman-Tukey variant of the arcsine square root transformed proportion. The pooled proportion was calculated as a back-transform of the weighted mean of the transformed proportions, using the random-effects model. To perform meta-analysis of median survival, we used published methods  to pool the estimates as mean survival and standard error under the random effects model. That is, using median survival and range reported in Kaplan-Meier curve, we converted these estimates into mean survival and standard error. Heterogeneity of treatment effects between trials was assessed using the I-squared statistic  with the following thresholds for I-squared statistic values: low (25% to 49%), moderate (50% to 74%), and high (≥75%) . We explored the potential causes of heterogeneity by assessing the differences between subgroups using the test of interaction. We assessed robustness of the results by conducting sensitivity analysis with respect to methodological quality criteria of reporting, study location, and funding source. RevMan Version 5.1  was used to perform the analyses.
A flow diagram depicting the literature search process based on PRISMA  is shown in Figure 1. Initial search identified 1,562 potentially relevant citations excluding 71 duplicates. After initial screening of titles and abstracts, 1,489 records were not relevant for reasons depicted in Figure 1 and were excluded. Further assessment of full texts of remaining 73 studies led to exclusion of 51 studies. Altogether, 22 studies met the pre-defined inclusion criteria: 7 were retrospective cohort studies [20, 28–33] and 15 were RCTs [34–48].
We did not find any inception cohort study or prospective cohort study assessing prognosis of patients with lung cancer without treatment. The seven retrospective cohort studies included 4,418 patients and the fifteen RCTs enrolled 1,031 patients. Altogether, the 22 studies included 5,449 patients. All studies assessed prognosis in patients with NSCLC and were published between 1973 and 2009 (Table 2).
The median sample size in the cohort studies was 131 patients (range: 39 to 2,344 patients) with a median study period of 8 years (range: 5 to 13 years). Fifty-seven percent (4/7) and 29% (2/7) of the studies reported number of patients with stage I and stage II NSCLC, respectively. Forty-three percent (3/7) of the studies reported patients’ cancer histology. Seventy-one percent (6/7) of the studies reported patient’s gender. Forty-three percent (3/7) of the studies reported median age. Forty-three percent (3/7) of the studies were conducted at single institutions, 43% (3/7) were at multicenter national institutions, and 14% (1/7) of the studies had unspecified study location. Twenty-nine percent (2/7) of the studies were publicly funded, 14% (1/7) were funded by both public and industry, and 57% (4/7) had not specified funding sources.
The median number of patients enrolled in the RCTs was 61 patients (range: 17 to 176 patients) with a median study period of 3 years (range: 1 to 7 years). Median follow-up was reported in 33% (5/15 of RCTs) and ranged between 2.7 and 43 months. Seventy-three percent (11/15) of the studies reported number of patients with stage III/IV NSCLC. Seventy-three percent (13/15) of the studies reported patients’ cancer histology. Eighty-seven percent (13/15) of the RCTs reported patient’s gender and median age. Twenty percent (3/15) of the RCTs were conducted at single institutions, 27% (4/15) were multicenter national studies, 20% (3/15) were multicenter international studies, and 33% (5/15) did not specify study locations. Seven percent (1/15) of the RCTs were funded by the public, 33% (5/15) by industry, 7% (1/15) by both the public and industry, and 53% (8/15) had unspecified funding sources.
Types of control in RCTs
Three studies described best supportive care as comprising ‘symptomatic or palliative treatment excluding chemotherapy’ , ‘palliative radiotherapy, antibiotics, and corticosteroids’ , ‘palliative radiotherapy, opioid analgesics, and psychosocial support’ , or ‘radiation therapy, pain medication, nutritional and psychological support, thoracocentesis and/or tube thorascopy’ . Three studies described supportive care as comprising ‘analgesics, an antitussive, relief of increased intracranial pressure, palliative radiotherapy, treatment of infections and pleural effusions’ , ‘symptomatic irradiation to involved fields’ , or ‘palliative radiation, analgesics, and psychosocial/nutritional support’ . Palliative care consisted of ‘radiotherapy, antibiotics, cough suppressants, and analgesics’ . Symptomatic treatment included ‘glucocorticosteroids and anabolic steroids’ . No descriptions were provided for placebo and ‘no treatment’.
All seven cohort studies fulfilled 64% (7/11) of the quality criteria (Table 1). That is, adequate description of the population of interest for key characteristics, adequate description of study setting/geographic location, adequate participation in the study by all eligible patients, reporting of patients with missing data, a priori and objective definition of outcomes, and presentation of frequencies of most important data (for example, outcome) were reported in all studies. However, baseline sample was adequately described for key characteristics in 57% (4/7) of the studies, inclusion and exclusion criteria were adequately described in 71% (5/7) of the studies, follow-up was sufficiently long for outcome to occur in 86% (6/7) of the studies, and alpha error and/or beta error were specified a priori in 29% (2/7) of the studies.
All 15 RCTs fulfilled 36% (5/14) of the quality criteria (Table 1). That is, adequate description of the population of interest for key characteristics, adequate description of withdrawal (incomplete outcome data), a priori and objective definition of outcomes, and frequencies of most important data were reported in all RCTs. However, study setting and geographic location were adequately described in 47% (7/15) of the RCTs, baseline sample was adequately described for key characteristics in 93% (14/15) of the RCTs, inclusion and exclusion criteria were adequately described in 93% (14/15) of the RCTs, patients were balanced in all aspects except the intervention in 93% (14/15) of the RCTs, follow-up was sufficiently long for outcome to occur in 53% (8/15) of the RCTs, proportion of sample completing the study was adequate in 60% (9/15) of the RCTs, characteristics of drop-outs versus completers was provided in 13% (2/15) of the RCTs, alpha error and/or beta error was specified a priori in 47% (7/15) of the RCTs, and data analysis was based on intention-to-treat analysis principle in 53% (9/15) of the RCTs.
Data on mortality was extractable from all seven cohort studies enrolling 4,418 patients. As shown in Figure 2, the pooled proportion of mortality for patients without anticancer treatment was 0.97 (95% CI: 0.96 to 0.99). There was a statistically significant heterogeneity among pooled cohort studies (I-squared = 93%, P <0.00001).
Data on mortality was extractable from the control arm of all 15 RCTs (1,031 patients). Figure 2 shows that the pooled proportion of mortality for patients in the control arm (without active treatment) was 0.96 (95% CI: 0.94 to 0.98). There was a statistically significant heterogeneity among pooled control arm of RCTs (I-squared = 80%, P <0.00001).
Combined (Cohort and RCTs)
Pooled proportion of mortality across the 22 studies was 0.97 (95% CI: 0.96 to 0.98). Because these two designs are inherently different from each other, we conducted separate analyses. However, as shown in Figure 2, testing for subgroup differences showed no statistically significant heterogeneity between the two study designs (P = 0.28).
Data on median overall survival was extractable from six cohort studies (4,125 patients). As shown in Figure 3, the pooled mean survival was 11.94 months (95% CI: 10.07 to 13.8). There was a statistically significant heterogeneity among pooled cohort studies (I-squared = 97%, P <0.00001).
Data on median overall survival was extractable from all 15 RCTs (1,031 patients). The pooled mean survival for patients in the control arm was 5.03 months (95% CI: 4.17 to 5.89) (Figure 3). There was a statistically significant heterogeneity among pooled control arm of RCTs (I-squared = 90%, P <0.00001).
Combined (Cohort and RCTs)
Pooled proportion of mean survival across the 21 studies was 7.15 months (95% CI: 5.87 to 8.42). Test for subgroup differences showed statistically significant heterogeneity between the two study designs (I-squared = 97.7%, P <0.00001). Thus, the mean survival was influenced by study design (Figure 3).
To assess the robustness of overall results according to the study design (cohort versus RCT) as well as explore the reasons for observed heterogeneity in the pooled proportion of mortality and mean survival, we conducted additional sensitivity analyses. For both cohort studies and RCTs, we conducted sensitivity analyses according to methodological quality criteria, funding source, and study location. For RCTs only, we conducted additional sensitivity analyses according to type of control. The results of sensitivity analyses are summarized in Figure 4. Overall, the results remained unchanged in the sensitivity analyses. There were no statistically significant differences in the proportion of mortality.
In cohort studies, there was no statistically significant difference in the proportion of mortality according to any methodological criteria of reporting. With respect to study location, the pooled proportion of mortality in cohort studies conducted at multicenter national locations was 0.95 (95% CI: 0.89 to 1.01) and at single institution was 0.98 (95% CI: 0.95 to 1.01) whereas the pooled proportion of mortality in cohort studies conducted at unspecified locations was 0.87 (95% CI: 0.82 to 0.93). Test for overall interaction among these subgroups was statistically significant (P = 0.007). Regarding funding source, the pooled proportion of mortality in public-funded, unspecified funding sources, and public/industry-funded cohort studies were 1.00 (95% CI: 1.00 to 1.00), 1.00 (95% CI: 0.99 to 1.00), and 0.97 (95% CI: 0.96 to 0.98), respectively. The test for overall interaction among these subgroups was statistically significant (P <0.0001).
There was no statistically significant difference in the proportion of mortality according to methodological criteria of reporting, study location, and funding source. With respect to type of control, the pooled proportion of mortality in RCTs involving best supportive care, no treatment, placebo, supportive care, and symptomatic treatment as control were 0.90 (95% CI: 0.83 to 0.97) and in RCTs involving supportive care as control was 0.96 (95% CI: 0.92 to 1.00), 0.86 (95% CI: 0.81 to 0.92), 1.00 (95% CI: 0.99 to 1.01), 0.96 (95% CI: 0.92 to 1.00), and 0.97 (95% CI: 0.92 to 1.03), respectively. Test for overall interaction among these subgroups was statistically significant (P <0.00001).
We considered performing subgroup analysis based on median follow-up. However, only one cohort study  and five RCTs [38, 39, 41, 42, 45] reported these data. The median follow-up in the cohort study was 40 months whereas in the RCTs, the median follow-up was 2.7, 13, 26, 40, and 40 months, respectively. Given that survival of patients with cancer differs by stage, we considered performing analysis by cancer stage (I, II, III, versus IV). However, only two cohort studies (29%) and two RCTs (13%) reported data by stage. Thus, it was not possible to perform meta-analysis based on the four stages.
This is the first study to provide the most comprehensive data related to survival of lung cancer patients. The results show that prognosis of patients with lung cancer not receiving treatment is very high. Regardless of the study design (that is, cohort versus RCTs) the findings were similar and did not differ according to disease severity. For example, all cohort studies assessed mortality in patients with early stage NSCLC (stage I/II) and all RCTs enrolled patients with advance stage NSCLC (stage III/IV). However, the mortality rates from cohort and RCTs essentially remained unchanged (97% versus 96%). Overall, included studies were of moderate methodological quality.
The findings from our study are similar to the study by Detterbeck and Gibson  which showed a 98% five-year mortality rate for stage I/II lung cancer (median survival = 10 months). Despite the obvious similarity in results our study is significantly different in the conduct and analysis. For example, the study by Detterbeck and Gibson  did not employ a systematic approach to data collection and analysis (that is, not a systematic review) and therefore the findings are not reproducible. The similarity in findings might be an artifact of play of chance. Furthermore, quantitative synthesis of results across included studies was not performed in the study by Detterbeck and Gibson  which was undertaken in our study. Another unique feature of our study lies in the inclusion of RCTs in addition to retrospective studies. None of the previous studies on the topic have utilized the approach of pooling data from one arm of RCTs for accurate assessment of prognosis. Therefore, due to the reasons enumerated, the study presented here is the most comprehensive to date in reporting survival of NSCLC patients without treatment.
Our study has some limitations. For example, we observed a statistically significant heterogeneity in pooled results which we could not explain through subgroup analyses. We suspect that the observed heterogeneity is clinical and not methodological. Specifically in the case of RCTs, the constitution of control arm varied across pooled studies. For example, five RCTs employed best supportive care as control, four had supportive care, two had placebo, two had no treatment and another two had symptomatic treatment as control. While, the definitions are very clear on placebo and no treatment, which was also explained by the sensitivity analyses (I-squared = 0% for both subgroups), the composition of best supportive care, supportive care, and symptomatic treatment varied significantly across pooled studies. In these cases, the observed heterogeneity remained unexplained. Also, whereas a significant number of studies (11 of 15 RCTs) included had some form of treatment even if used for the purpose of symptom palliation, we were unable to assess the effect of the supportive treatment on survival based on available data. Thus, the clinical heterogeneity may be attributed to stage of disease and/or differential therapies. The studies included had different follow-up periods, however, due to limited data reported, we were unable to perform subgroup analysis based on median follow-up. How much this difference accounts for results is thus not known. It is also unclear whether results would have changed had we performed the analysis by cancer stages (I, II, III, versus IV) as opposed to by stage I/II and III/IV. The former was not possible due to the limited data reported. Because studies included enrolled patients with NSCLC, our results may not entirely apply to all lung cancer patients. However, it is important to note that a systematic review is limited by the availability of data and we did include all available data related to prognosis of NSCLC patients without treatment.
The aim of this review was to estimate overall survival (natural history) in lung cancer when no anticancer therapy is provided. Our study shows that untreated lung cancer patients live on average for 7.15 months (95% CI: 5.87 to 8.42). Comprehensive data on the natural history of lung cancer is required for informed decision making by patients, physicians and researchers. For patients, it serves as the basis for their expected outcome with and without treatment, which is critical in cases of diseases with high mortality. For physicians, accurate and reliable information facilitates shared decision making with patients, related to choice of interventions or no intervention. Most importantly, the findings are needed by researchers to avoid optimism bias . A study by Djulbegovic et al.  assessed the role of optimism bias in a cohort of trials conducted by the National Cancer Institute Cooperative Groups and concluded that optimism bias is the primary reason for inconclusive findings in the context of RCTs. Similarly, a systematic review by Gan and colleagues  showed that investigators tend to make overly optimistic assumptions regarding treatment benefits when designing RCTs. Accordingly, the results from our study will help researchers determine the most optimal rate of expected improvement in mortality with innovative/newer treatments.
Non-small cell lung cancer
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Randomized controlled trial.
Jemal A: Global cancer statistics. CA Cancer J Clin. 2011, 61 (2): 69-90. 10.3322/caac.20107.
Ferlay J: Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. Int J Cancer. 2010, 127 (12): 2893-2917. 10.1002/ijc.25516.
American Cancer Society: Cancer Facts & Figures 2012. 2012, Atlanta: American Cancer Society
Detterbeck FC, Gibson CJ: Turning gray: the natural history of lung cancer over time. J Thorac Oncol. 2008, 3 (7): 781-792. 10.1097/JTO.0b013e31817c9230.
Moons KGM: Prognosis and prognostic research: what, why, and how?. BMJ. 2009, 338: b375-10.1136/bmj.b375.
Christakis NA, Lamont EB: Extent and determinants of error in doctors' prognoses in terminally ill patients: prospective cohort study. BMJ. 2000, 320 (7233): 469-472. 10.1136/bmj.320.7233.469.
Mackillop WJ, Quirt CF: Measuring the accuracy of prognostic judgments in oncology. J Clin Epidemiol. 1997, 50 (1): 21-29. 10.1016/S0895-4356(96)00316-2.
Djulbegovic B: Optimism bias leads to inconclusive results - an empirical study. J Clin Epidemiol. 2011, 64 (6): 583-593. 10.1016/j.jclinepi.2010.09.007.
Gan HK: Assumptions of expected benefits in randomized phase III trials evaluating systemic treatments for cancer. J Natl Cancer Inst. 2012, 104 (8): 590-598. 10.1093/jnci/djs141.
Daugherty CK, Hlubocky FJ: What are terminally ill cancer patients told about their expected deaths? A study of cancer physicians' self-reports of prognosis disclosure. J Clin Oncol. 2008, 26 (36): 5988-5993. 10.1200/JCO.2008.17.2221.
Moher D: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6 (7): e1000097-10.1371/journal.pmed.1000097.
Hemingway H, Riley RD, Altman DG: Ten steps towards improving prognosis research. BMJ. 2009, 339: b4184-10.1136/bmj.b4184.
Hemingway H: Prognosis research: why is Dr. Lydgate still waiting?. J Clin Epidemiol. 2006, 59 (12): 1229-1238. 10.1016/j.jclinepi.2006.02.005.
Moons KG: Prognosis and prognostic research: what, why, and how?. BMJ. 2009, 338: b375-10.1136/bmj.b375.
Chalmers I: Table: Steps in finding evidence (‘Level’) for different types of question. Available at http://www.cebm.net/mod_product/design/files/CEBM-Levels-of-Evidence-2.pdf
Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey. BMC Med. 2004, 2: 23-10.1186/1741-7015-2-23.
Haynes RB: Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey. BMJ. 2005, 330 (7501): 1179-10.1136/bmj.38446.498542.8F.
Hayden JA, Cote P, Bombardier C: Evaluation of the quality of prognosis studies in systematic reviews. Ann Intern Med. 2006, 144 (6): 427-437.
Laupacis A: Users guides to the medical literature V. How to use an article about prognosis. JAMA. 1994, 272 (3): 234-237. 10.1001/jama.1994.03520030076032.
Stang A: Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010, 25 (9): 603-605. 10.1007/s10654-010-9491-z.
Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2 [updated September 2009]. The Cochrane Collaboration. 2009, Available from http://www.cochrane-handbook.org
Hudak PL, Cole DC, Frank JW: Perspectives on prognosis of soft tissue musculoskeletal disorders. Int J Rehabil Res. 1998, 21 (1): 29-40. 10.1097/00004356-199803000-00003.
Altman DG: Systematic reviews of evaluations of prognostic variables. BMJ. 2001, 323 (7306): 224-228. 10.1136/bmj.323.7306.224.
Stuart A: Kendall's advanced theory of statistics. 1994, 102 (1): 173-180.
Hozo SP, Djulbegovic B, Hozo I: Estimating the mean and variance from the median, range, and the size of a sample. BMC Med Res Meth. 2005, 5: 13-10.1186/1471-2288-5-13.
Higgins JPT: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.
The Cochrane Collaboration: Review Manager (RevMan). 2008, Copenhagen: The Nordic Cochrane Centre
Chadha AS: Survival in untreated early stage non-small cell lung cancer. Anticancer Res. 2005, 25 (5): 3517-3520.
Henschke CI: Small stage I cancers of the lung: genuineness and curability. Lung Cancer. 2003, 39 (3): 327-330. 10.1016/S0169-5002(02)00503-2.
Hyde L: Natural course of inoperable lung cancer. Chest. 1973, 64 (3): 309-312. 10.1378/chest.64.3.309.
McGarry RC: Observation-only management of early stage, medically inoperable lung cancer: poor outcome. Chest. 2002, 121 (4): 1155-1158. 10.1378/chest.121.4.1155.
Vrdoljak E: Survival analysis of untreated patients with non-small cell lung cancer. Chest. 1994, 106 (6): 1797-1800. 10.1378/chest.106.6.1797.
Wisnivesky JP, Halm EA: Sex differences in lung cancer survival: do tumors behave differently in elderly women?. J Clin Oncol. 2007, 25 (13): 1705-1712. 10.1200/JCO.2006.08.1455.
Anderson H: Gemcitabine plus best supportive care (BSC) versus BSC in inoperable non-small cell lung cancer - a randomized trial with quality of life as the primary outcome. Br J Cancer. 2000, 83 (4): 447-453. 10.1054/bjoc.2000.1307.
Cartei G: Cisplatin-cyclophosphamide-mitomycin combination chemotherapy with supportive care versus supportive care alone for treatment of metastatic non-small cell lung cancer. J Natl Cancer Inst. 1993, 85 (10): 794-800. 10.1093/jnci/85.10.794.
Cellerino R: A randomized trial of alternating chemotherapy versus best supportive care in advanced non-small cell lung cancer. J Clin Oncol. 1991, 9 (8): 1453-1461.
Cormier Y: Benefits of polychemotherapy in advanced non-small cell bronchogenic carcinoma. Cancer. 1982, 50 (5): 845-849. 10.1002/1097-0142(19820901)50:5<845::AID-CNCR2820500507>3.0.CO;2-S.
Cullen MH: Mitomycin, ifosfamide, and cisplatin in unresectable non–small cell lung cancer: effects on survival and quality of life. J Clin Oncol. 1999, 17 (10): 3188-3194.
The Elderly Lung Cancer Vinorelbine Italian Study Group: Effects of vinorelbine on quality of life and survival of elderly patients with advanced non-small cell lung cancer. J Natl Cancer Inst. 1999, 91 (1): 66-72.
Ganz PA: Supportive care versus supportive care and combination chemotherapy in metastatic non-small cell lung cancer. Does chemotherapy make a difference?. Cancer. 1989, 63 (7): 1271-1278. 10.1002/1097-0142(19890401)63:7<1271::AID-CNCR2820630707>3.0.CO;2-6.
Goss G: Randomized phase II study of gefitinib compared with placebo in chemotherapy-naive patients with advanced non-small cell lung cancer and poor performance status. J Clin Oncol. 2009, 27 (13): 2253-2260. 10.1200/JCO.2008.18.4408.
Helsing M: Quality of life and survival in patients with advanced non-small cell lung cancer receiving supportive care plus chemotherapy with carboplatin and etoposide or supportive care only. A multicenter randomized phase III trial. Eur J Canc. 1998, 34 (7): 1036-1044. 10.1016/S0959-8049(97)10122-8.
Kaasa S: Symptomatic treatment versus combination chemotherapy for patients with extensive non-small cell lung cancer. Cancer. 1991, 67 (10): 2443-2447. 10.1002/1097-0142(19910515)67:10<2443::AID-CNCR2820671008>3.0.CO;2-K.
Laing AH: Treatment of inoperable carcinoma of bronchus. The Lancet. 1975, 306 (7946): 1161-1164. 10.1016/S0140-6736(75)92654-9.
Leung WT: Combined chemotherapy and radiotherapy versus best supportive care in the treatment of inoperable non-small cell lung cancer. Oncology. 1992, 49 (5): 321-326. 10.1159/000227065.
Quoix E: Is chemotherapy with cisplatin useful in non-small cell bronchial cancer at staging IV? Results of a randomized study. Bull Cancer. 1991, 78 (4): 341-346.
Rapp E: Chemotherapy can prolong survival in patients with advanced non-small cell lung cancer - report of a Canadian multicenter randomized trial. J Clin Oncol. 1988, 6 (4): 633-641.
Thongprasert S: Relationship between quality of life and clinical outcomes in advanced non-small cell lung cancer: best supportive care (BSC) versus BSC plus chemotherapy. Lung Cancer. 1999, 24 (1): 17-24. 10.1016/S0169-5002(99)00017-3.
Anderson G, Payne H: Response rate and toxicity of etoposide (VP-16) in squamous carcinoma of the lung: report from the Lung Cancer Treatment Study Group. Semin Oncol. 1985, 12 (1 Suppl 2): 21-22.
Kuijpers T: Systematic review of prognostic cohort studies on shoulder disorders. Pain. 2004, 109 (3): 420-431. 10.1016/j.pain.2004.02.017.
Supported by the US DoA grant #W81 XWH 09-2-0175 (PI: Djulbegovic).
The authors declare that they have no competing interests.
HW and RM were responsible for the study’s conception and design. HW acquired, analyzed and interpreted the data. HW drafted the manuscript while all other authors revised it critically for important intellectual content before giving approval of the final version to be published. All authors read and approved the final manuscript.