A comparison of international modelling methods to evaluate health economics of colorectal cancer screening: a systematic review protocol
Systematic Reviews volume 12, Article number: 14 (2023)
Colorectal cancer (CRC) is becoming an increasing health problem worldwide. However, with the help of screening, early diagnosis can reduce incidence and mortality rates. To elevate the economic burden that CRC can cause, cost-effectiveness analysis (CEA) can assist healthcare systems to make screening programmes more cost-effective and prolong survival for early-stage CRC patients. This review aims to identify different CEA modelling methods used internationally to evaluate health economics of CRC screening.
This review will systematically search electronic databases which include MEDLINE, EMBASE, Web of Science and Scopus. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidance recommendations will design the review, and the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement will be used to extract relevant data from studies retrieved. Two reviewers will screen through the evidence using the PICOS (Participant, Intervention, Comparators, Outcomes, Study Design) framework, with a third reviewer to settle any disagreements. Once data extraction and quality assessment are complete, the results will be presented qualitatively and tabulated using the CHEERS checklist.
The results obtained from the systematic review will highlight how different CRC screening programmes around the world utilise and incorporate health economic modelling methods to be more cost-effective. This information can help modellers develop CEA models which can be adapted to suit the specific screening programmes that they are evaluating.
Systematic review registration
Colorectal cancer (CRC) is the second most common cancer in females and the third most common cancer in males throughout the world . However, morbidity and early death of CRC can be prevented through early diagnosis, which can be enhanced via screening. Although extremely beneficial to the public, screening and the subsequent clinical pathways leading from this approach can be costly. In 2015, it was found that across Europe, the economic burden of CRC was €19.1 billion . To maximise the survival and long-term effects on the public’s health and potentially reallocate the costs attributable to CRC towards other parts of the economy, a cost-effective approach is needed.
CRC most commonly develops from polyps in the colon and/or rectum . These polyps can grow within the glandular tissue which is located in the intestinal lining. Most polyps are benign; however, with increased numbers and size , polyps are known to develop into precancerous diseases via the adenocarcinoma sequence where genetic changes can arise . Whilst colonoscopy is considered to be the gold standard tool of screening with a high sensitivity and specificity , non-invasive stool tests are commonly used in screening across Europe , with faecal immunochemical testing (FIT) most commonly used to detect any haemoglobin within the stool. If this test is positive, a colonoscopy is performed to examine the bowel. If polyps are identified during a colonoscopy procedure, they can be removed before developing into cancer. The primary aim of CRC screening programmes is to diagnose cancer early. Thus, to reduce the occurrence of later stages of this disease, screening programmes have been introduced to help tackle this public health problem .
CRC screening is subject to the World Health Organization (WHO) principles of screening, as first discussed by Wilson and Jungner , whereby understanding the interplay of the harms and benefits of the ability to test for the pre-clinical disease is a necessary step in health planning. Decision-makers need to consider the most cost-effective approach for their service in order to best understand whether a non-invasive diagnostic test, such as FIT, at a particular threshold, is cost-effective within a limited capacity . Crucially, these screening principles have led to the application of cost-effectiveness analyses to evaluate screening and support decision-makers in their planning and delivery of services. However, without a full understanding of the CEA modelling methods and how their use influences the delivery of screening programmes and future decision-making, unintentional bias may result from incorrectly using a modelling method that does not best capture the decision problem . Improving the understanding of the modelling approaches taken to evaluate screening programmes should create greater transparency and context for researchers, decision-makers and ultimately patients within screening programmes.
This review protocol will create a comprehensive search of cost-effectiveness analysis modelling methods for CRC screening programmes used internationally. This information will be used to examine and compare the key attributes of cost-effectiveness models. The findings will support future efforts to build more efficient models, grounded in real-world data for the evaluation of screening programmes worldwide.
The protocol of this systematic review adheres to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P 2015)  guidelines (see Additional file 1). The protocol is also registered in the PROSPERO database, the International prospective register of systematic reviews (CRD42022296113).
The PRISMA  guidance recommendations have been used to design the systematic review. The systematic review will apply the Consolidated Health Economic Evaluation Reporting Standards (CHEERS)  statement to extract relevant data from studies retrieved.
Decision problem review question
The objective of this review is to identify the modelling methods and assumptions used for colorectal cancer screening globally and to derive cost-effective analysis/cost-utility analysis/cost–benefit analysis outcomes. The following specific questions will be addressed in the review.
What type of model (for example, Markov, semi-Markov, discrete event simulation) and model structure is used in a particular CRC screening programme?
What are the model assumptions for each model structure, e.g. time horizons, LYGs, QALYs, costs and other parameters?
What is the associated background mortality with the population used for the building of this model? Are other model parameters included, such as efficiency parameters?
Defining inclusion criteria
A PICOS (Participants, Interventions, Comparator, Outcomes and Study Design) framework was used for the inclusion and exclusion criteria. The study design was specified since randomised controlled trials and cohort studies were deemed unlikely to provide suitable reports on the cost-effectiveness modelling of screening strategies.
Participants—males and females at average risk of CRC, or individuals eligible to receive a CRC screening invitation for a given screening programme
Interventions—interventions for screening for CRC, for example, faecal immunochemical test (FIT), faecal occult blood test (FOBT), flexible sigmoidoscopy, colonoscopy, computed tomography colonography (CTC), double-contrast barium enema or any other screening methods, which are not included in this list
Comparators—we expect the main comparator in most papers to be no screening compared to various screening strategies, for example, varying age ranges of the screening population and thresholds associated with quantitative FIT testing and FOBT testing
Outcomes—incremental cost-effectiveness ratio (ICER), net benefit, life years gained (LYGs), quality-adjusted life years (QALYs), costs, colonoscopy utilisation or any other unit of health gain and screening harm
Study designs—all economic evaluation academic papers which are published and discuss an economic evaluation model are eligible for inclusion in the review
Defining exclusion criteria
Participants—only human participants are to be included in the papers and not animals
Interventions—interventions used outside of the interventions listed above
Study designs—to avoid potentially high bias, case reports and case series are excluded from this review. Randomised controlled trials and cohort studies are needed for the quality evaluation of models but are not directly necessary for this review
Time frame—academic papers published between January 2011 and December 2021
Identifying research evidence
The search strategy was optimised following advice from the Specialist Medical Librarian at the host institution, who suggested using several databases to meet the needs of the review. The databases used for the planned strategy were MEDLINE, EMBASE, Web Of Science and Scopus. Searches were conducted in December 2021 using the.
MESH search terms (see Additional file 2) and updated in January 2022 for the following:
Colorectal Neoplasms OR colorectal cancer OR bowel cancer OR colorectal
screen* OR Mass Screening
Cost–Benefit Analysis OR cost-effective* OR cost-utility OR quality-adjusted life-years OR life-year* gain* OR economic evaluat* OR health technology assessment OR incremental cost-effective* ratio* OR ICER* OR cost analys* OR qaly* OR lyg*
Searches 1, 2 and 3 are then combined by AND. Only English papers were included in this review since there was no funding to translate non-English language papers. The studies which fulfil this criterion were then screened for inclusion by the PICOS criteria.
There will be three stages in the study selection process.
All results found from the initial search will be downloaded into the COVIDENCE systematic review manager  to facilitate the review management, including the removal of duplicated articles before starting the title and abstract review.
The titles and abstracts of the papers will be screened by two reviewers following the PICOS criteria.
The full text of the eligible papers will be reviewed to further confirm their eligibility.
If the two reviewers disagree on papers, a third reviewer will be introduced and a consensus of the three reviewers will be made. Also, in the case that multiple papers report the same model/method, the most recent paper with the overall model structure will be included, thus resulting in other papers with this model being discarded. The papers excluded will be deemed ineligible according to the PICOS criteria.
A sample of papers will be used to pilot the selection process using the inclusion criteria, to determine whether papers are being selected appropriately. If any noticeable or fundamental changes need to be addressed to the inclusion criteria, they can be iteratively improved by the reviewers to support the objectives.
The extracted data will use the CHEERS checklist as a benchmark to guide the collation of data, for example, extracting the study population, perspective, time horizon and discount rate from the papers. Data extraction will also focus on the model design, parameter selection and modelling methods to examine modelling practices and understand the sources of variation in methods, the likely impact on study quality and therefore its appropriateness for future application. Unfortunately, the CHEERS checklist does not include any items about potential bias within the studies. This is an important potential source of error in modelling and parameter assumptions can introduce unintended biases when reporting the results of the model . This will be a limitation of the paper and will be addressed within the discussion of the review.
This protocol aims to collate reported methods rather than examine their quality. Therefore, instead of using the Drummond checklist  which examines the methodological quality, the CHEERS checklist will be used for quality reporting of economic evaluations  as recommended by the EQUATOR Network . Papers eligible will undergo quality assessment, where detailed information on study characteristics will be collected, based on the CHEERS guideline checklist.
A PRISMA flow chart showing the number of papers remaining at each stage will be presented to document the study selection process.
As the purpose of this review is to examine the modelling methods used to evaluate the health economics of CRC screening, the results will be presented qualitatively. The studies included in the final review will be tabulated by the CHEERS checklist. Some key features will include the type of study, outcome measures and interventions. Thus, methodological study quality will be addressed, for example, the economic model choice, effectiveness measure and cost measures. Examination of the results will also collate any sensitivity analyses performed in the studies to help identify if there are any changes to the study conclusions due to the susceptibility of cost-effectiveness to key model parameters.
Results found from this systematic review will be published in a peer-reviewed journal and disseminated at international conferences and institutional academic workshops.
Earlier diagnosis of colorectal cancer as a result of screening can result in improved treatment and survival outcomes. To achieve this goal, healthcare providers can use health economic modelling methods to develop a more cost-effective approach to tackling CRC screening and tailor the methods specifically to other countries. This review will collate the modelling methods and assumptions used in CRC screening programmes internationally and thus can be a guide for modellers, for future design and to illustrate improvements, standardisation and quality evaluation of the models used within screening programmes to date.
The papers will be screened using the PICOS framework in this systematic review protocol, whilst the data extraction and reporting assessment will follow the CHEERS checklist . One limitation of this review, which may result in publication bias, is that only English language papers will be used since there was no funding for non-English papers to be translated. During the data synthesis process, the results will be qualitatively reported and tabulated in line with the CHEERS checklist. Therefore, the findings should give modellers and policymakers better insight into the modelling methods available within colorectal cancer screening, and how best to tailor such models for a defined population.
Availability of data and materials
Preferred Reporting Items for Systematic Reviews and Meta-Analysis
Consolidated Health Economic Evaluation Reporting Standards
Participants, Interventions, Comparators, Outcomes, Study Designs
World Health Organization
Life years gained
Quality-adjusted life years
Faecal immunochemical test
Faecal occult blood test
Computed tomography colonography
Incremental cost-effective ratio
Khalili F, Najafi B, Mansour-Ghanaei F, Yousefi M, Abdollahzad H, Motlagh A. Cost-effectiveness analysis of colorectal cancer screening: a systematic review. Risk Manag Healthc Policy. 2020;13:1499–512.
Henderson RH, French D, Maughan T, Adams R, Allemani C, Minicozzi P, Coleman MP, McFerran E, Sullivan R, Lawler M. The economic burden of colorectal cancer across Europe: a population-based cost-of-illness study. Lancet Gastroenterol Hepatol. 2021;6(9):709-22.
Understanding colorectal cancer - the basics. Available from: www.webmd.com/colorectal-cancer/understanding-colorectal-cancer-basics.
Winawer SJ. Colorectal cancer screening. Best Pract Res Clin Gastroenterol. 2007;21(6):1031–48.
Vogelstein B, Fearon E, Hamilton S, Kern S, Preisinger A, Leppert M, et al. Genetic alterations during colorectal-tumor development. N Engl J Med. 1988;319:525–32.
Issa IA, Noureddine M. Colorectal cancer screening: an updated review of the available options. World J Gastroenterol. 2017;23(28):5086.
Cardoso R, Guo F, Heisser T, Hackl M, Ihle P, De Schutter H, Van Damme N, Valerianova Z, Atanasov T, Májek O, Mužík J. Colorectal cancer incidence, mortality, and stage distribution in European countries in the colorectal cancer screening era: an international population-based study. Lancet Oncol. 2021;22(7):1002–13.
World Health Organization. Screening programmes: a short guide. Increase effectiveness, maximize benefits and minimize harm. 2020.
McFerran E, O’Mahony JF, Naber S, Sharp L, Zauber AG, Lansdorp-Vogelaar I, Kee F. Colorectal cancer screening within colonoscopy capacity constraints: can FIT-based programs save more lives by trading off more sensitive test cutoffs against longer screening intervals? MDM Policy Pract. 2022;7(1):23814683221097064.
Rovithis D. Do health economic evaluations using observational data provide reliable assessment of treatment effects? Heal Econ Rev. 2013;3(1):1–7.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1-9.
Page M, McKenzie J, Bossuyt P, Boutron I, Hoffmann T, Mulrow C. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;371. Doi: https://doi.org/10.1136/bmj.n71.
Husereau D, Drummond M, Augustovski F. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) explanation and elaboration: a report of the ISPOR CHEERS II Good Practices Task Force. Value Health. 2022;25(1):10–31.
Covidence systematic review software, Veritas Health Innovation, Melbourne, Australia. Available from: www.covidence.org.
Alarid-Escudero F, Kuntz KM. Potential bias associated with modeling the effectiveness of healthcare interventions in reducing mortality using an overall hazard ratio. Pharmacoeconomics. 2020;38(3):285–96.
Drummond MF, Richardson WS, O’Brien BJ, Levine M, Heyland D. Users’ guides to the medical literature: XIII. How to use an article on economic analysis of clinical practice A. Are the results of the study valid? Jama. 1997;21(277):1552–7.
Ma LL, Wang YY, Yang ZH, Huang D, Weng H, Zeng XT. Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: what are they and which is better? Mil Med Res. 2020;7(1):1–1.
The EQUATOR Network;. Available from: https://www.equator-network.org/.
Special thanks to Richard Fallis, the Specialist Medical Librarian who guided OA to efficiently search for the papers to be used in this review.
This review is not formally funded by any funding body. The lead author of the review is funded by a Department for the Economy studentship. FL is funded by Queen’s University, Belfast, and EMcF is funded by Health Data Research UK and receives funding from Cancer Focus NI to support this work.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
PRISMA-P Document 2015. PRISMA-P document is used to make the peer review process efficient and strengthen the quality of reporting.
MESH Search Terms. This document provides the MESH search terms that were included specifically in the MEDLINE database and altered to fit the other databases.
About this article
Cite this article
Adair, O., McFerran, E., Owen, T. et al. A comparison of international modelling methods to evaluate health economics of colorectal cancer screening: a systematic review protocol. Syst Rev 12, 14 (2023). https://doi.org/10.1186/s13643-023-02173-w