- Open Access
- Open Peer Review
Protocol for a systematic review of methods and cost-effectiveness findings of economic evaluations of obesity prevention and/or treatment interventions in children and adolescents
Systematic Reviewsvolume 7, Article number: 54 (2018)
Childhood obesity is a major global public health problem, with governments increasingly having to undertake various strategies to reduce excess weight in their populations. Considering the increasing number of well-conducted intervention studies in the field of childhood obesity prevention, there are relatively few published economic evaluations. The proposed systematic review will explore the methods of these economic evaluations, examine the limitations and establish the evidence base for cost-effectiveness analyses.
Systematic review methodology will be applied to identify, select and extract data from published economic evaluation studies (trial-based, non-trial based, simulation-based, decision model and trial based model economic evaluations) of obesity prevention and/or treatment interventions in children and adolescents. A systematic literature search will be conducted using bibliographic databases (MEDLINE, EMBASE, CINAHL, Web of Science, EconLit, PsycINFO, Cochrane Library, Centre for Reviews and Dissemination (CRD) and Cost-Effectiveness Analysis (CEA) Registry). The review will only include full economic evaluations. There will be no restrictions based on language, perspective, follow-up duration, sample size, country or setting. To minimise selection bias, translation of non-English language articles will be undertaken. The quality of included studies will be assessed. Following data extraction, a narrative synthesis of the results from the included studies will be undertaken. Subgroup analysis will be considered where deemed appropriate.
The findings from this review, which will include primary studies, will provide evidence to assist health policy decision makers interpret economic evaluations in this field. In addition, we will identify gaps in the current literature to inform future-related research.
Systematic review registration
Childhood obesity is a major global public health problem, which leads to health, social and emotional problems, as well as associated high health care costs . Thus, governments and policy makers are increasingly seeking to address this issue through a variety of strategies . Over the last 3 decades, the percentage of people who are overweight or obese has been increasing globally . Estimated age-standardised prevalence of obesity in children and adolescents in 2016 ranged from higher than 30% in, for example, Nauru, the Cook Islands, and Palau to lower than 2% in other countries, including Ethiopia . Obesity is as much an issue in developing as in developed countries. Although the prevalence of childhood obesity may be higher in developed countries, the rate of increase over the last decade is steeper in many developing countries .
Children who are overweight or obese run an increased risk of becoming obese in adulthood with the associated adverse health effects. However, even during childhood, they are more likely to develop early symptoms and signs of co-morbidities, hypertension and insulin resistance . The increasing prevalence of childhood obesity is also a major economic concern. Obesity leads to significant economic and societal consequences via both direct and indirect costs [6, 7]. Directs costs relate to the healthcare needs arising from the related health problems, whilst indirect costs, which are estimated to even exceed the direct costs, are a result of productivity losses (sick leave, disability, premature death) [7, 8]. Also, lower academic achievement among children with overweight and obesity could hinder their future employment prospects . Obesity prevention and treatment in children and adolescents is therefore a key public health priority. However, despite the increasing number of intervention studies, there are relatively few published economic evaluations [9,10,11].
The concept of opportunity cost plays a fundamental role in the economist’s view of costs. In many countries, the scarcity of economic resources relative to needs requires decision makers to prioritise spending in the knowledge that the use of resources in one way prevents their use in others . They need to invest in initiatives which offer the best value for money from increasingly limited public resources . Economic evaluation is a means to aid decisions about public resource allocation to maximise society’s welfare [3, 13]. To reflect a societal cost, where possible, all resource use should be measured, outlining how costs fit within a given sector, such as health, transport, education or the wider community . The UK Treasury guidance distinguishes between reporting accounting costs, to understand the flow of expenditure and resources, and reporting opportunity costs, reflecting the wider costs and benefits of interventions . Opportunity cost can be assessed directly with cost utility or cost-effectiveness studies .
Although the concept of opportunity cost is important, there can be a number of challenges with applying it within the context of economic evaluation . For example, the perspective of the study is important as this determines which costs and effects are included and the choice of comparisons are crucial in that these reflect the outcomes forgone from alternative uses of the limited resources. However, when incorporating costs and outcomes that span across multiple sectors as is commonly the case within obesity interventions, it is not always clear what society’s willingness to pay is for a non-health effect caused by a health-focused intervention or funded from a ‘health care budget’, or what the opportunity cost is of non-health resources, e.g. the value of a pound within the education sector. Also, valuation of resources for which no market exists, such as informal care, or patient time costs, requires specific methods . Due to such challenges, few studies are ever completely explicit about their estimates of opportunity costs.
Discounting enables a comparison between interventions that lead to benefits and incur costs over a number of years . Currently, NICE recommends a discount rate of 3.5% per year for both costs and outcomes . For childhood obesity prevention interventions, the effect of discounting will cause future health gains to be devalued . However, failure to discount future benefits would consider interventions to be more cost effective than they would otherwise appear .
Seven recent reviews [5, 19,20,21,22,23,24] have summarised the cost-effectiveness of obesity prevention and/or treatment interventions in young people; however, none have used or reported rigorous methods for conducting their reviews. Only two of them consider accounting for costs occurring across different sectors [5, 23]. Five of the previous reviews had restrictions based on language criteria [5, 19,20,21, 23] and four of the previous reviews explicitly excluded studies that were conducted in developing countries within their exclusion criteria [5, 19, 21, 23]. Only three of the reviews used established criteria, e.g. Drummond or Philips to assess the quality of the primary studies, and used preventative steps to minimise bias and errors in the quality assessment process [5, 20, 23]. The search strategy was adequate and appropriate in over half of the reviews (4/7) [5, 20, 22, 23]. However, several more relevant databases could have been searched to ensure that all studies were identified. Further, the latest date that the previous published reviews covered was up to November 2015 and, since then, at least 3 new economic evaluation studies of childhood obesity interventions have been published [25,26,27].
One recent review paper on child and adolescent obesity summarised the findings from 21 obesity prevention studies that included economic evaluation . The authors found that 6 interventions were dominant, in that the interventions are likely to result in both health gains and real cost savings to health services or to society; 12 were likely to be cost-effective, in that financial costs are worthwhile for the health gains and 3 were unlikely to be cost-effective. However, this brief summary did not critique the methods used for economic evaluation.
A further review of 8 cost-effectiveness analysis studies of childhood obesity prevention, which included a subset of the 21 studies reviewed in the other review, found that 1 intervention was dominant; 4 were likely to be cost-effective and 3 were unlikely to be cost-effective . However, this review also did not provide information regarding how opportunity cost was valued, and what perspective was adopted for economic evaluation.
A review of the methods used within 6 published economic evaluations of obesity prevention studies in early childhood (preschool children (< 6 years)) limited inclusion criteria to trials that included specific outcome measures (at least one of the following: BMI, waist circumference or overweight prevalence) . Furthermore, all included studies were based on behavioural interventions that targeted both diet and physical activity but none that targeted either diet or physical activity alone. It found that 3 interventions were cost-effective and 1 was not cost-effective.
Another review focused on economic evaluations of physical activity programmes as a primary prevention approach for obesity in children and adolescents . This did not provide detailed information about the numbers of interventions that were cost-effective. A review of childhood obesity interventions in Australia summarised the findings from 13 community, behavioural, pharmaceutical and surgical interventions and assessed their cost-effectiveness . In line with the Assessing Cost-Effectiveness (ACE) obesity approach , all included studies followed the same methodology for the economic evaluation allowing a comparison of cost-effectiveness between interventions. Similar to the previous reviews, the authors did not critically assess the methods used for economic evaluation.
A similar approach to the Australian review was applied in another review, in which the ACE approach was adapted to the US setting . Purposive sampling of intervention studies was applied to represent a ‘broad range of national scalable interventions’, including 4 intervention studies. Another review focused on cost of illness and cost-effectiveness of childhood obesity interventions . This review also did not provide information regarding the methods to value opportunity cost, or the perspective for the evaluation.
In summary, none of the existing reviews considered issues associated with the characteristics of the economic methods used, such as methods for collecting resource use data, how opportunity cost has been captured, reporting the largest cost drivers which impact upon cost-effectiveness and critiquing the modelling methods where appropriate. Also, there are no review studies addressing the question of how methods vary by setting, country, type of intervention or over time. These issues are important to consider when reviewing cost-effectiveness evidence . It is for these reasons that a new systematic review will be conducted. The aim of this review is to critique the methods used in economic evaluations of child and adolescent obesity and summarise cost-effectiveness evaluations of prevention and treatment interventions. Primary economic evaluation studies will be included, with no restrictions on the setting, language or country.
The primary objective is to systematically review methods of economic evaluations of obesity prevention and/or treatment interventions in children and adolescents. The review will examine the limitations and establish the evidence base for cost-effectiveness, focusing on methods for collecting resource use, valuing opportunity costs, methods for reporting costs and effectiveness across health and non-health settings, measures of effectiveness, and where appropriate, a critical review of decision-analytic models.
A secondary objective is to determine how the methods (in terms of perspective, costs included, outcomes and method of assessing cost-effectiveness) vary by setting, country, type of intervention or time period of the study with reference to any guidelines from the country in which the study is set.
The guidelines by the Cochrane Collaboration for Reviews and Centre for Reviews and Dissemination (CRD) will be followed in the systematic review [29, 30]. The systematic review protocol has been registered with the international prospective register of systematic reviews (PROSPERO) database ref. (CRD42017062236) and has been reported according to the PRISMA-P guidelines (see Additional file 1).
Since the objective of the systematic review will be to critique the methods used in economic evaluations of child and adolescent obesity and summarise cost-effectiveness evaluations of prevention and treatment interventions, studies will be included in the review if they meet the following criteria:
Types of study to be included
Full economic evaluations (studies in which both the costs and outcomes of the alternatives are examined and in which a comparison of two or more interventions or case alternatives is undertaken) including:
◦ Primary economic evaluation studies including:
Qualitative studies, conference abstracts, short notes, comments, editorials and study protocols will be excluded. Partial economic evaluations will also be excluded because the review will synthesise the evidence base for cost-effectiveness and provide an assessment of methods for full economic evaluations.
Condition or domain being studied
Condition or domain being studied is overweight or obesity in children and adolescents.
Children and adolescents aged 0–19 years at the start of the intervention and/or their parents/guardians will be included. Family based interventions will be included, in which case, the target participants will be the children. There will be no restrictions on participant characteristics such as gender, baseline weight status or country. Both developed and developing countries will be included. Any interventions to tackle obesity due to a secondary cause (i.e. Prader-Willi syndrome) will not be included.
Intervention(s) and exposure(s)
Any behavioural, community, policy or environmental interventions aimed at the treatment or prevention of overweight/obesity in children and/or adolescents will be included. Considering that prevention and treatment interventions are likely to be diverse the findings will be synthesised separately for both types of interventions and compared and contrasted if relevant. Pharmacological or surgical interventions will not be included.
There will be no restrictions on the types of comparator(s). For example, the comparator can be either no intervention or another intervention. However, the study should have a clear definition of the comparison.
There will be no restrictions on study outcomes because the purpose of the review is to assess what outcomes are reported within economic evaluations. However, potentially relevant primary outcomes will be disability-adjusted life years (DALYs), quality-adjusted life years (QALYs), effectiveness outcomes such as kilogramme (kg) weight loss, % body fat, BMI (z score), waist circumference, skinfold thickness, overweight and obesity case avoided, additional minute of MVPA, increase in physical activity and MET hour gained.
All outcomes as mentioned above.
There will be no restrictions based on language, perspective, follow-up duration, sample size or setting. Studies will be sought if published between January 2001 and the date of the searches. The year 2001 is chosen since the first study evaluating the cost-effectiveness of a childhood obesity treatment intervention was published in 2001, followed 2 years later by the first economic evaluation of a childhood obesity prevention intervention . The searches will be re-run just before the final analyses and further studies retrieved for inclusion.
The following electronic bibliographic databases of published studies will be searched:
Web of Science
Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Database of Systematic Reviews (CDSR)
Centre for Reviews and Dissemination (CRD) Databases (Database of Abstracts of Reviews of Effects (DARE), the National Health Service Economic Evaluation Databases (NHS EED), Health Technology Assessment Database (HTA))
Cost-Effectiveness Analysis (CEA) Registry
In addition, the following sources will also be used to identify potential additional studies, including grey literature sources for review:
Citation tracking in Google Scholar to retrieve further references.
Searching the relevant National Institute for Health and Care Excellence (NICE) guidelines.
The systematic scanning of the reference lists of eligible studies and review articles.
Contact with study authors where appropriate.
Grey literature such as OpenSIGLE, National Obesity Observatory, NHS Evidence, National Technical Information Service, Healthcare Management Information Consortium (HMIC) and RePEC (Economic Working papers) database.
Potential search terms
The potential search terms are systematic review, economic evaluation, cost-effectiveness, obesity, children, adolescents, prevention, treatment and intervention.
A Subject Advisor for Medicine and an Information Specialist applied a search strategy for MEDLINE, which was based on medical subject headings (MeSH) terms and text words of key papers that were identified beforehand (see Additional file 2). The search terms and text words will be adapted for use with other bibliographic databases.
The literature search results will be managed using Endnote 7 (Thomson Reuters) to facilitate removal of duplicate records, study selection, recording decisions and references.
Study selection procedure
The review will follow a two-stage method. Paper selection will be based on the inclusion and exclusion criteria:
First, two reviewers will independently screen titles and abstracts against the selection criteria.
Second, where there is doubt, the full-text version will be requested. All full-text papers will be further reviewed by two reviewers and a final decision made with respect to the inclusion/exclusion criteria.
Any disagreement or conflicting views between the reviewers over the eligibility of specific studies will be resolved by discussion or the final judgement of a third reviewer. Both stages of the selection process will be piloted and if necessary modified.
A PRISMA flow diagram will be used to illustrate the study selection processes . Details of articles excluded at the second stage will be recorded along with the reason for exclusion . To aid study selection and analysis of non-English language articles, translation either in part or in whole will be undertaken by appropriate University members. Endnote will be used to keep track of references.
Publication information, study characteristics and findings from the included studies, related to the research question, will be recorded in a standardised, pre-piloted data extraction form using Excel. Extracted information will include:
Overview and aim of the intervention
Measures of effectiveness
Length of follow-up
Methods for collecting resource use
Largest cost drivers
Total/average intervention costs
The main reviewer will extract the data. To validate the data extraction process, the process will be independently checked for completeness and accuracy by a second reviewer. Any discrepancies between the reviewers over the data extraction process will be identified and resolved by discussion or the final judgement of a third reviewer. Missing data will be requested from study authors.
Quality assessment of included studies
For this review, the Drummond checklist is not comprehensive enough to assess the quality of the economic evaluation studies included . However, the Philips checklist is only applicable for modelling studies . Therefore, the quality assessment checklist developed by the Centre for Reviews and Dissemination of the University of York, which is a slightly adapted version of the Drummond checklist, will be used . A few extra questions that are relevant to a paediatric setting will be added from the Paediatric Quality Appraisal Questionnaire (PQAQ) because this checklist is specially constructed for assessing the quality of measures for such a population . The quality assessment will provide a systematic and critical descriptive overview of key methodological elements. The scoring of the papers will be divided into 4 categories: poor quality (scoring 40–55%), good quality (scoring 55–70%), very good quality (scoring 70–85%) and excellent quality (scoring 85% or higher). To validate the quality assessment process, the process will be independently checked for completeness and accuracy by a second reviewer.
Strategy for data synthesis
Following data extraction, the reviewer will provide a narrative synthesis of the results from the included studies, structured around general characteristics, characteristics of the intervention programmes and economic findings (basic characteristics, study perspectives, resource use, cost categories, cost-effectiveness findings and sensitivity analysis), along with a critique of methods used for economic evaluation.
Analysis of subgroups or subsets
Subgroup analysis will be considered where deemed appropriate.
The review and its findings will be reported in accordance to the PRISMA guidelines . The strengths and weaknesses of the methods used for economic evaluation will be discussed. The implications of the review findings will be discussed within the context of current and future policy related to obesity.
Discussion and potential impact
Seven recent reviews have summarised the cost-effectiveness of obesity prevention and/or treatment interventions in young people; however, none have used or reported rigorous methods for conducting their reviews. This comprehensive systematic literature review will provide a critical review of the methods used in economic evaluations of child and adolescent obesity and a narrative summary of reported cost-effectiveness evaluations of prevention and treatment interventions. This critical analysis of the economic evidence can inform policies for tackling childhood obesity. We anticipate that the review will also highlight gaps in the current literature to inform future economic evaluation research in this area.
Body mass index
Cochrane Database of Systematic Reviews
Cost-Effectiveness Analysis Registry
Centre for Reviews and Dissemination
Disability-adjusted life years
Database of Abstracts of Reviews of Effects
Healthcare Management Information Consortium
Health Technology Assessment Database
Medical subject headings
Moderate to Vigorous Physical Activity
- NHS EED:
National Health Service Economic Evaluation Database
National Health Service
National Institute for Health and Clinical Excellence
Paediatric Quality Appraisal Questionnaire
Quality-adjusted life years
Basterfield L, Jones AR, Parkinson KN, Reilly J, Pearce MS, Reilly JJ, et al. Physical activity, diet and BMI in children aged 6–8 years: a cross-sectional analysis. BMJ Open. 2014;4(6):e005001.
Reilly JJ, Kelly J. Long-term impact of overweight and obesity in childhood and adolescence on morbidity and premature mortality in adulthood: systematic review. Int J Obes. 2011;35(7):891–8.
Ananthapavan J, Sacks G, Moodie M, Carter R. Economics of obesity—learning from the past to contribute to a better future. Int J Environ Res Public Health. 2014;11(4):4007–25.
Collaboration NRF. Worldwide trends in body-mass index, underweight, overweight, and obesity from 1975 to 2016: a pooled analysis of 2416 population-based measurement studies in 128·9 million children, adolescents, and adults. Lancet. 2017;390(10113):2627–42.
Doring N, Mayer S, Rasmussen F, Sonntag D. Economic evaluation of obesity prevention in early childhood: methods, limitations and recommendations. Int J Environ Res Public Health. 2016;13(9)
Au N. The health care cost implications of overweight and obesity during childhood. Health Serv Res. 2012;47(2):655–76.
Neovius K, Johansson K, Kark M, Neovius M. Obesity status and sick leave: a systematic review. Obes Rev. 2009;10(1):17–27.
Klarenbach S, Padwal R, Chuck A, Jacobs P. Population-based analysis of obesity and workforce participation. Obesity. 2006;14(5):920–7.
Blake-Lamb TL, Locks LM, Perkins ME, Baidal JAW, Cheng ER, Taveras EM. Interventions for childhood obesity in the first 1,000 days a systematic review. Am J Prev Med. 2016;50(6):780–9.
Seburg EM, Olson-Bullis BA, Bredeson DM, Hayes MG, Sherwood NE. A review of primary care-based childhood obesity prevention and treatment interventions. Curr. 2015;4(2):157–73.
Wang Y, Cai L, Wu Y, Wilson R, Weston C, Fawole O, et al. What childhood obesity prevention programmes work? A systematic review and meta-analysis. Obes Rev. 2015;16(7):547–65.
Palmer S, Raftery J. Economics notes: opportunity cost. BMJ. 1999;318(7197):1551.
Frew E. Economic evaluation of childhood obesity interventions: reflections and suggestions. PharmacoEconomics. 2016;34(8):733–40.
Johannesson M, Jonsson B, Jonsson L, Kobelt G, Zethraeus N. Why should economic evaluations of medical innovations have a societal perspective? 2009.
Treasury H. The green book, appraisal and evaluation in central government treasury guidance. London: TSO. 2003; 2011.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford university press; 2015.
NICE. Guide to the methods of technology appraisal 2013. London: National Institute for Health and Clinical Excellence; 2013.
Smith DH, Gravelle H. The practice of discounting in economic evaluations of healthcare interventions. Int J Technol Assess Health Care. 2001;17(02):236–43.
Carter R, Moodie M, Markwick A, Magnus A, Vos T, Swinburn B, et al. Assessing Cost-Effectiveness in Obesity (ACE-Obesity): an overview of the ACE approach, economic methods and cost results. BMC Public Health. 2009;9:419.
Erdol S, Mazzucco W, Boccia S. Cost effectiveness analysis of childhood obesity primary prevention programmes: a systematic review. Epidemiol Biostatistics Public Health. 2014;11(3):1–10.
Gortmaker SL, Long MW, Resch SC, Ward ZJ, Cradock AL, Barrett JL, et al. Cost effectiveness of childhood obesity interventions evidence and methods for CHOICES. Am J Prev Med. 2015;49(1):102–11.
John J, Wolfenstetter SB, Wenig CM. An economic perspective on childhood obesity: recent findings on cost of illness and cost effectiveness of interventions. Nutrition. 2012;28(9):829–39.
Korber K. Quality assessment of economic evaluations of health promotion programs for children and adolescents-a systematic review using the example of physical activity. Health Econ Rev. 2015;5(1):35.
Lobstein T, Jackson-Leach R, Moodie ML, Hall KD, Gortmaker SL, Swinburn BA, et al. Child and adolescent obesity: part of a bigger picture. Lancet. 2015;385(9986):2510–20.
Sutherland R, Reeves P, Campbell E, Lubans DR, Morgan PJ, Nathan N, et al. Cost effectiveness of a multi-component school-based physical activity intervention targeting adolescents: the ‘Physical Activity 4 Everyone’ cluster randomized trial. Int J Behav Nutr Phys Act. 2016;13:94.
Robertson W, Fleming J, Kamal A, Hamborg T, Khan KA, Griffiths F, et al. Randomised controlled trial evaluating the effectiveness and cost-effectiveness of ‘families for health’, a family-based childhood obesity treatment intervention delivered in a community setting for ages 6 to 11 years. Health Technol Assess. 2017;21(1):1–180.
Graziose MM, Koch PA, Wang YC, Lee Gray H, Contento IR. Cost-effectiveness of a nutrition education curriculum intervention in elementary schools. J Nutr Educ Behav. 2017;49(8):684–91.
Haby M, Vos T, Carter R, Moodie M, Markwick A, Magnus A, et al. A new approach to assessing the health benefit from obesity interventions in children and adolescents: the assessing cost-effectiveness in obesity project. Int J Obes. 2006;30(10):1463–75.
Khan KS, Ter Riet G, Glanville J, Sowden AJ, Kleijnen J. Undertaking systematic reviews of research on effectiveness: CRD’s guidance for carrying out or commissioning reviews: NHS Centre for Reviews and Dissemination; 2001.
Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions. Wiley; University of Florida, USA; 2011.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst. 2015;4(1):1.
Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, et al. Review of guidelines for good practice in decision-analytic modelling in health technology assessment. 2004.
Akers J, Aguiar-Ibáñez R, Baba-Akbari Sari A, Beynon S, Booth A, Burch J, et al. Systematic reviews: CRD’s guidance for undertaking reviews in health care; Centre for Reviews and Dissemination. York: University of York; 2009.
Ungar WJ, Santos MT. The Pediatric Quality Appraisal Questionnaire: an instrument for evaluation of the pediatric health economics literature. Value Health. 2003;6(5):584–94.
There is no funding documentation relevant to this study. This article represents an independent research project funded by an internal University of Birmingham PhD studentship (the College of Medical and Dental Sciences Studentship) and the systematic review forms part of that PhD project. The views expressed in this protocol are those of the authors.
Availability of data and materials
The data are available to all interested researchers upon request. Please contact the corresponding author.
MZ is a PhD student at the Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham. PA is a professor of chronic disease epidemiology and public health at the Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham. BL is a research fellow at the Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham. EF is a reader in health economics at the Health Economics Unit, Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.