Micro-costing studies in the health and medical literature: protocol for a systematic review
© Xu et al.; licensee BioMed Central Ltd. 2014
Received: 21 February 2014
Accepted: 29 April 2014
Published: 21 May 2014
Micro-costing is a cost estimation method that allows for precise assessment of the economic costs of health interventions. It has been demonstrated to be particularly useful for estimating the costs of new interventions, for interventions with large variability across providers, and for estimating the true costs to the health system and to society. However, existing guidelines for economic evaluations do not provide sufficient detail of the methods and techniques to use when conducting micro-costing analyses. Therefore, the purpose of this study is to review the current literature on micro-costing studies of health and medical interventions, strategies, and programs to assess the variation in micro-costing methodology and the quality of existing studies. This will inform current practice in conducting and reporting micro-costing studies and lead to greater standardization in methodology in the future.
We will perform a systematic review of the current literature on micro-costing studies of health and medical interventions, strategies, and programs. Using rigorously designed search strategies, we will search Ovid MEDLINE, EconLit, BIOSIS Previews, Embase, Scopus, and the National Health Service Economic Evaluation Database (NHS EED) to identify relevant English-language articles. These searches will be supplemented by a review of the references of relevant articles identified. Two members of the review team will independently extract detailed information on the design and characteristics of each included article using a standardized data collection form. A third reviewer will be consulted to resolve discrepancies. We will use checklists that have been developed for critical appraisal of health economics studies to evaluate the quality and potential risk of bias of included studies.
This systematic review will provide useful information to help standardize the methods and techniques for conducting and reporting micro-costing studies in research, which can improve the quality and transparency of future studies and enhance comparability and interpretation of findings. In the long run, these efforts will facilitate clinical and health policy decision-making about resource allocation.
Systematic review registration: PROSPERO CRD42014007453.
KeywordsSystematic review Micro-costing Health Economic evaluation Cost analysis
Micro-costing is a cost estimation method that involves the ‘direct enumeration and costing out of every input consumed in the treatment of a particular patient’ . In contrast to gross-costing studies that often reflect reimbursement amounts or charges, micro-costing improves precision in cost estimation and reflects actual resource use and economic costs by collecting detailed data on resources utilized and the unit costs of those resources. Unlike gross-costing methods, which estimate average levels and are unable to provide transparent and consistent estimates, micro-costing findings reflect the true costs to the healthcare system and to society. Previous research has shown that using micro-costing methods to measure important cost components helps improve the validity and reliability of total cost estimates for hospital services, and for diagnostic or treatment interventions where costs are not available or evolving [2–5]. It is particularly useful for estimating the costs of new interventions or treatments when there is no established estimate for their aggregate costs [6, 7].
The widespread concern about increasing healthcare costs in the USA, as well as in other countries, has prompted growing interest in studying the cost, cost-effectiveness, and cost-benefit of health interventions. It is essential that the costs of health interventions be assessed rigorously in order to inform efficient resource allocation. Cost estimation is the foundation for any economic evaluation. The U.S. Panel on Cost Effectiveness in Health and Medicine has recommended micro-costing as the preferred approach to cost estimation when the alternative gross-costing estimation could cause bias . However, existing guidelines for economic evaluations do not provide sufficient detail for the methods and techniques to use when conducting micro-costing analyses .
In this study, we propose to review the current literature on micro-costing studies of health and medical interventions, strategies, and programs to assess how widely and variably micro-costing methodology has been used and the quality of existing studies. Findings from this review will help identify gaps in current application of micro-costing analyses, inform the development of guidelines for micro-costing methodology and a checklist for conducting and reporting micro-costing studies, and ultimately improve the transparency and comparability of future micro-costing studies.
The design of this systematic review follows recommendations in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement , guidance from the Campbell and Cochrane Economics Methods Group on incorporating economics evidence in systematic reviews , and criteria in the Assessment of Multiple Systematic Reviews (AMSTAR) . To help guide the development of the protocol, we conducted a preliminary assessment of the literature using a pilot list of search terms and a single database (PubMed) from March to July 2013. This preliminary assessment helped us identify the terms that authors use when referencing micro-costing methods, the type of health interventions evaluated, the study settings involved, and the types of analysis conducted. Based on results from this preliminary assessment, we refined our search terms, the study selection criteria, the data items to be extracted, and the analytic framework needed to comprehensively evaluate the quality of these studies. Details of our final study protocol are provided below.
The purpose of this study is to address the question: How has micro-costing methodology been used in studying health and medical interventions, strategies, and programs? We will take a systematic approach by reviewing micro-costing studies in the health and medical literature to understand both the scope (how widely and variably has this methodology been used) and the quality (how well has this methodology been applied and reported) of these studies. The interventions, strategies and programs may include preventive, diagnostic, and treatment approaches and technologies, as well as public health initiatives.
Protocol and registration
This systematic review has been registered at the International Prospective Register of Systematic Reviews (PROSPERO) (registration #: CRD42014007453) .
Information sources and search strategy
We will search Ovid MEDLINE, EconLit, BIOSIS Previews, Embase, Scopus, and the National Health Service Economic Evaluation Database (NHS EED) to identify relevant English-language articles. This list of bibliographic databases was determined after careful scoping searches and assessments of the 2011 Health Economic Core Library Recommendations by the U.S. National Library of Medicine .
Search strategy for MEDLINE
(microcost$ or micro-cost$).mp.
“costs and cost analysis”/or health care costs/or health expenditures/
2 and 3
(bottom-up adj5 cost$).mp.
(bottom-up adj5 accounting).mp.
(activity-based adj5 accounting).mp.
(activity-based adj5 cost$).mp.
1 or 4 or 5 or 6 or 7 or 8
limit 9 to english language
limit 10 to journal article
Eligibility criteria and study selection
We will include studies that meet the following criteria: (1) involve original economic analysis of data; (2) involve a health- or healthcare-related intervention, strategy, or program; and (3) involve the use of micro-costing methodology as defined by Gold et al. that involves the ‘direct enumeration and costing out of every input consumed in the treatment of a particular patient’. Economic analysis will include both full economic evaluations and partial economic evaluations, as well as randomized trials or other types of single effectiveness studies that evaluate cost of care . We will operationalize the Gold et al. definition for micro-costing by including studies that involve: (1) patient-level data on direct enumeration and costing of all inputs consumed with clear delineation of unit cost information; or (2) program-level direct enumeration and costing of all inputs consumed (with clear delineation of unit cost information) which was then divided across individual participants. Because complete micro-costing may not be feasible in many situations, we will also consider studies that predominantly used micro-costing in their cost estimation. We will exclude studies published only as abstracts, in a language other than English, reflecting biomedical or laboratory research, reporting quantities of resource utilization (for example, length of stay) rather than costs, focusing on identifying cost predictors (for example, analyze impact of patient sociodemographics on cost of care) rather than evaluating costs, or only partially applying the micro-costing methodology (for example, use a combination of micro-costing and gross-costing). We will also exclude reviews, conceptual papers, commentaries, letters, editorials, and papers that only report a study’s methodology without results.
Items on article screening form
Phase 1 screening:
Full length article (yes/no)
Original research article (yes/no)
Economic evaluation (yes/no)
Health- or healthcare-related (yes/no)
Other reason for exclusion (yes/no, and if yes, specify the reason)
All phase 1 screening criteria met (yes/no)
Phase 2 screening (if all phase 1 screening criteria are met):
Costing methods clear (yes/no)
Applied gross-costing (entirely gross-costing, partial gross-costing, no gross-costing, or not clear)
Applied micro-costing (yes, no, or not clear)
Extent of micro-costing (if micro-costing used): for example, whether micro-costing was used for the entire study or for part of the study
Type of micro-costing (if micro-costing used): patient-level direct enumeration and unit cost of all inputs consumed; program-level direct enumeration and unit cost of all inputs consumed, then allocated to each participant; and so on.
Applied other costing methods (yes, no, or not clear, and if yes, specify the methods used)
Whether authors referred to their study as micro-costing (yes/no)
Whether to include the article in final data extraction (yes/no)
Any additional notes about this article
The screening will be based on inspection of study titles, abstracts, and full-text articles. Evaluation of full-text articles will be important because abstracts include only limited descriptions of study design and often cannot provide sufficient detail about a study’s cost valuation methodology. All identified articles from the initial search will be independently reviewed by two members of the review team to determine their appropriateness for inclusion. Any disagreements will be discussed and resolved by consensus. If a disagreement cannot be resolved, a third researcher will be consulted to help resolve disagreement and determine whether the article is suitable for inclusion.
For each included article, we will extract detailed information on its characteristics using a standardized data collection form. The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recently issued the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) guidelines that consolidated and updated prior checklists for reporting of health economic evaluations and are endorsed by 10 biomedical journals . Our data items will be selected based on the CHEERS guidelines , guidance from the Campbell and Cochrane Economics Methods Group on incorporating economics evidence in systematic reviews , and our previous experience with systematic reviews of health economics studies and with micro-costing studies [5, 14–18].
Items on data collection form for included articles
Year of publication
Research topic and study questions
Disease category: disease name, disease classification based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) chapters (for example, infectious and parasitic diseases, neoplasms, diseases of the circulatory system, and so on)
Study population/patient characteristics: age, gender, race/ethnicity, inclusion of vulnerable population, and so on
Year(s) of study
Study perspective: societal, healthcare system, hospital, healthcare program, and so on
Type of economic analysis: cost effectiveness analysis, cost utility analysis, cost benefit analysis, cost minimization analysis, cost comparison analysis, cost outcome description, cost of illness study, and so on
Study type and design: randomized clinical trial, observational study, decision analytic modeling, other economic modeling, and so on
Methods used to define effectiveness and preferences
Cost components included: personnel costs, consumables/materials/supplies cost, medication cost, facility cost, transportation cost, productivity loss, and so on
Separate reporting of input utilization quantity and unit cost data
Method of quantity data collection: time-motion study, patient self-report, cost-accounting database, provider/staff interview, and so on
Method of unit cost data collection: invoice amount, hospital/clinic/provider price catalogue, national/regional/provincial/hospital/insurer fee schedule, human resources/payroll record, and so on
Sensitivity analyses performed: stochastic (probabilistic) sensitivity analysis, deterministic sensitivity analysis, or no sensitivity analysis
Whether the study referred to its own methodology as micro-costing
Comparison with other economic evaluation
Funding source: industry sponsored study, non-profit funding sources, no funding, or not specified
Conflict of interest: yes, no, or not reported
Notes (please record any additional features of the study that deserve consideration when evaluating its quality)
Data collection process for included articles
For each included article, two members of the review team will independently extract the data items using the data collection form described above. Disagreements will be discussed and resolved. If disagreements cannot be resolved, a third researcher will be consulted to help determine the most appropriate answer.
Assessment of study quality and risk of bias in individual studies
In order to assess the quality and potential risk of bias in individual studies, we will critically assess the quality of each included study. This will be performed by using checklists that have been developed for critical appraisal of health economics studies. The Campbell and Cochrane Economics Methods Group  has recommended the use of three established checklists for appraising reporting and methodological quality of economic evaluations: (1) the Drummond checklist ; (2) the Evers checklist ; and (3) the Phillips checklist . A systematic review of quality assessment tools for conducting and reporting health economic evaluations  also showed good evidence for inter-rater reliability and test-retest reliability for the Drummond checklist  and the Evers checklist . Therefore, we will use the Drummond checklist  and the Evers checklist  to evaluate the quality and risk of bias for single effectiveness studies, and the Phillips checklist  for assessing the quality and risk of bias for studies that relied on decision analytic modeling.
In addition, we will adopt the criteria developed by Fukuda and Immanaka  to assess the transparency of cost estimates in included economic evaluations. These criteria categorize studies into transparency levels based on whether each study clarifies what cost components are included, whether the quantity and unit price of resources are separately reported, and whether an estimate of each cost component is reported. This also helps assess the quality and potential risk of bias for each included study. However, no checklist for appraising reporting and methodological quality of micro-costing studies currently exists.
Two members of the review team will independently assess these checklists for each included article with a consensus determined through discussion. If disagreements cannot be resolved, a third researcher will be consulted to help determine the most appropriate answer. Data from these checklists will be reviewed, summarized, and reported.
Summary measures and synthesis of results
Because we focus on reviewing and evaluating the methodology and reporting quality of included studies, we will not combine the findings across individual studies. Therefore, there will not be a summary measure for this review.
Instead, we will critically assess the methodological and reporting quality of included studies and provide tabulations and narrative summaries. Data items extracted on the screening and data collection forms will be reviewed, categorized, and compared across studies. For included articles, frequency of different methodological features employed among the studies (for example, use of societal perspective, separate reporting of input utilization and unit cost data source, conducting of sensitivity analysis) will be assessed. We will also summarize characteristics of the included studies (for example, type of economic evaluation, year of study). In particular, we will evaluate and report the adoption/application of micro-costing methodology across different disease categories (for example, infectious and parasitic diseases, neoplasms, diseases of the circulatory system).
As recommended by the Campbell and Cochrane Economics Methods Group , we will use tabulations and narrative summary to report the study characteristics. Gaps and limitations in the reporting and/or methodology of these studies will be noted and discussed.
We will carefully review articles captured in our systematic review that directly compare micro-costing with other cost valuation methods, and appraise their findings. This will allow us to report comparative information on the performance of alternative cost estimation methods, which can inform future research and policy discussion.
Risk of bias across studies
Risk of bias across studies is particularly relevant when a systematic review combines evidence on treatment effects across multiple studies. However, our review seeks to evaluate the methodological and reporting quality of micro-costing studies, rather than the effect of any particular intervention, and will not combine results across studies. We will include studies across diseases and conditions, and include a wide variety of health and medical interventions, strategies, and programs. Therefore, we expect that the risk of bias across studies (for example, publication bias, selective reporting bias) will have minimal impact on our findings. Moreover, the traditional tools for assessing publication bias (for example, funnel plots) or selective reporting bias (for example, comparing outcomes listed in the methods section with those reported in the results section) have been designed for examining treatment effect of interventions , which cannot be applied to our study. Because of these considerations, our assessment of the risk of bias across studies will be based on evaluations of each study’s funding source (for example, industry sponsored study, non-profit funding sources, no funding, or not specified)  and the nature of disclosed conflict of interest for the study.
Micro-costing is a cost estimation method that enables precise estimation of economic costs for health interventions. With a growing interest in economic evaluations, we expect to see an increasing number of studies adopting this methodology. Therefore, standardizing the methods and techniques for conducting and reporting a micro-costing analysis is important. If researchers can establish and follow a standardized method for conducting and reporting micro-costing analyses, the quality and transparency of individual studies will be enhanced, and comparability across studies and interpretation of findings will improve. This systematic review will provide useful information to facilitate this effort. Specific guidelines and checklists for conducting and reporting micro-costing studies do not currently exist but can be developed and will help inform clinical and health policy decision-making about resource allocation in the long run.
We recognize that micro-costing has its own limitations [1, 6]. It is labor-intensive to collect such detailed utilization and valuation data. The results may not be widely generalizable, as the data may reflect only the practice at selected sites with specific populations. Hence, it is not always feasible or desirable to use micro-costing in economic evaluations. However, prior studies have demonstrated the usefulness and importance of this methodology in certain scenarios (for example, new interventions, extensive variability across providers, and so on) [2–7, 17, 18] and advances in electronic administrative databases (for example, proprietary cost-accounting data systems)  portend greater ease of individual-based data collection in the future. The purpose of this systematic review is to provide a critical assessment of how micro-costing has been used in the current literature. This information can help set research priorities for future economic evaluations and identify opportunities to improve the quality and reporting of future studies when micro-costing is desired or needed.
XX is an assistant professor at Yale University Department of Obstetrics, Gynecology and Reproductive Sciences. HKGN is a librarian at Yale University Cushing/Whitney Medical Library. JPR is an associate professor at University of Pennsylvania Perelman School of Medicine Department of Medical Ethics and Health Policy and a senior fellow at University of Pennsylvania Leonard Davis Institute of Health Economics.
Consolidated Health Economic Evaluation Reporting Standards
International Society for Pharmacoeconomics and Outcomes Research
- NHS EED:
National Health Service Economic Evaluation Database
National Institute on Drug Abuse
National Institutes of Health
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
International Prospective Register of Systematic Reviews.
The National Institutes of Health (NIH) (National Institute on Drug Abuse (NIDA) grant R01DA025555) provides funding support for this study. Dr. Ruger is also supported by the Patrick and Catherine Weldon Donaghue Medical Research Foundation. The funders had no role in the design of the study and will not participate in the collection, analysis, and interpretation of data, preparation or approval of any final reports or manuscripts, or decision to submit the manuscripts for publication.
- Gold MR, Siegel JE, Russell LB, Weinstein MC: Cost-effectiveness in Health and Medicine. 1996, New York, NY: Oxford University PressGoogle Scholar
- Tan SS, Rutten FF, van Ineveld BM, Redekop WK, Hakkaart-van Roijen L: Comparing methodologies for the cost estimation of hospital services. Eur J Health Econ. 2009, 10: 39-45. 10.1007/s10198-008-0101-x.View ArticlePubMedGoogle Scholar
- Heerey A, McGowan B, Ryan M, Barry M: Microcosting versus DRGs in the provision of cost estimates for use in pharmacoeconomic evaluation. Expert Rev Pharmacoecon Outcomes Res. 2002, 2: 29-33. 10.1586/14737126.96.36.199.View ArticlePubMedGoogle Scholar
- Clement Nee Shrive FM, Ghali WA, Donaldson C, Manns BJ: The impact of using different costing methods on the results of an economic evaluation of cardiac care: microcosting vs gross-costing approaches. Health Econ. 2009, 18: 377-388. 10.1002/hec.1363.View ArticlePubMedGoogle Scholar
- Ruger JP, Emmons KM, Kearney MH, Weinstein MC: Measuring the costs of outreach motivational interviewing for smoking cessation and relapse prevention among low-income pregnant women. BMC Pregnancy Childbirth. 2009, 9: 46-10.1186/1471-2393-9-46.View ArticlePubMedPubMed CentralGoogle Scholar
- Barnett PG: An improved set of standards for finding cost for cost-effectiveness analysis. Med Care. 2009, 47: S82-S88. 10.1097/MLR.0b013e31819e1f3f.View ArticlePubMedGoogle Scholar
- Frick KD: Microcosting quantity data collection methods. Med Care. 2009, 47: S76-S81. 10.1097/MLR.0b013e31819bc064.View ArticlePubMedPubMed CentralGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.View ArticlePubMedPubMed CentralGoogle Scholar
- Shemilt I, Mugford M, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, McDaid D, Vale L, Walker D: Chapter 15: Incorporating economics evidence. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. (updated March 2011). Edited by: Higgins JPT, Green S. 2011, Oxford, UK: The Cochrane Collaboration, Available from http://www.cochrane-handbook.org Google Scholar
- Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007, 7: 10-10.1186/1471-2288-7-10.View ArticlePubMedPubMed CentralGoogle Scholar
- Xu X, Lazar C, Grossetta Nardini HK, Ruger JP: Micro-costing studies in the health and medical literature: a systematic review. 2014, PROSPERO, CRD42014007453 Available from http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014007453 Google Scholar
- AcademyHealth: Health Economics Core Library Recommendations, 2011. 2011, Bethesda, MD: Funded by the U.S. National Library of Medicine, Available from http://www.nlm.nih.gov/nichsr/corelib/hecon-2011.html Google Scholar
- Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E: Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013, 16: 231-250. 10.1016/j.jval.2013.02.002.View ArticlePubMedGoogle Scholar
- Ruger JP, Emmons KM: Economic evaluations of smoking cessation and relapse prevention programs for pregnant women: a systematic review. Value Health. 2008, 11: 180-190. 10.1111/j.1524-4733.2007.00239.x.View ArticlePubMedGoogle Scholar
- Ruger JP, Lazar CM: Economic evaluation of drug abuse treatment and HIV prevention programs in pregnant women: a systematic review. Addict Behav. 2012, 37: 1-10. 10.1016/j.addbeh.2011.07.042.View ArticlePubMedGoogle Scholar
- Ruger JP, Lazar CM: Economic evaluation of pharmaco- and behavioral therapies for smoking cessation: a critical and systematic review of empirical research. Annu Rev Public Health. 2012, 33: 279-305. 10.1146/annurev-publhealth-031811-124553.View ArticlePubMedPubMed CentralGoogle Scholar
- Ruger JP, Ben Abdallah A, Cottler L: Costs of HIV prevention among out-of-treatment drug-using women: results of a randomized controlled trial. Public Health Rep. 2010, 125 (Suppl 1): 83-94.PubMedPubMed CentralGoogle Scholar
- Ruger JP, Chawarski M, Mazlan M, Luekens C, Ng N, Schottenfeld R: Costs of addressing heroin addiction in Malaysia and 32 comparable countries worldwide. Health Serv Res. 2012, 47: 865-887. 10.1111/j.1475-6773.2011.01335.x.View ArticlePubMedGoogle Scholar
- Drummond MF, Jefferson TO: Guidelines for authors and peer reviewers of economic submissions to the BMJ: the BMJ economic evaluation working party. BMJ. 1996, 313: 275-283. 10.1136/bmj.313.7052.275.View ArticlePubMedPubMed CentralGoogle Scholar
- Evers S, Goossens M, de Vet H, van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Assess Health Care. 2005, 21: 240-245.PubMedGoogle Scholar
- Philips Z, Bojke L, Sculpher M, Claxton K, Golder S: Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006, 24: 355-371. 10.2165/00019053-200624040-00006.View ArticlePubMedGoogle Scholar
- Walker DG, Wilson RF, Sharma R, Bridges J, Niessen L, Bass EB, Frick K: Best Practices for Conducting Economic Evaluations in Health Care: A Systematic Review of Quality Assessment Tools. 2012, Rockville, MD: Agency for Healthcare Research and QualityGoogle Scholar
- Fukuda H, Imanaka Y: Assessment of transparency of cost estimates in economic evaluations of patient safety programmes. J Eval Clin Pract. 2009, 15: 451-459. 10.1111/j.1365-2753.2008.01033.x.View ArticlePubMedGoogle Scholar
- Bell CM, Urbach DR, Ray JG, Bayoumi A, Rosen AB, Greenberg D, Neumann PJ: Bias in published cost effectiveness studies: systematic review. BMJ. 2006, 332: 699-703. 10.1136/bmj.38737.607558.80.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.