Micro-costing studies in the health and medical literature: protocol for a systematic review
Systematic Reviews volume 3, Article number: 47 (2014)
Micro-costing is a cost estimation method that allows for precise assessment of the economic costs of health interventions. It has been demonstrated to be particularly useful for estimating the costs of new interventions, for interventions with large variability across providers, and for estimating the true costs to the health system and to society. However, existing guidelines for economic evaluations do not provide sufficient detail of the methods and techniques to use when conducting micro-costing analyses. Therefore, the purpose of this study is to review the current literature on micro-costing studies of health and medical interventions, strategies, and programs to assess the variation in micro-costing methodology and the quality of existing studies. This will inform current practice in conducting and reporting micro-costing studies and lead to greater standardization in methodology in the future.
We will perform a systematic review of the current literature on micro-costing studies of health and medical interventions, strategies, and programs. Using rigorously designed search strategies, we will search Ovid MEDLINE, EconLit, BIOSIS Previews, Embase, Scopus, and the National Health Service Economic Evaluation Database (NHS EED) to identify relevant English-language articles. These searches will be supplemented by a review of the references of relevant articles identified. Two members of the review team will independently extract detailed information on the design and characteristics of each included article using a standardized data collection form. A third reviewer will be consulted to resolve discrepancies. We will use checklists that have been developed for critical appraisal of health economics studies to evaluate the quality and potential risk of bias of included studies.
This systematic review will provide useful information to help standardize the methods and techniques for conducting and reporting micro-costing studies in research, which can improve the quality and transparency of future studies and enhance comparability and interpretation of findings. In the long run, these efforts will facilitate clinical and health policy decision-making about resource allocation.
Systematic review registration: PROSPERO CRD42014007453.
Micro-costing is a cost estimation method that involves the ‘direct enumeration and costing out of every input consumed in the treatment of a particular patient’ . In contrast to gross-costing studies that often reflect reimbursement amounts or charges, micro-costing improves precision in cost estimation and reflects actual resource use and economic costs by collecting detailed data on resources utilized and the unit costs of those resources. Unlike gross-costing methods, which estimate average levels and are unable to provide transparent and consistent estimates, micro-costing findings reflect the true costs to the healthcare system and to society. Previous research has shown that using micro-costing methods to measure important cost components helps improve the validity and reliability of total cost estimates for hospital services, and for diagnostic or treatment interventions where costs are not available or evolving [2–5]. It is particularly useful for estimating the costs of new interventions or treatments when there is no established estimate for their aggregate costs [6, 7].
The widespread concern about increasing healthcare costs in the USA, as well as in other countries, has prompted growing interest in studying the cost, cost-effectiveness, and cost-benefit of health interventions. It is essential that the costs of health interventions be assessed rigorously in order to inform efficient resource allocation. Cost estimation is the foundation for any economic evaluation. The U.S. Panel on Cost Effectiveness in Health and Medicine has recommended micro-costing as the preferred approach to cost estimation when the alternative gross-costing estimation could cause bias . However, existing guidelines for economic evaluations do not provide sufficient detail for the methods and techniques to use when conducting micro-costing analyses .
In this study, we propose to review the current literature on micro-costing studies of health and medical interventions, strategies, and programs to assess how widely and variably micro-costing methodology has been used and the quality of existing studies. Findings from this review will help identify gaps in current application of micro-costing analyses, inform the development of guidelines for micro-costing methodology and a checklist for conducting and reporting micro-costing studies, and ultimately improve the transparency and comparability of future micro-costing studies.
The design of this systematic review follows recommendations in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement , guidance from the Campbell and Cochrane Economics Methods Group on incorporating economics evidence in systematic reviews , and criteria in the Assessment of Multiple Systematic Reviews (AMSTAR) . To help guide the development of the protocol, we conducted a preliminary assessment of the literature using a pilot list of search terms and a single database (PubMed) from March to July 2013. This preliminary assessment helped us identify the terms that authors use when referencing micro-costing methods, the type of health interventions evaluated, the study settings involved, and the types of analysis conducted. Based on results from this preliminary assessment, we refined our search terms, the study selection criteria, the data items to be extracted, and the analytic framework needed to comprehensively evaluate the quality of these studies. Details of our final study protocol are provided below.
The purpose of this study is to address the question: How has micro-costing methodology been used in studying health and medical interventions, strategies, and programs? We will take a systematic approach by reviewing micro-costing studies in the health and medical literature to understand both the scope (how widely and variably has this methodology been used) and the quality (how well has this methodology been applied and reported) of these studies. The interventions, strategies and programs may include preventive, diagnostic, and treatment approaches and technologies, as well as public health initiatives.
Protocol and registration
This systematic review has been registered at the International Prospective Register of Systematic Reviews (PROSPERO) (registration #: CRD42014007453) .
Information sources and search strategy
We will search Ovid MEDLINE, EconLit, BIOSIS Previews, Embase, Scopus, and the National Health Service Economic Evaluation Database (NHS EED) to identify relevant English-language articles. This list of bibliographic databases was determined after careful scoping searches and assessments of the 2011 Health Economic Core Library Recommendations by the U.S. National Library of Medicine .
We will use the search strategy outlined in Table 1 for MEDLINE. The search strategies for other databases will be similar but tailored slightly to fit each specific database. Search results from the various databases will be combined and results will be de-duplicated. This will be supplemented by a review of the references of relevant articles identified. Auto-alerts will provide literature updates while the data are being analyzed.
Eligibility criteria and study selection
We will include studies that meet the following criteria: (1) involve original economic analysis of data; (2) involve a health- or healthcare-related intervention, strategy, or program; and (3) involve the use of micro-costing methodology as defined by Gold et al. that involves the ‘direct enumeration and costing out of every input consumed in the treatment of a particular patient’. Economic analysis will include both full economic evaluations and partial economic evaluations, as well as randomized trials or other types of single effectiveness studies that evaluate cost of care . We will operationalize the Gold et al. definition for micro-costing by including studies that involve: (1) patient-level data on direct enumeration and costing of all inputs consumed with clear delineation of unit cost information; or (2) program-level direct enumeration and costing of all inputs consumed (with clear delineation of unit cost information) which was then divided across individual participants. Because complete micro-costing may not be feasible in many situations, we will also consider studies that predominantly used micro-costing in their cost estimation. We will exclude studies published only as abstracts, in a language other than English, reflecting biomedical or laboratory research, reporting quantities of resource utilization (for example, length of stay) rather than costs, focusing on identifying cost predictors (for example, analyze impact of patient sociodemographics on cost of care) rather than evaluating costs, or only partially applying the micro-costing methodology (for example, use a combination of micro-costing and gross-costing). We will also exclude reviews, conceptual papers, commentaries, letters, editorials, and papers that only report a study’s methodology without results.
Search results from the various databases will be combined and results will be de-duplicated. A two-phase screening process will be implemented (Table 2). The first phase will screen for full-length, original research articles that involved economic evaluation of a health- or healthcare-related topic. Then, for articles that fulfill the criteria from the first phase screening, we will assess the type of costing methods used and the extent to which micro-costing technique was applied in the cost estimation. This detailed screening will allow us to categorize, summarize, and report reasons for excluded studies. Moreover, we will be able to provide information on the nature of articles that involve some enumeration of resource utilization and unit cost data but do not fully meet the definition of micro-costing methodology  (for example, direct enumeration and unit cost data for some inputs consumed plus gross-costing or additional costing methodologies for other cost components).
The screening will be based on inspection of study titles, abstracts, and full-text articles. Evaluation of full-text articles will be important because abstracts include only limited descriptions of study design and often cannot provide sufficient detail about a study’s cost valuation methodology. All identified articles from the initial search will be independently reviewed by two members of the review team to determine their appropriateness for inclusion. Any disagreements will be discussed and resolved by consensus. If a disagreement cannot be resolved, a third researcher will be consulted to help resolve disagreement and determine whether the article is suitable for inclusion.
For each included article, we will extract detailed information on its characteristics using a standardized data collection form. The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recently issued the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) guidelines that consolidated and updated prior checklists for reporting of health economic evaluations and are endorsed by 10 biomedical journals . Our data items will be selected based on the CHEERS guidelines , guidance from the Campbell and Cochrane Economics Methods Group on incorporating economics evidence in systematic reviews , and our previous experience with systematic reviews of health economics studies and with micro-costing studies [5, 14–18].
A draft list of data items is presented in Table 3. We specifically tailored this list to suit the aim of this review, that is, to focus on each study’s cost estimation methods. For example, we plan to record whether the study separately reported input utilization quantity and unit cost data which are important for the conduct and interpretation of micro-costing analysis , method of quantity data collection used (for example, time-motion study, patient self-report, cost-accounting database, or provider/staff interview), and method of unit cost data collection (for example, invoice amount, or standard fee schedule). Any additional features of a study that deserve consideration when evaluating its quality will be noted in a ‘notes’ data field. We will first pilot a data collection form containing these data items and modify/refine it as needed prior to its final use.
Data collection process for included articles
For each included article, two members of the review team will independently extract the data items using the data collection form described above. Disagreements will be discussed and resolved. If disagreements cannot be resolved, a third researcher will be consulted to help determine the most appropriate answer.
Assessment of study quality and risk of bias in individual studies
In order to assess the quality and potential risk of bias in individual studies, we will critically assess the quality of each included study. This will be performed by using checklists that have been developed for critical appraisal of health economics studies. The Campbell and Cochrane Economics Methods Group  has recommended the use of three established checklists for appraising reporting and methodological quality of economic evaluations: (1) the Drummond checklist ; (2) the Evers checklist ; and (3) the Phillips checklist . A systematic review of quality assessment tools for conducting and reporting health economic evaluations  also showed good evidence for inter-rater reliability and test-retest reliability for the Drummond checklist  and the Evers checklist . Therefore, we will use the Drummond checklist  and the Evers checklist  to evaluate the quality and risk of bias for single effectiveness studies, and the Phillips checklist  for assessing the quality and risk of bias for studies that relied on decision analytic modeling.
In addition, we will adopt the criteria developed by Fukuda and Immanaka  to assess the transparency of cost estimates in included economic evaluations. These criteria categorize studies into transparency levels based on whether each study clarifies what cost components are included, whether the quantity and unit price of resources are separately reported, and whether an estimate of each cost component is reported. This also helps assess the quality and potential risk of bias for each included study. However, no checklist for appraising reporting and methodological quality of micro-costing studies currently exists.
Two members of the review team will independently assess these checklists for each included article with a consensus determined through discussion. If disagreements cannot be resolved, a third researcher will be consulted to help determine the most appropriate answer. Data from these checklists will be reviewed, summarized, and reported.
Summary measures and synthesis of results
Because we focus on reviewing and evaluating the methodology and reporting quality of included studies, we will not combine the findings across individual studies. Therefore, there will not be a summary measure for this review.
Instead, we will critically assess the methodological and reporting quality of included studies and provide tabulations and narrative summaries. Data items extracted on the screening and data collection forms will be reviewed, categorized, and compared across studies. For included articles, frequency of different methodological features employed among the studies (for example, use of societal perspective, separate reporting of input utilization and unit cost data source, conducting of sensitivity analysis) will be assessed. We will also summarize characteristics of the included studies (for example, type of economic evaluation, year of study). In particular, we will evaluate and report the adoption/application of micro-costing methodology across different disease categories (for example, infectious and parasitic diseases, neoplasms, diseases of the circulatory system).
As recommended by the Campbell and Cochrane Economics Methods Group , we will use tabulations and narrative summary to report the study characteristics. Gaps and limitations in the reporting and/or methodology of these studies will be noted and discussed.
We will carefully review articles captured in our systematic review that directly compare micro-costing with other cost valuation methods, and appraise their findings. This will allow us to report comparative information on the performance of alternative cost estimation methods, which can inform future research and policy discussion.
Risk of bias across studies
Risk of bias across studies is particularly relevant when a systematic review combines evidence on treatment effects across multiple studies. However, our review seeks to evaluate the methodological and reporting quality of micro-costing studies, rather than the effect of any particular intervention, and will not combine results across studies. We will include studies across diseases and conditions, and include a wide variety of health and medical interventions, strategies, and programs. Therefore, we expect that the risk of bias across studies (for example, publication bias, selective reporting bias) will have minimal impact on our findings. Moreover, the traditional tools for assessing publication bias (for example, funnel plots) or selective reporting bias (for example, comparing outcomes listed in the methods section with those reported in the results section) have been designed for examining treatment effect of interventions , which cannot be applied to our study. Because of these considerations, our assessment of the risk of bias across studies will be based on evaluations of each study’s funding source (for example, industry sponsored study, non-profit funding sources, no funding, or not specified)  and the nature of disclosed conflict of interest for the study.
Micro-costing is a cost estimation method that enables precise estimation of economic costs for health interventions. With a growing interest in economic evaluations, we expect to see an increasing number of studies adopting this methodology. Therefore, standardizing the methods and techniques for conducting and reporting a micro-costing analysis is important. If researchers can establish and follow a standardized method for conducting and reporting micro-costing analyses, the quality and transparency of individual studies will be enhanced, and comparability across studies and interpretation of findings will improve. This systematic review will provide useful information to facilitate this effort. Specific guidelines and checklists for conducting and reporting micro-costing studies do not currently exist but can be developed and will help inform clinical and health policy decision-making about resource allocation in the long run.
We recognize that micro-costing has its own limitations [1, 6]. It is labor-intensive to collect such detailed utilization and valuation data. The results may not be widely generalizable, as the data may reflect only the practice at selected sites with specific populations. Hence, it is not always feasible or desirable to use micro-costing in economic evaluations. However, prior studies have demonstrated the usefulness and importance of this methodology in certain scenarios (for example, new interventions, extensive variability across providers, and so on) [2–7, 17, 18] and advances in electronic administrative databases (for example, proprietary cost-accounting data systems)  portend greater ease of individual-based data collection in the future. The purpose of this systematic review is to provide a critical assessment of how micro-costing has been used in the current literature. This information can help set research priorities for future economic evaluations and identify opportunities to improve the quality and reporting of future studies when micro-costing is desired or needed.
XX is an assistant professor at Yale University Department of Obstetrics, Gynecology and Reproductive Sciences. HKGN is a librarian at Yale University Cushing/Whitney Medical Library. JPR is an associate professor at University of Pennsylvania Perelman School of Medicine Department of Medical Ethics and Health Policy and a senior fellow at University of Pennsylvania Leonard Davis Institute of Health Economics.
Consolidated Health Economic Evaluation Reporting Standards
International Society for Pharmacoeconomics and Outcomes Research
- NHS EED:
National Health Service Economic Evaluation Database
National Institute on Drug Abuse
National Institutes of Health
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
International Prospective Register of Systematic Reviews.
Gold MR, Siegel JE, Russell LB, Weinstein MC: Cost-effectiveness in Health and Medicine. 1996, New York, NY: Oxford University Press
Tan SS, Rutten FF, van Ineveld BM, Redekop WK, Hakkaart-van Roijen L: Comparing methodologies for the cost estimation of hospital services. Eur J Health Econ. 2009, 10: 39-45. 10.1007/s10198-008-0101-x.
Heerey A, McGowan B, Ryan M, Barry M: Microcosting versus DRGs in the provision of cost estimates for use in pharmacoeconomic evaluation. Expert Rev Pharmacoecon Outcomes Res. 2002, 2: 29-33. 10.1586/1473718.104.22.168.
Clement Nee Shrive FM, Ghali WA, Donaldson C, Manns BJ: The impact of using different costing methods on the results of an economic evaluation of cardiac care: microcosting vs gross-costing approaches. Health Econ. 2009, 18: 377-388. 10.1002/hec.1363.
Ruger JP, Emmons KM, Kearney MH, Weinstein MC: Measuring the costs of outreach motivational interviewing for smoking cessation and relapse prevention among low-income pregnant women. BMC Pregnancy Childbirth. 2009, 9: 46-10.1186/1471-2393-9-46.
Barnett PG: An improved set of standards for finding cost for cost-effectiveness analysis. Med Care. 2009, 47: S82-S88. 10.1097/MLR.0b013e31819e1f3f.
Frick KD: Microcosting quantity data collection methods. Med Care. 2009, 47: S76-S81. 10.1097/MLR.0b013e31819bc064.
Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.
Shemilt I, Mugford M, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, McDaid D, Vale L, Walker D: Chapter 15: Incorporating economics evidence. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. (updated March 2011). Edited by: Higgins JPT, Green S. 2011, Oxford, UK: The Cochrane Collaboration, Available from http://www.cochrane-handbook.org
Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007, 7: 10-10.1186/1471-2288-7-10.
Xu X, Lazar C, Grossetta Nardini HK, Ruger JP: Micro-costing studies in the health and medical literature: a systematic review. 2014, PROSPERO, CRD42014007453 Available from http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014007453
AcademyHealth: Health Economics Core Library Recommendations, 2011. 2011, Bethesda, MD: Funded by the U.S. National Library of Medicine, Available from http://www.nlm.nih.gov/nichsr/corelib/hecon-2011.html
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E: Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013, 16: 231-250. 10.1016/j.jval.2013.02.002.
Ruger JP, Emmons KM: Economic evaluations of smoking cessation and relapse prevention programs for pregnant women: a systematic review. Value Health. 2008, 11: 180-190. 10.1111/j.1524-4733.2007.00239.x.
Ruger JP, Lazar CM: Economic evaluation of drug abuse treatment and HIV prevention programs in pregnant women: a systematic review. Addict Behav. 2012, 37: 1-10. 10.1016/j.addbeh.2011.07.042.
Ruger JP, Lazar CM: Economic evaluation of pharmaco- and behavioral therapies for smoking cessation: a critical and systematic review of empirical research. Annu Rev Public Health. 2012, 33: 279-305. 10.1146/annurev-publhealth-031811-124553.
Ruger JP, Ben Abdallah A, Cottler L: Costs of HIV prevention among out-of-treatment drug-using women: results of a randomized controlled trial. Public Health Rep. 2010, 125 (Suppl 1): 83-94.
Ruger JP, Chawarski M, Mazlan M, Luekens C, Ng N, Schottenfeld R: Costs of addressing heroin addiction in Malaysia and 32 comparable countries worldwide. Health Serv Res. 2012, 47: 865-887. 10.1111/j.1475-6773.2011.01335.x.
Drummond MF, Jefferson TO: Guidelines for authors and peer reviewers of economic submissions to the BMJ: the BMJ economic evaluation working party. BMJ. 1996, 313: 275-283. 10.1136/bmj.313.7052.275.
Evers S, Goossens M, de Vet H, van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Assess Health Care. 2005, 21: 240-245.
Philips Z, Bojke L, Sculpher M, Claxton K, Golder S: Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006, 24: 355-371. 10.2165/00019053-200624040-00006.
Walker DG, Wilson RF, Sharma R, Bridges J, Niessen L, Bass EB, Frick K: Best Practices for Conducting Economic Evaluations in Health Care: A Systematic Review of Quality Assessment Tools. 2012, Rockville, MD: Agency for Healthcare Research and Quality
Fukuda H, Imanaka Y: Assessment of transparency of cost estimates in economic evaluations of patient safety programmes. J Eval Clin Pract. 2009, 15: 451-459. 10.1111/j.1365-2753.2008.01033.x.
Bell CM, Urbach DR, Ray JG, Bayoumi A, Rosen AB, Greenberg D, Neumann PJ: Bias in published cost effectiveness studies: systematic review. BMJ. 2006, 332: 699-703. 10.1136/bmj.38737.607558.80.
The National Institutes of Health (NIH) (National Institute on Drug Abuse (NIDA) grant R01DA025555) provides funding support for this study. Dr. Ruger is also supported by the Patrick and Catherine Weldon Donaghue Medical Research Foundation. The funders had no role in the design of the study and will not participate in the collection, analysis, and interpretation of data, preparation or approval of any final reports or manuscripts, or decision to submit the manuscripts for publication.
The authors declare that they have no competing interests.
XX designed the systematic review and drafted the manuscript. HKGN developed the search strategy for the systematic review and participated in critical revision of the manuscript. JPR conceived of the study concept, participated in and supervised the design of the systematic review, and participated in drafting and critically revising the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Xu, X., Grossetta Nardini, H.K. & Ruger, J.P. Micro-costing studies in the health and medical literature: protocol for a systematic review. Syst Rev 3, 47 (2014). https://doi.org/10.1186/2046-4053-3-47