Measurement properties of adult quality-of-life measurement instruments for eczema: protocol for a systematic review
Systematic Reviews volume 4, Article number: 48 (2015)
Eczema is a common chronic or chronically relapsing skin disease that has a substantial impact on quality of life (QoL). By means of a consensus-based process, the Harmonising Outcome Measures in Eczema (HOME) initiative has identified QoL as one of the four core outcome domains to be assessed in all eczema trials (Allergy 67(9):1111-7, 2012). Various measurement instruments exist to measure QoL in adults with eczema, but there is a great variability in both content and quality (for example, reliability and validity) of the instruments used, and it is not always clear if the best instrument is being used.
Therefore, the aim of the proposed research is a comprehensive systematic assessment of the measurement properties of the existing measurement instruments that were developed and/or validated for the measurement of patient-reported QoL in adults with eczema.
This study is a systematic review of the measurement properties of patient-reported measures of QoL developed and/or validated for adults with eczema. Medline via PubMed and EMBASE will be searched using a selection of relevant search terms. Eligible studies will be primary empirical studies evaluating, describing, or comparing measurement properties of QoL instruments for adult patients with eczema. Eligibility assessment and data abstraction will be performed independently by two reviewers. Evidence tables will be generated for study characteristics, instrument characteristics, measurement properties, and interpretability. The quality of the measurement properties will be assessed using predefined criteria. Methodological quality of studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A best evidence synthesis will be undertaken if more than one study has investigated a particular measurement property.
The proposed systematic review will produce a comprehensive assessment of measurement properties of existing QoL instruments in adult patients with eczema. We aim to identify one best currently available instrument to measure QoL in eczema patients.
Systematic review registration
Eczema (synonymous with atopic eczema, atopic dermatitis) is an important medical condition not only in children but also in adults. The prevalence of eczema in adults is estimated at 1% to 3% . Various different interventions exist, many of which have been assessed in randomized controlled trials. Due to substantial variation in eczema outcome measures in trials, interventions are not comparable. The lack of standardization of eczema outcome measures currently renders truly evidence-based decision making difficult, if not impossible.
A multi-perspective Delphi study  conducted by the initiators of the Harmonising Outcome Measures in Eczema (HOME) initiative  defined clinical signs measured by means of a physician-assessed instrument, symptoms of eczema, and the long-term course of eczema as the core outcome domains to be applied in all future eczema trials. At the HOME II meeting in Amsterdam in 2011, the international community confirmed these core outcome measures and also added quality of life (QoL) to the core set of outcome domains . The next crucial step in the process of standardizing eczema outcome measurements is to identify appropriate instruments to measure each of the four core outcome domains of atopic eczema. There was broad international consensus among clinicians, patients, and methodologists that the Outcome Measures in Rheumatology (OMERACT) quality criteria ‘Truth, Discrimination, and Feasibility’  need to be met for eczema outcome measures to be recommended by the HOME initiative .
To systematically assess the measurement properties of patient-reported measurement instruments of QoL for adults with eczema
To identify outcome measurement instruments for QoL in adults with eczema
that have the potential to be recommended in the future depending on the results of further validation studies
To provide the evidence base
for an international consensus process to further standardize the assessment of QoL in adults with eczema in clinical trials.
for an international consensus process to prioritize further research concerning QoL assessment in adults with eczema.
Protocol and registration
The methods for this systematic review have been developed according to recommendations from the Preferred Reporting Items for Systematic Reviews and Meta-Analyes Protocols (PRISMA-P) statement . This protocol has been registered in the International Prospective Register of Systematic Reviews (PROSPERO): CRD42015017138.
A systematic literature search will be performed in PubMed and EMBASE. The search strategy will contain blocks of search terms related to the following aspects:
construct of interest: quality of life
target population: (atopic) eczema (cf Table 1).
measurement properties: the precise PubMed search filter for finding studies on measurement properties developed by Terwee et al. will be used to identify relevant articles . This filter has a sensitivity of 93.1% and a precision of 9.4%.
The entire search strategy is available as an Additional file 1 to this protocol.
The systematic electronic search will be supplemented by hand searching of reference lists of studies included and key articles on this topic. Furthermore, an additional search will be performed in each database, including the names of the instruments which are found in the initial search. The PROQOLID (www.proqolid.org) database will be searched.
Eligible measurement instruments
Eligible measurement instruments will include all patient-reported measurement instruments which were designed and/or validated to measure QoL in adults with eczema.
A study will be included if it is published as a full-text paper and concerns the development (‘development paper’) and/or evaluation of the measurement properties (‘validation paper’) of instruments that measure QoL or health-related quality of life (HrQoL) in adult people with eczema. A study with a mixed patient sample will be eligible either if it presents a subgroup analysis for adult patients with atopic eczema or if adult patients with atopic eczema constitute at least 50% of the study population. The measurement instrument must be a self-reported questionnaire. Articles that report indirect evidence, for instance, by using data obtained within the context of a clinical trial, will not be considered eligible. Articles assessing the measurement properties of dermatology-specific instruments in non-eczema samples will not be considered eligible.
Two reviewers will independently judge titles and abstracts retrieved in the literature search and, at a second stage, full-text articles for eligibility (Table 1). Disagreements will be resolved by discussion with all reviewers.
Assessment of the methodological quality of included studies
The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist [8-10] will be used to evaluate the methodological quality of included studies. In the COSMIN checklist (cf www.cosmin.nl), four domains are distinguished (reliability, validity, responsiveness, and interpretability) with related measurement properties and aspects of measurement properties. These are listed in Table 2 (adapted from ).
For each of the measurement properties, the COSMIN checklist consists of 5 to 18 items covering methodological standards (organized in nine boxes for the nine measurement properties). In addition, each item can be scored on a four-point rating scale (that is, ‘poor,’ ‘fair,’ ‘good,’ ‘excellent’). Taking the lowest rating for each item in one box, an overall quality score (‘poor,’ ‘fair,’ ‘good,’ ‘excellent’) is obtained for each measurement property separately.
The measurement property ‘criterion validity’ will not be considered for the purpose of this systematic review since no gold standard exists for QoL.
Relevant data from all included articles will be summarized in evidence tables. The evidence table will be drafted and pilot tested. Data from each article included will be abstracted independently by two reviewers. All reviewers will participate in this process and will work in pairs on defined sets of articles. Disagreements will be resolved by discussion of all reviewers.
Evidence tables will include the following: reference, geographical location, language, setting, study type, key characteristics of study subjects, name of measure, domains measured, number of items and (sub)scales, number and type of response categories, recall period in the questions, scoring algorithm, time needed for administration, mode of administration, target population for whom the questionnaire was originally developed, how a full copy of the questionnaire can be obtained, the instructions given to those who complete the questionnaire, the available versions and translations of the questionnaire, results of the measurement properties, all items from the COSMIN box Generalisability, and all items from the COSMIN box Interpretability [8,9].
If general characteristics of an instrument (that is, name of measure, number of items and (sub)scales, number and type of response categories, recall period in the questions, scoring algorithm, time needed for administration, mode of administration, target population for whom the questionnaire was originally developed, how a full copy of the questionnaire can be obtained, the instructions given to those who complete the questionnaire, the available versions and translations of the questionnaire) cannot be extracted from the studies included, the original development paper may be consulted to obtain missing information.
An overview of the content of each instrument on item level will be presented in order to visualize which content is covered by the different instruments. The original development paper is going to be consulted to obtain this information.
Quality assessment of the measurement instruments
The predefined criteria for rating the quality of measure recommended by the COSMIN group will be used  (cf Table 3). These criteria are in accordance with the OMERACT filter  which has been adopted by the HOME initiative  and the criteria applied in a previous review on atopic eczema outcome measures  (Table 3).
Best evidence synthesis
If an instrument has been evaluated in different studies, findings will be synthesized if the characteristics of the included studies are sufficiently similar and if the results of the studies do not show too different or conflicting findings and if the methodological quality of the included studies is sufficient . The criteria for best evidence synthesis are outlined in Table 4.
Generating recommendations for the use of QoL measurement instruments for eczema
For each instrument identified in the review, a standardized recommendation for usage or required future validation work will be made depending on the quality of the instrument and on the methodological quality of included studies (cf Table 5). According to the results of the HOME II meeting , all three criteria of the OMERACT filter , that is, truth, discrimination, and feasibility, have to be met by an outcome measure to be recommended by the HOME initiative.
Four categories of recommendation will be made:
QoL measurement instrument meets all requirements and is recommended for use.
QoL measure meets two or more quality items, but performance in all other required quality items is unclear, so that the outcome measure has the potential to be recommended in the future depending on the results of further validation studies.
QoL measure has low quality in at least one required quality criterion (≥1 rating of ‘minus’) and therefore is not recommended to be used any more.
QoL measure has (almost) not been validated. Its performance in all or most relevant quality items is unclear so that it is not recommended to be used until further validation studies clarify its quality.
Finally, we aim to identify one best (currently available) instrument to assess QoL in adult eczema.
The proposed systematic review will yield a comprehensive assessment of measurement properties of existing QoL instruments in adult patients with eczema. We aim to arrive at a recommendation of one best instrument to measure QoL in eczema patients. The processes underlying this systematic review are transparent and systematic. Quality assurance is achieved by involving two independent reviewers at each stage. A strength of the proposed research is the international coverage of the contributing reviewers. This will increase the credibility of any findings. However, coordinating work packages between many reviewers is certainly a challenge. Whether or not we will be able to reach the goal of recommending one best instrument is unclear. It may well be that no instrument will meet all the filter criteria or that several instruments will meet them. In any case, the findings of this systematic review will inform a consensus-finding process at the fourth meeting of the HOME initiative (HOME IV) that will take place in Malmö, Sweden, in April 2015. Based on the findings of this work, we hope to be able to inform group discussion and consensus voting with the ultimate goal to endorse one instrument to be included in the core set of outcome measurement instruments for eczema. If instruments lack important requirements, for instance, in relation to responsiveness or feasibility, further validation work will need to be done before a QoL instrument can be included in the core set.
- COSMIN :
COnsensus-based Standards for the selection of health Measurement INstruments
- HrQoL :
health-related quality of life
- PRO :
quality of life
Schmitt J, Bauer A, Meurer M. [Atopic exzema in adulthood]. Hautarzt. 2008;59(10):841–50. quiz 51. PubMed Atopisches Ekzem im Erwachsenenalter.
Schmitt J, Langan S, Stamm T, Williams HC. Core outcome domains for controlled trials and clinical recordkeeping in eczema: international multiperspective Delphi consensus process. J Invest Dermatol. 2011;131(3):623–30. PubMed Epub 2010/10/15. eng.
Schmitt J, Williams H. Harmonising Outcome Measures for Eczema (HOME). Report from the First International Consensus Meeting (HOME 1), 24 July 2010, Munich, Germany. Br J Dermatol. 2010;163(6):1166–8. PubMed Epub 2010/12/09. eng.
Schmitt J, Spuls P, Boers M, Thomas K, Chalmers J, Roekevisch E, et al. Towards global consensus on outcome measures for atopic eczema research: results of the HOME II meeting. Allergy. 2012;67(9):1111–7. PubMed Epub 2012/08/01. eng.
Boers M, Brooks P, Strand CV, Tugwell P. The OMERACT filter for outcome measures in rheumatology. J Rheumatol. 1998;25(2):198–9. PubMed Epub 1998/03/07. eng.
Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647. PubMed.
Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18(8):1115–23. PubMed Pubmed Central PMCID: 2744791. Epub 2009/08/28. eng.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. PubMed Epub 2010/05/25. eng.
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22. PubMed Pubmed Central PMCID: 2848183. Epub 2010/03/20. eng.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49. PubMed Pubmed Central PMCID: 2852520. Epub 2010/02/20. eng.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42. PubMed Epub 2006/12/13. eng.
Schmitt J, Langan S, Williams HC. What are the best outcome measurements for atopic eczema? A systematic review. J Allergy Clin Immunol. 2007;120(6):1389–98. PubMed Epub 2007/10/04. eng.
Furlan AD, Pennick V, Bombardier C, van Tulder M. 2009 updated method guidelines for systematic reviews in the Cochrane back review group. Spine. 2009;34(18):1929–41. PubMed Epub 2009/08/15. eng.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 4th ed. Oxford: Oxford University Press; 2008.
PROMIS® Instrument Development and Validation Scientific Standards Version 2.0. 2013. (available at http://www.nihpromis.org/%28X%281%29S%28l4ziabyqjykgamhigno4zi5p%29%29/Documents/PROMISStandards_Vers2.0_Final.pdf).
Schellingerhout JM, Verhagen AP, Heymans MW, Koes BW, de Vet HC, Terwee CB. Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review. Qual Life Res. 2012;21(4):659–70. PubMed Pubmed Central PMCID: 3323817. Epub 2011/07/08. eng.
We are indebted to the HOME executive committee for having commented on an early version of this protocol.
The authors declare that they have not received any financial funding to conduct this study.
The authors declare that they have no competing interests.
CA initiated the protocol, conceptualized the research plan for the proposed systematic review, wrote the manuscript, and reviewed it for important intellectual content. DH conceptualized the research plan for the proposed systematic review, wrote the manuscript, and reviewed it for important intellectual content. CP wrote the manuscript and reviewed it for important intellectual content. SD helped with the methodology section and reviewed the manuscript for important intellectual content. JC reviewed the manuscript for important intellectual content. RO helped with the methodology section and reviewed the manuscript for important intellectual content. RH reviewed the manuscript for important intellectual content. TS reviewed the manuscript for important intellectual content. SC reviewed the manuscript for important intellectual content. JS conceptualized the research plan for the proposed systematic review and reviewed it for important intellectual content. All authors read and approved the final manuscript.
About this article
Cite this article
Apfelbacher, C.J., Heinl, D., Prinsen, C.A.C. et al. Measurement properties of adult quality-of-life measurement instruments for eczema: protocol for a systematic review. Syst Rev 4, 48 (2015). https://doi.org/10.1186/s13643-015-0041-3