Recommendations for exercise adherence measures in musculoskeletal settings: a systematic review and consensus meeting (protocol)
© Holden et al.; licensee BioMed Central Ltd. 2014
Received: 20 January 2014
Accepted: 28 January 2014
Published: 10 February 2014
Exercise programmes are frequently advocated for the management of musculoskeletal disorders; however, adherence is an important pre-requisite for their success. The assessment of exercise adherence requires the use of relevant and appropriate measures, but guidance for appropriate assessment does not exist. This research will identify and evaluate the quality and acceptability of all measures used to assess exercise adherence within a musculoskeletal setting, seeking to reach consensus for the most relevant and appropriate measures for application in research and/or clinical practice settings.
There are two key stages to the proposed research. First, a systematic review of the quality and acceptability of measures used to assess exercise adherence in musculoskeletal disorders; second, a consensus meeting. The systematic review will be conducted in two phases and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to ensure a robust methodology. Phase one will identify all measures that have been used to assess exercise adherence in a musculoskeletal setting. Phase two will seek to identify published and unpublished evidence of the measurement and practical properties of identified measures. Study quality will be assessed against the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. A shortlist of best quality measures will be produced for consideration during stage two: a meeting of relevant stakeholders in the United Kingdom during which consensus on the most relevant and appropriate measures of exercise adherence for application in research and/or clinical practice settings will be sought.
This study will benefit clinicians who seek to evaluate patients’ levels of exercise adherence and those intending to undertake research, service evaluation, or audit relating to exercise adherence in the musculoskeletal field. The findings will impact upon new research studies which aim to understand the factors that predict adherence with exercise and which test different adherence-enhancing interventions. PROSPERO reference: CRD42013006212
KeywordsAcceptability Adherence Consensus Exercise Measurement Musculoskeletal disorders Physical activity Quality Systematic review
Musculoskeletal disorders, such as low back pain, shoulder disorders, and osteoarthritis, are common, with estimates suggesting an average prevalence of 38% , which increases markedly with age  and is likely to continue to rise due to the ageing population and increasingly sedentary lifestyles [2, 3]. Musculoskeletal disorders cause more functional limitations than any other group of disorders within the adult population and lead to enormous healthcare expenditure and loss of work .
Clinical guidelines advocate the use of exercise programmes for musculoskeletal disorders [5, 6]. Exercise can encompass a wide range of interventions such as general (aerobic) exercise, specific body-region exercises for strengthening and flexibility, continuing normal physical activities, and increasing general physical activity levels . Systematic reviews consistently show the beneficial effects of different types of exercise on key clinical outcomes such as pain, physical function, and quality of life [8–10]. Adherence, defined as “the extent to which a person’s behaviour corresponds with agreed recommendations from a healthcare provider”, is considered to be an important pre-requisite for the success of exercise programmes for musculoskeletal disorders [11, 12]. Adhering to an exercise programme enhances its effectiveness, and patients who undertake regular physical activity may be less likely to progress to recurrent, persistent, or disabling problems [13, 14].
Despite its importance, adherence to clinic-based exercise protocols is often around 50% [15, 16] and is usually worse for unsupervised home exercise programmes [17, 18]. Non-adherence to exercise recommendations may negatively affect treatment effectiveness, treatment duration, efficiency of use of personnel and equipment, the therapeutic relationship, waiting times, and cost of care [19–21], and may also be responsible for non-significant research outcomes within a clinic-based research context . Although numerous interventions exist that may potentially improve adherence to exercise for musculoskeletal disorders [7, 23–25], in order to robustly test the effectiveness of these potential interventions, reliable and reproducible measures of exercise adherence are first required.
Due to the multi-dimensional nature of exercise adherence , including completing exercise and physical activity correctly, in different settings and at the agreed ‘dose’, accurate measurement of exercise adherence can be challenging. No gold standard measure of adherence exists . Moreover, the most appropriate measure of adherence for one type of therapeutic exercise (for example specific body-region exercises for strengthening and flexibility) may not be appropriate to measure adherence to other types of therapeutic exercise, such as increasing general physical activity levels. Within clinical practice, more objective measures of exercise adherence, such as a diary, are underutilised , and in randomised controlled trials of exercise for musculoskeletal disorders measurement of adherence is either non-existent or limited by use of non-standardised instruments that capture data on only one domain of adherence [7, 29].
Although a wide range of performance-based, clinician-reported and patient-reported measures of exercise adherence are available, most lack a clear theoretical underpinning [7, 30]. In addition, there is wide variation in the use of these measures within clinical research and routine practice settings, and guidelines or consensus regarding how exercise adherence should be assessed do not exist. Agreement on the most relevant, useful and appropriate approach to assessing exercise adherence is essential if research and clinical audit is to be effective in informing both policy and clinical decision-making .
This study will seek to achieve a UK-based consensus on the ‘best’ measures of exercise adherence in terms of quality, acceptability, and usefulness to musculoskeletal research and routine clinical practice.
There are two key stages to the proposed research. First, a systematic review of the quality and acceptability of measures used to assess exercise adherence; second a consensus meeting of UK stakeholders. The systematic review will be conducted in two phases and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to ensure robust methodology . Phase one will identify all measures that have been used to assess exercise adherence within a musculoskeletal setting. Phase two will seek to identify published and unpublished evidence of measurement and practical properties of identified measures of exercise adherence. The quality of developmental and evaluative studies will be assessed against the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines [33, 34]. A short-list of best quality measures will be produced for consideration during stage two of the study, the consensus meeting, which will inform recommendations on the ‘best’ measures of exercise adherence in terms of quality, acceptability, and usefulness to musculoskeletal research and routine clinical practice.
Stage 1.1: Systematic review – identification of measures
A search strategy combining title/abstract words and database subject headings relating to exercise adherence and musculoskeletal rehabilitation will be used to locate all measures used to assess exercise adherence in a musculoskeletal context (see Search strategy for phase one of the systematic review), and run in the following databases from their inception: Medline, SPORTDiscus, CINAHL Plus with Fulltext, PsycINFO, AMED, The Cochrane Library (Cochrane Database of Systematic Reviews, Cochrane Cemtral Register of Controlled Clinical Trials, Database of abstracts of reviews of effects, Health Technology Assessment Database, and the NHS economic evaluation database), Embase, and Web of Science. A RefWorks database will be used to manage all references.
Search strategy for phase one of the systematic review
The search strategies will use title and abstract words/synonyms and database subject headings (e.g., MeSH) to capture the concept of exercise adherence in the context of musculoskeletal rehabilitation, for adult patients. The strategies will also contain the following exclusions: “cardiac rehabilitation”, “pulmonary rehabilitation”, “neuro* rehabilitation”, “stroke”, “child*”, and “infan*”.
To capture ‘exercise adherence’, title and abstract terms/synonyms and database subject headings for adherence will be combined with those for exercise (listed below) using proximity operators (within 3 words), or AND, as applicable.
Adherence terms: Words in title/abstract: adher*, nonadher*, complian*, noncomplian*, concordan*, cooperat*, co-operat*, uncooperat*, unco-operat*, engag*, disengag*, behaviour#, behavior#. MeSH: “Patient Compliance”.
Exercise terms: Words in title/abstract: activ*, exercis*, physical n3 train*, weight n3 train*, sport#, rehab*, MeSH: “Therapeutic Exercise +”, “Exercise Therapy +”, “Exercise +”, “Physical Activity”, “Motor Activity”, “Exercise Movement Techniques”.
To restrict the results to the context of musculoskeletal rehabilitation, the above searches will be combined (AND) with the following search terms/synonyms and database subject headings:
Musculoskeletal rehabilitation terms: Words in title/abstract: osteopath*, chiropract*, musculoskeletal, msk, physiotherap*, rehabilitat*, osteoarthrit*, spondyl*, osteitis, osteochondritis, arthropathy, bursitis, shoulder impingement, myalgia, lordosis, sacroiliac, sciatica, cervicogenic, dyskinesis, tendinitis, tendinopathy, allodynia, hyperalgesia, subluxation, disc, misalignment, osteopathic lesion, frozen shoulder, degenerative joint disease, muscular n3 pain, back n3 pain, lumbar n3 pain, lumbo* n3 pain, spine n3 pain, spinal n3 pain, neck n3 pain, cervical n3 pain, knee* n3 pain, hips n3 pain, hip n3 pain, shoulder n3 pain, ankle# n3 pain, foot n3 pain, feet n3 pain, elbow# n3 pain, hand# n3 pain, flank pain, buttock pain, joint pain, radicular pain, neuralgia, lumbago, arthralgia, adverse neural tension, muscle tear#, sprain* n5 musc*, strain* n5 musc*. MesH: “Osteopathy”, “Osteopathic Medicine”, “Chiropractic”, “Manipulation, Chiropractic”, “Musculoskeletal Diseases +”, “Sciatica”, “Tendinopathy +”, “Allodynia”, “Hyperalgesia”, “Subluxation”, “Back Pain +”, “Neck Pain”, “Neuralgia +”, “Elbow Pain”, “Arthralgia +”, (“Musculoskeletal System +” AND “Pain +”).
Titles and abstracts of all identified articles will be reviewed for inclusion by two independent reviewers and agreement checked. A third independent reviewer will be used to resolve any differences regarding eligibility. Any primary quantitative study (including clinical trials, observational studies, longitudinal studies, case control studies, and case studies) will be included if they involve: i) adults with musculoskeletal disorders, ii) any therapeutic exercise or physical activity intervention, iii) clearly defined and reproducible measures used to assessed adherence to exercise or activity, including patient-reported or clinician-reported measures or exercise diaries (if converted to an adherence measurement scale), and iv) exercise or activity delivered in any therapeutic setting including inpatient, outpatient, and community settings. Studies will be excluded if they are not written in English, involve i) participants under 18 years of age, ii) participants who have received therapeutic exercise and activity for non-musculoskeletal conditions such as diabetes, asthma, and cancer, or iii) if they include healthy volunteers. Performance measures (i.e., muscle strength and joint range of movement), performance of exercise technique and attendance at sessions are often considered proxy measures of exercise adherence and will therefore be excluded from this review. Following title and abstract screening, full text articles of retained studies will be reviewed for inclusion and adherence measures will be identified. Cleary defined and reproducible measures of exercise adherence used within the musculoskeletal field will then be located and collated.
Stage 1.2: Systematic review – identification of development and/or evaluative papers
Articles reporting the measurement and/or practical properties of identified measures used to assess exercise adherence will be sought by performing further specific searches in the databases identified above for each identified measure. A highly sensitive search filter developed by Terwee et al.  for finding studies on measurement properties of measurement instruments will be applied for larger result sets. Authors identified as the first contact for the development of a specific measure will be contacted to locate additional published or unpublished studies that may provide additional evidence of measurement and/or practical properties for the specific measure. Published articles will be included if they provide evidence of development and/or evaluations for clearly defined and reproducible measures used to assess exercise adherence, and published in the English language. We will seek evidence from both within, and outside of the musculoskeletal setting. All titles and abstracts, and where applicable full text articles, will be assessed for inclusion by two independent reviewers and a third reviewer will resolve any disagreements. Reference lists of included articles will be reviewed for additional published articles.
Data extraction and appraisal
A data extraction form informed by earlier reviews  and the requirements of the COSMIN checklist [33, 34] will be used to ensure that data necessary to support an evaluation of both study and measure quality is extracted.
Data extraction will capture study-specific information (including population, intervention, and setting) and measurement tool-specific information. Extraction for measurement properties will seek evidence of reliability (internal consistency, test-retest, intra- or inter-tester, measurement error); validity (content, construct including internal (within scale) analyses and analyses against external criteria, convergent/divergent, and known group differences); evidence of explicit hypothesis testing will be detailed; evidence of the conceptual underpinning and the aspects of exercise adherence which the measure purports to assess will be sought; responsiveness (criterion-based or construct-based assessment); interpretation (minimal important difference); and precision (data quality, end effects). Extraction for evidence of practical properties will include acceptability (relevance and respondent burden) and feasibility. The extent of patient involvement in measurement development and/or application will also be sought.
In accordance with the COSMIN checklist, each measurement property reported by the study will be rated on a 4-point scale (i.e., excellent, good, fair, poor) [33, 34]. Study methodological quality will be evaluated per measurement property and determined by the lowest checklist rating [33, 34]. Two reviewers will independently undertake data extraction and apply the checklist to each included study. Consensus will be sought through discussion; any disagreements will be resolved using a third reviewer.
As reported in other reviews [37, 38], all data will be qualitatively synthesised to determine the overall quality and acceptability of each reviewed measure. The synthesis will take the following factors into account: i) study methodological quality (COSMIN scores); ii) the number of studies reporting specific evidence per measure; iii) the results for each measurement/practical property per measure; and iv) consistency between studies . The data synthesis score will have two elements. First, the overall quality of a measurement property will be reported as: adequate (+), not adequate (−), conflicting (+/−), or unclear (?). Second, levels of evidence for the overall quality of each measurement property will be further defined to indicate ‘strong’, ‘moderate’, ‘limited’, ‘conflicting’, or ‘unknown’ evidence as detailed by Elbers et al. . The synthesis will produce a shortlist of ‘best’ quality measures that will be further considered in stage two.
Stage 2: Consensus meeting
The final stage of the project will be a one-day ‘expert’ consensus meeting with 15 participants representing key stakeholders, including lay representatives (n = 6), clinicians who use therapeutic exercise (n = 3), expert researchers in the field of adherence or exercise therapy (n = 3), and service managers (n = 3). We will reach a consensus on the ‘best’ measures of exercise adherence in terms of quality, relevance, acceptability, feasibility, and appropriateness for musculoskeletal healthcare in both clinical research and routine practice settings. The strengths and limitations of reviewed measures, and a future research agenda will be produced.
What should be measured when assessing exercise adherence?
How should exercise adherence be measured and how ‘useful’ are the shortlisted ‘best’ measures of exercise adherence with respect to:
Relevance (to the aspects of exercise adherence viewed as most important);
Acceptability (to patients who are required to adhere to exercise regimes);
Appropriateness (to the musculoskeletal population)
Feasibility (for use in clinical research and/or routine practice settings)?
Relevant research will be summarised and sent to participants in advance of the meeting. This will include i) a synthesis of the systematic review and copies of the ‘shortlisted’ measures (how is adherence currently measured); and ii) a list of aspects, or domains, of exercise adherence currently assessed in published research (what aspects of adherence are currently measured).
Participants will also receive a questionnaire with two key sections on what and how to measure exercise adherence. Participants will be asked to rate the relative importance of each aspect, or domain of exercise adherence identified in the systematic review. Importance ratings will be made on a 9-point GRADE scale (1 to 3 = not important; 4 to 6 = important; 7 to 9 = critical) [42, 43]. Importance will be defined as ‘how important is it that this aspect, or domain, of adherence is included in the assessment of exercise adherence?’ Participants will also be asked to consider the relevance and feasibility of each measure for research or clinical musculoskeletal settings. Measures will be rated on separate 9-point GRADE scales (1 to 3 = not relevant/not feasible; 4 to 6 = relevant/feasible; 7 to 9 = most relevant/highly feasible). Finally, participants will be asked to rate the suitability of each measure for the assessment of exercise adherence in i) research (yes/no) or ii) routine practice (yes/no) musculoskeletal settings.
The questionnaire content will be piloted with representative stakeholders (n = 3; to include a patient, physiotherapist, methodologist/researcher). Participants will be asked to return all completed questionnaires in advance of the meeting to allow results to be collated. Where appropriate, participants will be encouraged to provide additional comments or contributions to the candidate lists of domains and outcome measures for further discussion at the meeting.
The consensus meeting will be structured into three discrete sections [44–46]. First the evidence synthesis will be re-presented , and group results from postal completion of the nominal group questionnaire shared with the group. Individual participants will also receive their own individual scores, supporting comparison with the wider group. Next, semi-structured group discussions will be facilitated and participants will again be invited to address the two core questions stated above. Finally, a plenary session will be convened and the results from the group sessions fed back to all participants. There will be an anonymised voting process, during which we will converge on a common view of what aspects of exercise adherence should be assessed (1. What to measure?), and make recommendations for the most relevant and appropriate method of assessment (2. How to measure?). During the final vote participants will be invited to vote as to whether each domain (yes/no) and each outcome measure (yes/no) should be included in the assessment of exercise adherence. The meeting will seek to make clear recommendations for simple, relevant, and appropriate assessment of exercise adherence both within research and clinical practice settings within the musculoskeletal field.
Adherence to therapeutic exercise is a pre-requisite for successful rehabilitation, yet its accurate measurement is challenging . In clinical practice, more objective measures of exercise adherence are underutilised . In clinical trials of exercise for musculoskeletal pain, adherence is not always measured, and when it is, the measures used are often not validated or standardised, making it difficult to compare the effectiveness of different interventions and impossible to pool data in the form of a meta-analyses [7, 29]. This review will identify, summarise, and critically evaluate available measures of exercise adherence and develop recommendations about the most promising measures which are relevant for musculoskeletal research and clinical practice. This will benefit clinicians evaluating patients’ levels of exercise adherence and those intending to undertake research, service evaluation, or audit relating to exercise adherence in the musculoskeletal field. The findings will impact upon new research studies which aim to understand the factors that predict adherence with exercise, which test different adherence-enhancing interventions.
Allied and complementary medicine
Cumulative index to nursing and allied health literature
COnsensus-based Standards for the selection of health Measurement Instruments
Grading of recommendations assessment development and evaluation
Preferred reporting items for systematic reviews and meta-analyses
We are grateful for the involvement of the Project Steering Group (Hazel Horobin, Devdeep Ahuja, and Jeff Breckon) and patient representatives from Barnsley Consumer Research Advisory Group for their contribution to the development of this project. The Chartered Society of Physiotherapy Charitable Trust funded this research.
- Parsons S, Breen A, Foster NE, Letley L, Pincus T, Vogel S, Underwood M: Prevalence and comparative troublesomeness by age of musculoskeletal pain in different body locations. Fam Pract. 2007, 24: 308-316. 10.1093/fampra/cmm027.View ArticlePubMedGoogle Scholar
- Reginster JY: The prevalence and burden of arthritis. Rheumatology. 2002, 41 (Suppl 1): 3-6.View ArticlePubMedGoogle Scholar
- Woolf AD, Pfleger B: Burden of major musculoskeletal conditions. Bull World Health Organisat. 2003, 81: 646-656.Google Scholar
- Walsh NE, Brooks P, Hazes JM, Walsh RM, Dreinhofer K, Woolf AD, Akesson K, Lidgren L, Bone and Joint Decade Task Force for Standards of Care for Acute and Chronic Musculoskeletal Pain: Standards of care for acute and chronic musculoskeletal pain: the bone and joint decade (2000–2010). Arch Phys Med Rehabil. 2008, 89: 1830-1845. 10.1016/j.apmr.2008.04.009.View ArticlePubMedGoogle Scholar
- Childs JD, Cleland JA, Elliott JM, Teyhen DS, Wainner RS, Whitman JM, Sopky BJ, Godges JJ, Flynn TW, American Physical Therapy Association: Neck pain: clinical practice guidelines linked to the international classification of functioning, disability, and health from the orthopaedic section of the American physical therapy association. J Orthop Sports Phys Ther. 2008, 38: A1-A34.View ArticlePubMedGoogle Scholar
- Fernandes L, Hagen KB, Bijlsma JW, Andreassen O, Christensen P, Conaghan PG, Doherty M, Geenen R, Hammond A, Kjeken I, Lohmander LS, Lund H, Mallen CD, Nava T, Oliver S, Pavelka K, Pitsillidou I, da Silva JA, de la Torre J, Zanoli G, Vliet Vlieland TP, European League Against Rheumatism (EULAR): : EULAR recommendations for the non-pharmacological core management of hip and knee osteoarthritis. Ann Rheum Dis. 2013, 72 (7): 1125-1135. 10.1136/annrheumdis-2012-202745.View ArticlePubMedGoogle Scholar
- Jordan JL, Holden ME, Mason EEJ, Foster NE: Interventions to improve adherence to exercise for chronic musculoskeletal pain in adults. Cochrane Database Syst Rev. 2010, 1: CD005956Google Scholar
- Fuentes JP, Armijo-Olivo S, Magee DJ, Gross DP: Effects of exercise therapy on endogenous pain-relieving peptides in musculoskeletal pain – a systematic review. Clin J Pain. 2011, 27: 365-374. 10.1097/AJP.0b013e31820d99c8.View ArticleGoogle Scholar
- Kay TM, Gross A, Goldsmith C, Santaguida PL, Hoving J, Bronfort G, Cervical Overview Group: Exercises for mechanical neck disorders. Cochrane Database Syst Rev. 2005, 3: CD004250Google Scholar
- Fransen M, McConnell S: Exercise for osteoarthritis of the knee. Cochrane Database Syst Rev. 2008, 4: CD004376Google Scholar
- World Health Organisation: Adherence to Long Term Therapies – Evidence for Action. 2003, Geneva: World Health OrganisationGoogle Scholar
- Roddy E, Zhang W, Doherty M, Arden KM, Barlow J, Birrell F, Carr A, Chakravarty K, Dickson J, Hay E, Hosie G, Hurley M, Jordan KM, McCarthy C, McMurdo M, Mockett S, O’Reilly S, Peat G, Pendleton A, Richards S: Evidence-based recommendations for the role of exercise in the management of osteoarthritis of the hip or knee–the MOVE consensus. Rheumatology. 2005, 44: 67-73. 10.1093/rheumatology/keh399.View ArticlePubMedGoogle Scholar
- McLean SM, May S, Klaber Moffett J, Sharp D, Gardiner E: Prognostic factors for progressive non-specific neck pain. Phys Ther Rev. 2007, 12: 207-220. 10.1179/108331907X222967.View ArticleGoogle Scholar
- Hayden JA, van Tulder MW, Tomlinson G: Systematic review: strategies for using exercise therapy to improve outcomes in chronic low back pain. Ann Intern Med. 2005, 142: 776-785. 10.7326/0003-4819-142-9-200505030-00014.View ArticlePubMedGoogle Scholar
- McLean S, Klaber Moffett J, Sharp D, Gardiner E: A randomised controlled trial comparing graded exercise treatment and usual physiotherapy for patients with non-specific neck pain (The GET UP neck pain trial). Man Ther. 2013, 18: 199-205. 10.1016/j.math.2012.09.005.View ArticlePubMedGoogle Scholar
- Kolt GS, McEvoy JF: Adherence to rehabilitation in patients with low back pain. Man Ther. 2003, 8: 110-116. 10.1016/S1356-689X(02)00156-X.View ArticlePubMedGoogle Scholar
- Forkan R, Pumper B, Smyth N, Wirkkala H, Ciol MA, Shumway-Cook A: Exercise adherence following physical therapy intervention in older adults with impaired balance. Phys Ther. 2006, 86: 401-410.PubMedGoogle Scholar
- Hardage J, Peel C, Morris D, Graham C, Brown C, Foushee HR, Braswell J: Adherence to exercise scale for older patients (AESOP): a measure for predicting exercise adherence in older adults after discharge from home health physical therapy. J Geriatr Phys Ther. 2007, 30: 69-78. 10.1519/00139143-200708000-00006.View ArticlePubMedGoogle Scholar
- Gucciardi E: A systematic review of attrition from diabetes education services: strategies to improve attrition and retention research. Can J Diabetes. 2008, 32: 53-65. 10.1016/S1499-2671(08)21011-7.View ArticleGoogle Scholar
- Martin C, Perfect T, Mantle G: Non-attendance in primary care: the views of patients and practices on its causes, impact and solutions. Fam Pract. 2005, 22: 638-643. 10.1093/fampra/cmi076.View ArticlePubMedGoogle Scholar
- Weinger K, McMurrich SJ, Yi JP, Lin S, Rodriguez M: Psychological characteristics of frequent short-notice cancellers of diabetes medical and education appointments. Diabetes Care. 2005, 28: 1791-1793. 10.2337/diacare.28.7.1791.View ArticlePubMedPubMed CentralGoogle Scholar
- Turk DC, Rudy TE: Neglected topics in the treatment of chronic pain patients–relapse, noncompliance, and adherence enhancement. Pain. 1991, 44: 5-28. 10.1016/0304-3959(91)90142-K.View ArticlePubMedGoogle Scholar
- Beswick AD, Rees K, West RR, Taylor FC, Burke M, Griebsch I, Taylor RS, Victory J, Brown J, Ebrahim S: Improving uptake and adherence in cardiac rehabilitation: literature review. J Adv Nurs. 2005, 49: 538-555. 10.1111/j.1365-2648.2004.03327.x.View ArticlePubMedGoogle Scholar
- Wens J, Vermeire E, Hearnshaw H, Lindenmeyer A, Biot Y, Van Royen P: Educational interventions aiming at improving adherence to treatment recommendations in type 2 diabetes: a sub-analysis of a systematic review of randomised controlled trials. Diabetes Res Clin Pract. 2008, 79: 377-388. 10.1016/j.diabres.2007.06.006.View ArticlePubMedGoogle Scholar
- Williams A, Manias E, Walker R: Interventions to improve medication adherence in people with multiple chronic conditions: a systematic review. J Adv Nurs. 2008, 63: 132-143. 10.1111/j.1365-2648.2008.04656.x.View ArticlePubMedGoogle Scholar
- Kolt GS, Brewer BW, Pizzari T, Schoo AMM, Garrett N: The sport injury rehabilitation adherence scale: a reliable scale for use in clinical physiotherapy. Physiotherapy. 2007, 93: 17-22. 10.1016/j.physio.2006.07.002.View ArticleGoogle Scholar
- Treuth MS: Applying multiple methods to improve the accuracy of activity assessments. Physical Activity Assessments for Heath Related Research. Edited by: Welk GJ. 2002, USA: Human Kinetics Publishers, 213-224.Google Scholar
- Holden MA, Nicholls EE, Hay EM, Foster NE: Physical therapists’ use of therapeutic exercise for patients with clinical knee osteoarthritis in the United Kingdom: in line with current recommendations?. Phys Ther. 2008, 88: 1109-1121. 10.2522/ptj.20080077.View ArticlePubMedPubMed CentralGoogle Scholar
- Beinart NA, Goodchild CE, Weinman JA, Ayis S, Godfrey EL: Individual and intervention-related factors associated with adherence to home exercise in chronic low back pain: a systematic review. Spine J. 2013, 13: 1940-1950. 10.1016/j.spinee.2013.08.027.View ArticlePubMedGoogle Scholar
- Abrams D, Davidson M, Harrick J, Harcourt P, Zylinski M, Clancy J: Monitoring the change: current trends in outcome measure usage in physiotherapy. Man Ther. 2006, 11: 46-53. 10.1016/j.math.2005.02.003.View ArticlePubMedGoogle Scholar
- Ward JA, Potter S, Blazeby JM: Outcome reporting for reconstructive breast surgery: the need for consensus, consistency and core outcome sets. Eur J Surg Oncol. 2012, 38: 1020-1021. 10.1016/j.ejso.2012.07.108.View ArticlePubMedGoogle Scholar
- The PRISMA group: Preferred Reporting Items for Systematic reviews and Meta-Analyses: The PRISMA statement. 2009,http://www.prisma-statement.org/,Google Scholar
- Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC: Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012, 21: 651-657. 10.1007/s11136-011-9960-1.View ArticlePubMedGoogle Scholar
- Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related quality patient-reported outcomes. J Clin Epidemiol. 2010, 63: 737-745. 10.1016/j.jclinepi.2010.02.006.View ArticlePubMedGoogle Scholar
- Terwee CB, Jansma EP, Riphagen II, de Vet HCW: Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009, 18: 1115-1123. 10.1007/s11136-009-9528-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Haywood KL, Staniszewska S, Chapman S: Quality and acceptability of patient-reported outcome measures used in chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME): a systematic review. Qual Life Res. 2012, 21: 35-52. 10.1007/s11136-011-9921-8.View ArticlePubMedGoogle Scholar
- Haywood KLBJ, Tutton E, Staniszewska S: Patient-reported outcome measures (PROMs) and fragility hip fracture: a systematic review of quality and acceptability. Qual Life Res. 2013, 22 (Suppl 1): 2077-Google Scholar
- Elbers RG, Rietberg MB, van Wegen EE, Verhoef J, Kramer SF, Terwee CB, Kwakkel G: Self-report fatigue questionnaires in multiple sclerosis, Parkinson’s disease and stroke: a systematic review of measurement properties. Qual Life Res. 2012, 21: 925-944. 10.1007/s11136-011-0009-2.View ArticlePubMedGoogle Scholar
- Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I: The nominal group technique: a research tool for general practice?. Fam Pract. 1993, 10: 76-81. 10.1093/fampra/10.1.76.View ArticlePubMedGoogle Scholar
- Harvey N, Holmes CA: Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Pract. 2012, 18: 188-194. 10.1111/j.1440-172X.2012.02017.x.View ArticlePubMedGoogle Scholar
- Foster NE, Dziedzic KS, van der Windt D, Fritz J, Hay EM: Research priorities for non-pharmacological therapies for common musculoskeletal problems: nationally and internationally agreed recommendations. BMC Musculoskelet Disord. 2009, 10: 3-10.1186/1471-2474-10-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Grade Working Group.http://www.gradeworkinggroup.org,
- Williamson PR, Altman DG, Blazeby JM, Clarke M, Devance D, Gargon E, Tugwell P: Developing core outcome sets for clinical trials: issues to consider. Trials. 2012, 13: 132-10.1186/1745-6215-13-132.View ArticlePubMedPubMed CentralGoogle Scholar
- Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2 (3): 1-88. i–ivGoogle Scholar
- Vella K, Goldfrad C, Rowan K, Bion J, Black N: Use of consensus development to establish national research priorities in critical care. BMJ. 2000, 320: 976-980. 10.1136/bmj.320.7240.976.View ArticlePubMedPubMed CentralGoogle Scholar
- Sarre G, Cooke J: Developing indicators for measuring research capacity development in primary care organizations: a consensus approach using a nominal group technique. Health Soc Care Community. 2009, 17: 244-253. 10.1111/j.1365-2524.2008.00821.x.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.