Skip to main content

Do outcomes reported in randomised controlled trials of joint replacement surgery fulfil the OMERACT 2.0 Filter? A review of the 2008 and 2013 literature

Abstract

Background

It is not known, whether outcome reporting in trials of total joint arthroplasty in the recent years is adequate or not. Our objective was to assess whether outcomes reported in total joint replacement (TJR) trials fulfil the Outcome Measures in Rheumatology (OMERACT) Filter 2.0.

Methods

We systematically reviewed all TJR trials in adults, published in English in 2008 or 2013. Searches were conducted in the Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE. Two authors independently applied the inclusion criteria for the studies, and any disagreement was resolved with a third review author. All outcome measures were abstracted using a pre-piloted standardised data extraction form and assessed for whether they mapped to one of the three OMERACT Filter 2.0 core areas: pathophysiological, life impact, and death.

Results

From 1635 trials identified, we included 70 trials (30 in 2008 and 40 in 2013) meeting the eligibility criteria. Twenty-two (31%) trials reported the three essential OMERACT core areas. Among the 27 hip replacement surgery trials and 39 knee replacement surgery trials included, 11 hip (41%) and nine knee (23%) trials reported all three essential OMERACT core areas. The most common outcome domains/measures were pain (20/27, 74%) and function (23/27, 85%) in hip trials and pain (26/39, 67%) and function (27/39, 69%) in knee trials. Results were similar for shoulder and hand joint replacement trials.

Conclusions

We identified significant gaps in the measurement of OMERACT core outcome areas in TJR trials, despite the majority reporting outcome domains of pain and function. An international consensus of key stakeholders is needed to develop a core domain set for reporting of TJR trials.

Systematic review registration

PROSPERO CRD42014009216

Peer Review reports

Background

For a randomised controlled trial (RCT) to discern the true effect of an intervention, relevant and robust outcome measures must be chosen. A standardised set of outcome measures used across similar types of trials has the potential to increase their efficiency and value by enabling comparisons between trials and pooling of data, thereby providing more precise estimates of the treatment effect.

Twenty years ago the World Health Organization (WHO) and the International League of Associations for Rheumatology (ILAR) established a core set of outcomes for clinical trials in rheumatoid arthritis. This work originated from the Outcome Measures in Rheumatology (OMERACT) group that developed a framework and methodology (i.e. the OMERACT Filter), for the identification and validation of core outcome measurement sets for use in clinical trials, for any health condition [1]. The OMERACT group has gone on to develop successful core outcome measurement sets for other conditions including ankylosing spondylitis and gout, and the OMERACT Filter and methodology has been widely adopted internationally within the rheumatology community [1,2,3] and other disciplines [4,5,6].

Within the discipline of orthopaedic surgery, the development of a core outcome measurement set for trials involving patients with hip fractures is underway [7]. To our knowledge, there are currently no standardised or universally accepted core outcome measurement sets for clinical trials of joint replacement surgery. With over a million hip and knee joint replacements done each year in the USA alone [8], and the technology for joint replacement surgery evolving rapidly, there is a need for high-quality randomised controlled trials (RCTs). The use of standardised measures of outcome assessment in trials involving joint replacement will facilitate accurate and effective comparisons of new and existing joint replacement implants and techniques, as well as accurate and effective evaluation of the value of pre- and post-operative interventions.

In order to improve the reporting of relevant health outcome domains within joint replacement trials and develop a standard core set, a working group within OMERACT was established in 2008 and preliminary work was completed [9,10,11]. This work demonstrated the lack of well-validated outcome instruments in knee and hip clinical trials and identified the need to develop core outcome domains and a core outcome measurement set with the goal of harmonisation of outcome measures used in joint replacement clinical trials.

The OMERACT Filter 2.0 defines three “core areas” that should be measured within a clinical trial of any disease condition: death, life impact, and pathophysiological manifestations [1]; it also strongly recommends the measurement of resource utilisation. The OMERACT Filter 2.0 provides a roadmap, describing the steps to achieve a final core measurement set for clinical trials for a given condition. Firstly, it recommends relevant stakeholders start by identifying at least one “domain” within each of the core areas to formulate the “core domain set;” an additional file shows this in more detail (see Additional file 1). At least one applicable measurement instrument for each core domain is then identified to formulate a “core outcome measurement set.” Each measurement instrument must prove to be truthful (valid), discriminative, and reliable.

At the OMERACT-12 Meeting (2014), clinical and methodological experts in epidemiology, psychometrics, orthopaedics, and rheumatology along with patient partners interested in harmonising outcomes for people undergoing joint replacement surgery met as a working group. The ultimate aim of the group is to develop and reach international consensus on a core outcome measurement set for joint replacement surgery. In preparation for the meeting, we systematically examined the outcomes reported in all randomised controlled trials of joint replacement surgery published in 2008 and 2013. We found suboptimal reporting of primary outcomes in TJR trials as well as heterogeneity in the primary outcomes when reported [12]. In this paper, we report the extent to which the outcomes reported in the trials fulfil the OMERACT Filter 2.0 core areas of mortality, life impact, and pathophysiological manifestations, and the OMERACT Filter 2.0 strongly recommended area, resource use.

Methods

We undertook the review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [13, 14]. A PRISMA checklist is provided as an additional file that shows this in more detail (see Additional file 2). The protocol for this review was registered with the International Prospective Register of Systematic Reviews (PROSPERO; Registration number: CRD42014009216).

We included all randomised or quasi-randomised (where allocation not strictly random) controlled trials investigating joint replacement surgery (defined as substitution of any joint surface with a prosthesis) in adult patients ≥18 years published in either 2008 or 2013. We chose 2 years only (2008 and 2013) for our study for two reasons: we anticipated that a 2-year data including a recent year would provide us with a reasonable sample size for our main study to assess consistency with OMERACT filter 2.0 [1]; and a secondary objective was to assess study quality and outcome reporting over time (2008 to 2013) and due to feasibility issues, since we expected >100 studies per year to be eligible, limited resources prohibited a review of 6-year trial data (reported in a separate manuscript ) [12]. We excluded trials investigating spinal joint replacement surgery and those trials where the intervention of interest was not part of the intraoperative insertion of joint replacement prosthesis, for example, trials investigating pre-operative education, peri-operative analgesia, or post-operative care.

The comparator could include another type of joint implant, surgical placebo or sham, usual care, physical therapy, or other active treatments. Trials were included if at least one outcome had been reported. Only trials published in English as full articles or available as full trial report were included.

We searched the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, and hand searched reference lists of relevant articles for randomised or quasi-randomised controlled trials on 20 March 2014. We limited the search to publications in 2008 and 2013, in order to capture recent trials. The search strategy used for MEDLINE is provided as an additional file and shows this in more detail (see Additional file 3).

Two authors (BR and PW) independently assessed the search results based on the title and abstract, and the full texts of all potentially eligible studies were then assessed to identify studies that fulfilled inclusion criteria. Any disagreement in study selection was resolved by consensus or by discussion with a third review author (RB).

Trial details were extracted for each trial including the first author, year of publication, and interventions. Additional details including number of participants, year of recruitment, study duration, and sample size were also extracted but are reported in a separate manuscript [12].

We extracted all outcome measures using a standardised data extraction form. Outcome measures were then grouped according to outcome domains and then grouped according to the three OMERACT core areas, pathophysiological, life impact, and death or the recommended area, resource use. Joint-specific multidimensional outcome measures were broken down into constituent outcome domains and then grouped according to the four OMERACT core areas. The data was then aggregated and reported using simple summary statistics.

Results

There were a total of 1635 potential studies identified from the initial searches after de-duplication (41 duplicates in 2008 and 60 duplicates in 2013), and 70 trials (30 published in 2008 and 40 published in 2013) met the eligibility criteria and were included in the review (Fig. 1). Screening of titles/abstracts was done over 3 weeks, data abstraction over the next 4–6 weeks and data analyses for the 4 weeks after that. No published trials of joint replacement involving the foot, ankle, or elbow were identified. There were 27 trials for hip, 39 trials for knee, three trials for shoulder, and one trial for replacement surgery of the small joints (Table 1). The inter-rater agreement was 86% for 2008 and 93% for 2013 initial abstractions. One hundred percent consensus was reached by discussion and with involvement of a third reviewer. There were 13 joint-specific multidimensional outcome tools reported; all of which measured outcome domains of both pain and function (Table 2). Nine (69%) of the joint-specific multidimensional outcome tools were patient reported.

Fig. 1
figure 1

We identified 1635 potential studies  from the initial searches after de-duplication (41 duplicates in 2008 and 60 duplicates in 2013 were removed). Seventy trials, 30 published in 2008 and 40 published in 2013 met the eligibility criteria

Table 1 Studies of hip and knee arthroplasty from 2008 to 2013
Table 2 Constituent outcomes for multidimensional joint-specific outcome tools

A mean of six outcome domains were reported per trial. Twenty-two (31%) trials reported outcome domains/measures in all three of the essential OMERACT core areas (pathophysiological, life impact, and death), and 21 (30%) trials reported outcome domains/measures in the recommended area of resource utilisation.

Hip replacement trial outcome domains

Twenty-seven trials of hip replacement surgery were included (10 published in 2008 and 17 published in 2013) (Table 3). Eighteen unique outcome measures were identified with a mean of six outcome measures per trial. Eleven (41%) trials reported an outcome domain/measure within all three of the essential OMERACT core areas. The most common outcome domains/measures reported were pain (20/27, 74%) and function (23/27, 85%).

Table 3 Hip RCT outcomes and their mapping to the three core and one optional OMERACT areas/domains

Seven unique outcome domains/measures mapped to core area pathophysiological, five mapped to life impact, five mapped to resource use and one mapped to death. Core area pathophysiological was represented most frequently with 86 instances of mapping to this area.

Knee replacement trial outcome domains

Thirty-nine trials of knee replacement surgery were included (19 published in 2008 and 20 in 2013) (Table 4). Twenty-one individual outcome domains/measures were identified with a mean of six per trial. Nine (23%) trials reported an outcome domain/measure within all three of the essential OMERACT core areas. The most common outcome domains/measures were pain (26/39, 67%) and function (27/39, 69%). Nine outcome domains mapped to pathophysiological, five mapped to life impact, six mapped to resource use and one outcome mapped to death. Core area pathophysiological was represented most frequently, with 150 instances of mapping to this area.

Table 4 Knee study outcomes and their mapping to three core and one optional OMERACT areas/domains

Shoulder replacement trial outcome domains

There were three (4%) trials of shoulder replacement surgery; an additional file shows this in more detail (see Additional file 4). Outcome domains/measures of pain, strength, and activity levels were reported in all three trials. Seven outcome domains mapped to pathophysiological, three mapped to life impact, and one outcome domain mapped to death. Core area pathophysiological was represented most frequently with 12 instances of mapping to this area.

Hand joint replacement outcome domains

There was one (1%) trial involving replacement of the small joints of the hand reporting six individual outcome domains/measures with four mapping to pathophysiological and two to life impact core areas. An additional file shows this in more detail (see Additional file 4).

Discussion

The purpose of this systematic review was to examine and highlight inconsistencies in reporting of joint replacement trials and make recommendations for future studies in the area. This systematic review has highlighted that there are significant gaps in the measurement of OMERACT core outcome areas in joint replacement trials. Less than a third (31%) of trials captured outcome domains/measures within all three essential OMERACT core areas. The majority of joint replacement trials (but not all) did, however, capture outcome domains/measures of pain (71%) and function (77%). This finding is in keeping with the principles and primary indications for joint replacement surgery, which are to relieve pain and improve function. All of the joint-specific multidimensional outcome tools included in the trials capture both pain and function, which is a reflection that these measures are well established and accepted by the orthopaedic community for monitoring outcomes after joint replacement surgery [15].

All trials captured domains within the core area of pathophysiological manifestations, with many trials reporting surrogate outcome domains such as radiosteriometric analysis (RSA) and plain radiographs to assess implant loosening. RSA uses x-rays to determine the implant position and is a well-validated tool for measuring the movement of implants following joint replacement surgery. RSA requires specialist equipment and training to use and therefore really only has a role in early/short-term clinical evaluation of joint replacements. The correlation between movement detected on RSA and longer term clinically meaningful implant failure is not well documented or validated [16]. It is not surprising that the OMERACT filter 2.0 framework specifies both pathophysiological manifestations and life impact (such as pain, function, mobility, quality of life) as two of the three core areas for any disease construct. In our example, filter 2.0 indicates that it is just as important (if not more) to know the true clinical impact of a difference in implant positioning between interventions, i.e. implant failure/revision and pain, function, quality of life (impact on the patient) as is knowing the exact positioning of the implant (e.g. by RSA).

Measurement of mortality is one of the three core areas of the OMERACT Filter 2.0, but was reported in only 36% of the trials reviewed. In addition, none of the trials reported whether or not mortality was considered attributable to the interventions under study or underlying condition/s. Measurement and reporting of 7-, 30- and 90-day mortality, or mortality during the trial (3 or 6 or 12 months) could capture potential intervention-related versus unrelated deaths and be supplemented with a case by case review to determine the cause of death. For joint replacement, which is usually an elective procedure, mortality is rare, but unexpected. Therefore, mortality reporting is very important. As in any clinical trial, study subject mortality is always known to the investigator and its reporting is quite simple, i.e. “there were no deaths in this trial,” and or adding a row with zeros (or the number applicable) to the table showing adverse events of each intervention being compared.

We also found that less than a third (31%) of trials captured the OMERACT recommended area of resource utilisation. Without comprehensive data about resource utilisation, it is difficult to determine the true comparative effectiveness (and cost-effectiveness) of one type of joint replacement compared to another. A potential reason for this may be a lack of appropriate outcome measures or a lack of consensus as to which outcome measure/s to use. Joint replacement is typically an elective surgery, and therefore, in principle, resource utilisation is pertinent and appropriate to capture from both the individual’s and system’s perspective. Outcome tools would need to be identified which could capture the individual initial costs of surgery and follow-up hospital visits but also any additional costs incurred as a result of further surgery or its complications.

One of the limitations of this review is that we only included two snapshots of joint replacement research trials, i.e. trial results published in 2008 and 2013. Our results may therefore not be truly representative of periods just before, between and after these dates. On the other hand, there is no reason to suspect that outcomes/measures and trial reporting would differ significantly different in other years.

Successful adoption of the original OMERACT filter [17] for validation of measures has led to the successful development and implementation of core domain sets and core measurement sets for various rheumatic and non-rheumatic diseases [1, 4,5,6, 18]. An updated version, OMERACT filter 2.0, is based on the WHO framework [1]. OMERACT filter 2.0 provides a practical framework to develop and validate domains and measures for any health condition. A pragmatic approach is to use a data-driven, consensus-based process with multi-stakeholder involvement to define a minimum measurement set for all joint replacement trials. In line with the OMERACT working group’s future agenda for achieving an international consensus-based core domain set for joint replacement trials, and building upon the findings of this review, we have derived a preliminary core domain set for joint replacement clinical trials based on the OMERACT filter 2.0 and multi-stakeholder consensus. The joint replacement clinical trial core domain set includes six core domains: pain, function, patient satisfaction, revision, adverse events, and death [19].

Conclusions

In conclusion, this systematic review provides insights into the outcome areas/domains being used and reported in contemporary joint replacement RCTs and highlights the gaps in this area. The minimum standard of outcome reporting within joint replacement trials needs improvement. The OMERACT Filter [1] provides a well-established methodology for improving this, i.e. providing guidance and methods for developing a core outcome measurement set. RCTs are expensive time-consuming studies. As researchers, we have a duty to patients to extract as much clinically useful information as possible. The development of a core outcome measurement set for joint replacement trials would undoubtedly help to strengthen both the design and subsequent reporting of results in much the same way as it has within rheumatology clinical trials, and hopefully advance the field at an accelerated pace, by allowing comparisons across trials and standard meta-analyses.

Abbreviations

AE:

Adverse events

CCTs:

Controlled clinical trials

LoI:

Length of incision

LoS:

Length of stay

OMERACT:

Outcome Measures in Rheumatology

QoL:

Quality of life

RCT:

Randomised controlled trial

RCTs:

Randomised controlled trials

RMAL:

Radiographs to measure alignment or loosening

RSA:

Radiosteriometric analysis

Satis:

Satisfaction

THR:

Total hip replacement

TJA:

Total joint arthroplasty

TKR:

Total knee replacement

UAB:

University of Alabama at Birmingham

WG:

Working group

WHO:

World Health Organization

References

  1. Boers M, Kirwan JR, Wells G, Beaton D, Gossec L, d’Agostino MA, et al. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol. 2014;67(7):745–53.

    Article  PubMed  Google Scholar 

  2. Felson DT, Anderson JJ, Boers M, Bombardier C, Furst D, Goldsmith C, et al. American College of Rheumatology. Preliminary definition of improvement in rheumatoid arthritis. Arthritis Rheum. 1995;38(6):727–35.

    Article  CAS  PubMed  Google Scholar 

  3. Schumacher HR, Taylor W, Edwards L, Grainger R, Schlesinger N, Dalbeth N, et al. Outcome domains for studies of acute and chronic gout. J Rheumatol. 2009;36(10):2342–5.

    Article  PubMed  Google Scholar 

  4. Chiarotto A, Terwee CB, Deyo RA, Boers M, Lin CW, Buchbinder R, et al. A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set. Trials. 2014;15:511.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hall NJ, Kapadia MZ, Eaton S, Chan WW, Nickel C, Pierro A, et al. Outcome reporting in randomised controlled trials and meta-analyses of appendicitis treatments in children: a systematic review. Trials. 2015;16:275.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Schmitt J, Spuls PI, Thomas KS, Simpson E, Furue M, Deckert S, et al. The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials. J Allergy Clin Immunol. 2014;134(4):800–7.

    Article  PubMed  Google Scholar 

  7. Haywood KL, Griffin XL, Achten J, Costa ML. Developing a core outcome set for hip fracture trials. Bone Joint J. 2014;96-B(8):1016–23.

    Article  CAS  PubMed  Google Scholar 

  8. National Institue of Arthritis and Musculoskeletal and Skin Diseases. Joint Replacement Surgery: Health Information Basics For You And Your Family. 2014. [Available from: http://www.niams.nih.gov/Health_info/Joint_Replacement/default.asp - 4.

    Google Scholar 

  9. Riddle DL, Stratford PW, Bowman DH. Findings of extensive variation in the types of outcome measures used in hip and knee replacement clinical trials: a systematic review. Arthritis Rheum. 2008;59(6):876–83.

    Article  PubMed  Google Scholar 

  10. Riddle DL, Stratford PW, Singh JA, Strand CV. Variation in outcome measures in hip and knee arthroplasty clinical trials: a proposed approach to achieving consensus. J Rheumatol. 2009;36(9):2050–6.

    Article  PubMed  Google Scholar 

  11. Gossec L, Paternotte S, Bingham 3rd CO, Clegg DO, Coste P, Conaghan PG, et al. OARSI/OMERACT initiative to define states of severity and indication for joint replacement in hip and knee osteoarthritis. An OMERACT 10 Special Interest Group. J Rheumatol. 2011;38(8):1765–9.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Richards B, Wall PDH, Sprowson AP, Singh JA, Buchbinder R. Outcome measures used in arthroplasty trials: Systematic review of the 2008 and 2013 literature. J Rheumatol. 2017. doi:10.3899/jrheum.161477. [Epub ahead of print]. PMID:28507180.

  13. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    Article  PubMed  Google Scholar 

  16. Karrholm J, Gill RH, Valstar ER. The history and future of radiostereometric analysis. Clin Orthop Relat Res. 2006;448:10–21.

    Article  PubMed  Google Scholar 

  17. Boers M, Brooks P, Strand CV, Tugwell P. The OMERACT filter for Outcome Measures in Rheumatology. J Rheumatol. 1998;25(2):198–9.

    CAS  PubMed  Google Scholar 

  18. Felson DT, Anderson JJ, Boers M, Bombardier C, Chernoff M, Fried B, et al. The American College of Rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials. The Committee on Outcome Measures in Rheumatoid Arthritis Clinical Trials. Arthritis Rheum. 1993;36(6):729–40.

    Article  CAS  PubMed  Google Scholar 

  19. Singh JA, Dohm M, Sprowson AP, Wall PD, Richards BL, Gossec L, et al. Outcome Domains and Measures in Total Joint Replacement Clinical Trials: Can We Harmonize Them? An OMERACT Collaborative Initiative. J Rheumatol. 2015;42(12):2496–502.

  20. Garcia-Rey E, Garcia-Cimbrelo E, Cruz-Pardos A, Ortega-Chamarro J. New polyethylenes in total hip replacement: a prospective, comparative clinical study of two types of liner. J Bone Joint Surg Br. 2008;90(2):149–53.

    Article  CAS  PubMed  Google Scholar 

  21. Glyn-Jones S, Isaac S, Hauptfleisch J, McLardy-Smith P, Murray DW, Gill HS. Does highly cross-linked polyethylene wear less than conventional polyethylene in total hip arthroplasty? A double-blind, randomized, and controlled trial using roentgen stereophotogrammetric analysis. J Arthroplasty. 2008;23(3):337–43.

    Article  PubMed  Google Scholar 

  22. Glyn-Jones S, McLardy-Smith P, Gill HS, Murray DW. The creep and wear of highly cross-linked polyethylene: a three-year randomised, controlled trial using radiostereometric analysis. J Bone Joint Surg. 2008;90(5):556–61.

    Article  CAS  Google Scholar 

  23. Hamadouche M, Baque F, Lefevre N, Kerboull M. Minimum 10-year survival of Kerboull cemented stems according to surface finish. Clin Orthop Relat Res. 2008;466(2):332–9.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Lachiewicz PF, Kelley SS, Soileau ES. Survival of polished compared with precoated roughened cemented femoral components: a prospective, randomized study. J Bone Joint Surg Ser A. 2008;90(7):1457–63.

    Article  Google Scholar 

  25. Macaulay W, Nellans KW, Garvin KL, Iorio R, Healy WL, Rosenwasser MP. Prospective randomized clinical trial comparing hemiarthroplasty to total hip arthroplasty in the treatment of displaced femoral neck fractures. Winner of the Dorr Award. J Arthroplasty. 2008;23(6 SUPPL):2–8.

    Article  PubMed  Google Scholar 

  26. Meneghini RM, Smits SA, Swinford RR, Bahamonde RE. A randomized, prospective study of 3 minimally invasive surgical approaches in total hip arthroplasty. comprehensive gait analysis. J Arthroplasty. 2008;23(6 SUPPL):68–73.

    Article  PubMed  Google Scholar 

  27. Mouzopoulos G, Stamatakos M, Arabatzi H, Vasiliadis G, Batanis G, Tsembeli A, et al. The four-year functional result after a displaced subcapital hip fracture treated with three different surgical options. Int Orthop. 2008;32(3):367–73.

    Article  PubMed  Google Scholar 

  28. Pagnano MW, Trousdale RT, Meneghini RM, Hanssen AD. Slower recovery after two-incision than mini-posterior-incision total hip arthroplasty: a randomized clinical trial. J Bone Joint Surg Ser A. 2008;90(5):1000–6.

    Article  Google Scholar 

  29. Pitto RP, Bhargava A, Pandit S, Munro JT. Retroacetabular stress-shielding in THA. Clin Orthop. 2008;466(2):353–8.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Barrett WP, Turner SE, Leopold JP. Prospective randomized study of direct anterior vs postero-lateral approach for total hip arthroplasty. J Arthroplasty. 2013;28(9):1634–8.

    Article  PubMed  Google Scholar 

  31. Bjorgul K, Novicoff WN, Andersen ST, Ahlund OR, Bunes A, Wiig M, et al. High rate of revision and a high incidence of radiolucent lines around Metasul metal-on-metal total hip replacements: results from a randomised controlled trial of three bearings after seven years. Bone Joint J. 2013;95 B(7):881–6.

    Article  PubMed  Google Scholar 

  32. Cadossi M, Chiarello E, Savarino L, Tedesco G, Baldini N, Faldini C, et al. A comparison of hemiarthroplasty with a novel polycarbonate-urethane acetabular component for displaced intracapsular fractures of the femoral neck: a randomised controlled trial in elderly patients. [Erratum appears in Bone Joint J. 2013 Nov;95-B(11):1582]. Bone Joint J. 2013;95-B(5):609–15.

    Article  CAS  PubMed  Google Scholar 

  33. Desmarchelier R, Viste A, Chouteau J, Lerat JL, Fessy MH. Metasul vs cerasul bearings. A prospective, randomized study at 9 years. J Arthroplasty. 2013;28(2):296–302.

    Article  PubMed  Google Scholar 

  34. Greidanus NV, Chihab S, Garbuz DS, Masri BA, Tanzer M, Gross AE, et al. Outcomes of minimally invasive anterolateral THA are not superior to those of minimally invasive direct lateral and posterolateral THA hip. Clin Orthop Relat Res. 2013;471(2):463–71.

    Article  PubMed  Google Scholar 

  35. Hedbeck CJ, Inngul C, Blomfeldt R, Ponzer S, Tornkvist H, Enocson A. Internal fixation versus cemented hemiarthroplasty for displaced femoral neck fractures in patients with severe cognitive dysfunction: a randomized controlled trial. J Orthop Trauma. 2013;27(12):690–5.

    Article  PubMed  Google Scholar 

  36. Inngul C, Hedbeck CJ, Blomfeldt R, Lapidus G, Ponzer S, Enocson A. Unipolar hemiarthroplasty versus bipolar hemiarthroplasty in patients with displaced femoral neck fractures. A four-year follow-up of a randomised controlled trial. Int Orthop. 2013;37(12):2457–64.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kim YH, Park JW, Kulkarni SS. A randomised prospective evaluation of ceramic-on-ceramic and ceramic-on-highly cross-linked polyethylene bearings in the same patients with primary cementless total hip arthroplasty. Int Orthop. 2013;37(11):2131–7.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Landgraeber S, Quitmann H, Guth S, Haversath M, Kowalczyk W, Kecskemethy A, et al. A prospective randomized peri- and post-operative comparison of the minimally invasive anterolateral approach versus the lateral approach. Orthop Rev. 2013;5(3):87–92.

    Article  Google Scholar 

  39. Munzinger U, Guggi T, Kaptein B, Persoon M, Valstar E, Cornelis Doets H. A titanium plasma-sprayed cup with and without hydroxyapatite-coating: a randomised radiostereometric study of stability and osseointegration. Hip Int. 2013;23(1):33–9.

    Article  PubMed  Google Scholar 

  40. Naudie DDR, Somerville L, Korczak A, Yuan X, McCalden RW, Holdsworth D, et al. A randomized trial comparing acetabular component fixation of two porous ingrowth surfaces using RSA. J Arthroplasty. 2013;28(8 SUPPL):48–52.

    Article  PubMed  Google Scholar 

  41. Penny JO, Ovesen O, Varmarken J-E, Overgaard S. Similar range of motion and function after resurfacing large-head or standard total hip arthroplasty. Acta Orthop. 2013;84(3):246–53.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Smolders JMH, Pakvis DF, Hendrickx BW, Verdonschot N, van Susante JLC. Periacetabular bone mineral density changes after resurfacing hip arthroplasty versus conventional total hip arthroplasty: a randomized controlled DEXA study. J Arthroplasty. 2013;28(7):1177–84.

    Article  PubMed  Google Scholar 

  43. Stiehler M, Goronzy J, Hartmann A, Krummenauer F, Gunther K-P. The First SICOT Oral Presentation Award 2011: imageless computer-assisted femoral component positioning in hip resurfacing: a prospective randomised trial. Int Orthop. 2013;37(4):569–81.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Vendittoli PA, Riviere C, Lavigne M, Lavoie P, Alghamdi A, Duval N. Alumina on alumina versus metal on conventional polyethylene: a randomized clinical trial with 9 to 15 years follow-up. Acta Orthop Belg. 2013;79(2):181–90.

    PubMed  Google Scholar 

  45. Vidovic D, Matejcic A, Punda M, Ivica M, Tomljenovic M, Bekavac-Beslin M, et al. Periprosthetic bone loss following hemiarthroplasty: a comparison between cemented and cementless hip prosthesis. Injury. 2013;44 SUPPL 3:S62–6.

    Article  PubMed  Google Scholar 

  46. Zagra L, Anasetti F, Bianchi L, Licari V, Giacometti Ceroni R. No difference in gait recovery after THA with different head diameters: a prospective randomized study. Clin Orthop Relat Res. 2013;471(12):3830–7.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Breugem SJ, Sierevelt IN, Schafroth MU, Blankevoort L, Schaap GR, van Dijk CN. Less anterior knee pain with a mobile-bearing prosthesis compared with a fixed-bearing prosthesis. Clin Orthop Relat Res. 2008;466(8):1959–65.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Chaudhary R, Beaupre LA, Johnston DW. Knee range of motion during the first two years after use of posterior cruciate-stabilizing or posterior cruciate-retaining total knee prostheses. A randomized clinical trial. J Bone Joint Surg. 2008;90(12):2579–86. American volume.

    Article  CAS  PubMed  Google Scholar 

  49. Dutton AQ, Yeo SJ, Yang KY, Lo NN, Chia KU, Chong HC. Computer-assisted minimally invasive total knee arthroplasty compared with standard total knee arthroplasty. A prospective, randomized study. J Bone Joint Surg. 2008;90(1):2–9. American volume.

    Article  PubMed  Google Scholar 

  50. Findlay IA, Bowman NK, Miles K, East DJ, Apthorp HD, Butler-Manuel A. The AGC total knee replacement-cemented versus cementless hydroxyapatite fixation. Proceedings of the International Symposium on Current Topics in Knee Arthroplasty: 13th - 15th June 2007, Marbella, Spain; Selected Scientific Papers. J Bone Joint Surg. July 2008; Volume 90-B, Issue SUPP II.

  51. Hall J, Copp SN, Adelson WS, D’Lima DD, Colwell Jr CW. Extensor mechanism function in single-radius vs multiradius femoral components for total knee arthroplasty. J Arthroplasty. 2008;23(2):216–9.

    Article  PubMed  Google Scholar 

  52. Han I, Seong SC, Lee S, Yoo JH, Lee MC. Simultaneous bilateral MIS-TKA results in faster functional recovery. Clin Orthop. 2008;466(6):1449–53.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Hansson U, Ryd L, Toksvig-Larsen S. A randomised RSA study of peri-Apatite HA coating of a total knee prosthesis. Knee. 2008;15(3):211–6.

    Article  PubMed  Google Scholar 

  54. Harato K, Bourne RB, Victor J, Snyder M, Hart J, Ries MD. Midterm comparison of posterior cruciate-retaining versus -substituting total knee arthroplasty using the Genesis II prosthesis. A multicenter prospective randomized clinical trial. Knee. 2008;15(3):217–21.

    Article  PubMed  Google Scholar 

  55. Karachalios T, Giotikas D, Roidis N, Poultsides L, Bargiotas K, Malizos KN. Total knee replacement performed with either a mini-midvastus or a standard approach: a prospective randomised clinical and radiological trial. J Bone Joint Surg Ser B. 2008;90(5):584–91.

    Article  Google Scholar 

  56. Ladermann A, Lubbeke A, Stern R, Riand N, Fritschy D. Fixed-bearing versus mobile-bearing total knee arthroplasty: a prospective randomised, clinical and radiological study with mid-term results at 7 years. Knee. 2008;15(3):206–10.

    Article  CAS  PubMed  Google Scholar 

  57. Lionberger DR, Weise J, Ho DM, Haddad JL. How does electromagnetic navigation stack up against infrared navigation in minimally invasive total knee arthroplasties? J Arthroplasty. 2008;23(4):573–80.

    Article  PubMed  Google Scholar 

  58. Lozano LM, Segur JM, Macule F, Nunez M, Torner P, Castillo F, et al. Intramedullary versus extramedullary tibial cutting guide in severely obese patients undergoing total knee replacement: a randomized study of 70 patients with Body Mass Index >35 kg/m2. Obes Surg. 2008;18(12):1599–604.

    Article  CAS  PubMed  Google Scholar 

  59. Luring C, Beckmann J, Haibock P, Perlick L, Grifka J, Tingart M. Minimal invasive and computer assisted total knee replacement compared with the conventional technique: a prospective, randomised trial. Knee Surg Sports Traumatol Arthrosc. 2008;16(10):928–34.

    Article  CAS  PubMed  Google Scholar 

  60. Lutzner J, Krummenauer F, Wolf C, Gunther KP, Kirschner S. Computer-assisted and conventional total knee replacement: a comparative, prospective, randomised study with radiological and CT evaluation. J Bone Joint Surg Ser B. 2008;90(8):1039–44.

    Article  CAS  Google Scholar 

  61. Nutton RW, van der Linden ML, Rowe PJ, Gaston P, Wade FA. A prospective randomised double-blind study of functional outcome and range of flexion following total knee replacement with the NexGen standard and high flexion components. J Bone Joint Surg Br. 2008;90(1):37–42.

    Article  CAS  PubMed  Google Scholar 

  62. Oberst M, Bertsch C, Konrad G, Lahm A, Holz U. CT analysis after navigated versus conventional implantation of TKA. Arch Orthop Trauma Surg. 2008;128(6):561–6.

    Article  PubMed  Google Scholar 

  63. Smith AJ, Wood DJ, Li MG. Total knee replacement with and without patellar resurfacing: a prospective, randomised trial using the profix total knee system. J Bone Joint Surg Br. 2008;90(1):43–9.

    Article  CAS  PubMed  Google Scholar 

  64. Therbo M, Lund B, Jensen KE, Schroder HM. Effect of bioactive coating of the tibial component on migration pattern in uncemented total knee arthroplasty: a randomized RSA study of 14 knees presented according to new RSA-guidelines. J Orthop Traumatol. 2008;9(2):63–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Wylde V, Learmonth I, Potter A, Bettinson K, Lingard E. Patient-reported outcomes after fixed- versus mobile-bearing total knee replacement: a multi-centre randomised controlled trial using the Kinemax total knee replacement. [Erratum appears in J Bone Joint Surg Br. 2008 Nov;90(11):1534]. J Bone Joint Surg Br. 2008;90(9):1172–9.

    Article  CAS  PubMed  Google Scholar 

  66. Aggarwal AK, Agrawal A. Mobile vs fixed-bearing total knee arthroplasty performed by a single surgeon. A 4- to 6.5-year randomized, prospective, controlled, double-blinded study. J Arthroplasty. 2013;28(10):1712–6.

    Article  PubMed  Google Scholar 

  67. Breeman S, Campbell MK, Dakin H, Fiddian N, Fitzpatrick R, Grant A, et al. Five-year results of a randomised controlled trial comparing mobile and fixed bearings in total knee replacement. Bone Joint J. 2013;95 B(4):486–92.

    Article  PubMed  Google Scholar 

  68. Chareancholvanich K, Narkbunnam R, Pornrattanamaneewong C. A prospective randomised controlled study of patient-specific cutting guides compared with conventional instrumentation in total knee replacement. Bone Joint J. 2013;95-B(3):354–9.

    Article  CAS  PubMed  Google Scholar 

  69. Dennis DA, Heekin RD, Clark CR, Murphy JA, O’Dell TL, Dwyer KA. Effect of implant design on knee flexion. J Arthroplasty. 2013;28(3):429–38.

    Article  PubMed  Google Scholar 

  70. Fischer M, von Eisenhart-Rothe R, Simank HG. Comparable short-term results seen with standard and high-flexion knee arthroplasty designs in European patients. J Orthop. 2013;10(3):119–22.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Hamilton DF, Simpson A, Burnett R, Patton JT, Moran M, Clement ND, et al. Lengthening the moment arm of the patella confers enhanced extensor mechanism power following total knee arthroplasty. J Orthop Res. 2013;31(8):1201–7.

    Article  PubMed  Google Scholar 

  72. Hamilton DF, Clement ND, Burnett R, Patton JT, Moran M, Howie CR, et al. Do modern total knee replacements offer better value for money? A health economic analysis. Int Orthop. 2013;37(11):2147–52.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Hamilton WG, Parks NL, Saxena A. Patient-specific instrumentation does not shorten surgical time: a prospective, randomized trial. J Arthroplasty. 2013;28(8 SUPPL):96–100.

    Article  PubMed  Google Scholar 

  74. Jarvis SL, Johnson-Wo AK, Onstot BR, Bhowmik-Stoker M, Shrader MW, Jacofsky MC, et al. Differences between standard and minimally invasive parapatellar surgical approaches for total knee arthroplasty in the tasks of sitting and standing. J Knee Surg. 2013;26(4):249–56.

    Article  PubMed  Google Scholar 

  75. Joseph J, Simpson PMS, Whitehouse SL, English HW, Donnelly WJ. The use of navigation to achieve soft tissue balance in total knee arthroplasty—A randomised clinical study. Knee. 2013;20(6):401–6.

    Article  CAS  PubMed  Google Scholar 

  76. Jung W, Chun C, Lee J, Ha J, Jeong JH. The accuracy of the extramedullary and intramedullary femoral alignment system in total knee arthroplasty for varus osteoarthritic knee. Knee Surg Sports Traumatol Arthrosc. 2013;21(3):629–35.

    Article  PubMed  Google Scholar 

  77. Nieuwenhuijse MJ, van der Voort P, Kaptein BL, van der Linden-van der Zwaag HM, Valstar ER, Nelissen RG. Fixation of high-flexion total knee prostheses: five-year follow-up results of a four-arm randomized controlled clinical and roentgen stereophotogrammetric analysis study. J Bone Joint Surg. 2013;95(19):e1411. American volume.

    Article  PubMed  Google Scholar 

  78. Nishizawa Y, Matsumoto T, Kubo S, Muratsu H, Matsushita T, Oka S, et al. The influence of patella height on soft tissue balance in cruciate-retaining and posterior-stabilised total knee arthroplasty. Int Orthop. 2013;37(3):421–5.

    Article  PubMed  Google Scholar 

  79. Pandit H, Liddle AD, Kendrick BJ, Jenkins C, Price AJ, Gill HS, et al. Improved fixation in cementless unicompartmental knee replacement: five-year results of a randomized controlled trial. J Bone Joint Surg Am. 2013;95(15):1365–72.

    Article  CAS  PubMed  Google Scholar 

  80. Radetzki F, Wienke A, Mendel T, Gutteck N, Delank KS, Wohlrab D. High flex total knee arthroplasty—a prospective, randomized study with results after 10 years. Acta Orthop Belg. 2013;79(5):536–40.

    PubMed  Google Scholar 

  81. Roh YW, Kim TW, Lee S, Seong SC, Lee MC. Is TKA using patient-specific instruments comparable to conventional TKA? A randomized controlled study of one system knee. Clin Orthop Relat Res. 2013;471(12):3988–95.

    Article  PubMed  PubMed Central  Google Scholar 

  82. Song EK, Seon JK, Yim JH, Netravali NA, Bargar WL. Robotic-assisted TKA reduces postoperative alignment outliers and improves gap balance compared to conventional TKA knee. Clin Orthop Relat Res. 2013;471(1):118–26.

    Article  PubMed  Google Scholar 

  83. Umrani SP, Cho KY, Kim KI. Patellar eversion does not adversely affect quadriceps recovery following total knee arthroplasty. J Arthroplasty. 2013;28(4):591–4.

    Article  PubMed  Google Scholar 

  84. Wegrzyn J, Parratte S, Coleman-Wood K, Kaufman KR, Pagnano MW. The John Insall award: no benefit of minimally invasive TKA on gait and strength outcomes: a randomized controlled trial. Clin Orthop Relat Res. 2013;471(1):46–55.

    Article  PubMed  Google Scholar 

  85. Yim J-H, Song E-K, Khan MS, Sun ZH, Seon J-K. A comparison of classical and anatomical total knee alignment methods in robotic total knee arthroplasty: classical and anatomical knee alignment methods in TKA. J Arthroplasty. 2013;28(6):932–7.

    Article  PubMed  Google Scholar 

  86. Fialka C, Stampfl P, Arbes S, Reuter P, Oberleitner G, Vecsei V. Primary hemiarthroplasty in four-part fractures of the proximal humerus: Randomized trial of two different implant systems. J Shoulder Elbow Surg. 2008;17(2):210–5.

    Article  PubMed  Google Scholar 

  87. Soliman OA, Koptan WMT. Proximal humeral fractures treated with hemiarthroplasty: does tenodesis of the long head of the biceps improve results? Injury. 2013;44(4):461–4.

    Article  PubMed  Google Scholar 

  88. Lapner PLC, Sabri E, Rakhra K, Bell K, Athwal GS. Healing rates and subscapularis fatty infiltration after lesser tuberosity osteotomy versus subscapularis peel for exposure during shoulder arthroplasty. J Shoulder Elbow Surg. 2013;22(3):396–402.

    Article  PubMed  Google Scholar 

  89. Hansen TB, Stilling M. Equally good fixation of cemented and uncemented cups in total trapeziometacarpal joint prostheses. Acta Orthop. 2013;84:98–105.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Andrew Sprowson died tragically on 13 March 2015. Andrew was an academic orthopaedic surgeon who was dedicated to improving evidence-based care in his field. He was an exceptionally enthusiastic researcher and surgeon and will be sadly missed by both his academic and clinical colleagues.

We thank OMERACT SIG participants including the patients to whom these findings were presented.

Funding

This work was partially supported by funding from OMERACT to the TJR working group. RB is supported by an Australian National Health and Medical Research Council (NHMRC) Senior Principal Research Fellowship. JAS was also supported by the resources and the use of facilities at the VA Medical Center at Birmingham, Alabama.

Availability of data and materials

All included studies undergoing review are published research articles and have been referenced within the text. A copy of the search strategy has also been included within the text.

Authors’ contributions

PW contributed to the study protocol, performed the data abstraction and data analyses, and wrote the first draft of the paper. BR contributed to the study protocol and performed the data abstraction and data analyses. RB contributed to the study protocol, reviewed the analyses, and served as the consensus reviewer. JAS contributed to the study protocol and reviewed analyses. All authors made revisions to the manuscript and read and approved the final manuscript.

Authors’ information

RB and JAS were co-chairs of the OMERACT special Interest group assessing the outcome measures in joint replacement surgery. RB is the current President of the Australian Rheumatology Association, current member of the Medical Services Advisory Committee (MSAC) and past Chair of the Working group for the Australian Clinical Care Standards for Osteoarthritis of the Knee. JAS has served as expert/lead on task forces for the specialty societies and the United States Food and Drug Administration.

Competing interests

JAS has received research grants from Takeda and Savient and consultant fees from Savient, Takeda, Regeneron, Merz, Bioiberica, Crealta, and Allergan pharmaceuticals, WebMD, UBM LLC, and the American College of Rheumatology. JAS serves as the principal investigator for an investigator-initiated study funded by Horizon pharmaceuticals through a grant to DINORA, Inc., a 501 (c)(3) entity. JAS is a member of the executive of OMERACT, an organisation that develops outcome measures in rheumatology and receives arms-length funding from 36 companies; a member of the American College of Rheumatology’s (ACR) Annual Meeting Planning Committee (AMPC); Chair of the ACR Meet-the-Professor, Workshop and Study Group Subcommittee; and a member of the Veterans Affairs Rheumatology Field Advisory Committee. None of the authors have any financial or non-financial conflict.

All authors have disclosed potential conflicts of interest, have read the journal’s policy on conflicts of interest and have read the journal’s authorship agreement.

Consent for publication

Not applicable.

Ethical approval and consent to participate

No ethical approval was needed, since this was a systematic review of published articles and did not involve any patient recruitment.

Availability of data and materials

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jasvinder A. Singh.

Additional information

Andrew Sprowson died on 13 March 2015

Additional files

Additional file 1:

OMERACT conceptual framework of Core Areas for outcome measurement in the setting of healthcare intervention studies—reproduced from M. Boers et al. 2013J Clinical Epidemiology. Description of data: This file shows the schema of OMERACT conceptual framework of Core Areas for outcome measurement in the setting of healthcare intervention studies, which is based on the World Health Organization’s (WHO) International Classification of Functioning, Disability and Health (ICF) framework and forms the basis of OMERACT Filter 2.0. (DOCX 142 kb)

Additional file 2:

PRISMA 2009 Checklist. Description of data: This file shows the PRISMA checklist for this systematic review. (DOCX 27 kb)

Additional file 3:

Example search strategy for MEDLINE. Description of data: This file shows an example of a search strategy for MEDLINE database. (DOCX 47 kb)

Additional file 4:

Shoulder and Hand Study Outcomes. Description of data: This file shows the included studies for shoulder and hand joint replacement and which of the core areas/domains of OMERACT Filter 2.0 were presented as outcomes in these trials. (DOCX 67 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wall, P.D.H., Richards, B.L., Sprowson, A. et al. Do outcomes reported in randomised controlled trials of joint replacement surgery fulfil the OMERACT 2.0 Filter? A review of the 2008 and 2013 literature. Syst Rev 6, 106 (2017). https://doi.org/10.1186/s13643-017-0498-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-017-0498-3

Keywords