A comparative assessment of three formulations of botulinum toxin A for facial rhytides: a systematic review and meta-analyses
© Bonaparte et al.; licensee BioMed Central Ltd. 2013
Received: 26 February 2013
Accepted: 22 May 2013
Published: 13 June 2013
Botulinum toxin A is a commonly used biological medication in the field of facial plastic surgery. Currently, there are three distinct formulations of botulinum toxin A, each with their purported benefits and advantages. However, there is considerable confusion as to the relative efficacy and side-effects associated with each formulation. Therefore, the purpose of this paper is to systematically assess published studies and perform a meta-analysis to determine if there is a significant advantage of any of the individual formulations.
A systematic literature search was performed for all relevant English language randomized controlled trials using Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), MEDLINE, World Health Organization (WHO) International Clinical Trials Registry Platform, European Union (EU) Clinical Trials Register, Cochrane Library databases of clinical trials, and ClinicalTrials.gov. Inclusion criteria included any randomized controlled trial (RCT) that assessed the use of botulinum toxin for cosmetic purposes. The included articles were also analyzed for bias using the Cochrane Collaboration’s tool for assessing the risk of bias in RCTs.
The results of this review will provide clinicians with an unbiased, high level of evidence of the comparative efficacy of individual preparations of botulinum toxin A.
Systematic review registration
KeywordsBotulinum toxin Cosmetics Skin wrinkling Systematic review Plastic surgery
Botulinum toxin type A is a commonly used biological medication for a variety of medical and cosmetic indications. Currently, there are three commonly used formulations of botulinum toxin A: onabotulinum toxin A (Botox or Vistabel (Allergen, Irvine, CA, USA), incobotulinum toxin A (Xeomin or Bocouture (Merz Pharmaceuticals, Frankfurt, Germany), and abobotulinum toxin A (Dysport (Medicis, Scottsdale, AZ, USA) or Azzalure (Ipsen, Paris, France). Each formulation is purported to have unique benefits; however, it is unclear if these differences are clinically significant. Producers of each formulation often highlight a number of factors distinguishing their product from their competitors. These features typically include: dose potency and/or equivalency , the onset of action , duration of action , local diffusion of the toxin [4, 5], side-effect profile , and differences in immunogenicity.
Manufacturers of botulinum toxin typically produce their product as a 150 to 900 kDa protein. This protein includes both the primary active component (the 150 kDa polypeptide chain)  as well as complexing proteins. The 150 kDa chain has low activity; however, once cleaved into a 50 kDa (light chain) and a 100 kDa (heavy chain) the toxin has the ability to exert its effect .
There is evidence to suggest that these complexing proteins are primarily responsible for protecting the toxin as it passes through mammalian gastrointestinal tracts [8, 9]. However, it has also been suggested that these proteins are responsible for the development of anti-toxin antibodies  which can result in the medication being ineffective. This is controversial since there is contrasting evidence, particularly given the notion that these accessory proteins may be required for adequate functioning of the active protein. For example, one of these proteins has been shown to disrupt epithelial integrity allowing the active protein entry into the cell .
One of the primary differences between botulinum toxin formulations is the presence or absence of these complexing proteins . The manufacturers of incobotulinum toxin A use this feature in marketing to professionals, particularly with respect to the proposed low potential for antigenicity . From a marketing perspective, it is understandable that manufacturers highlight this feature to distinguish it from other formulations. Clinically, however, it is unclear whether there is a significant effect of these molecular differences in terms of both antigenicity and efficacy.
With respect to dose equivalency, previous data suggest that abobotulinum toxin A and onabotulinum toxin have non-parallel dose–response curves, and thus differ in their relative potencies . Studies often assess these medications at varying dose ratios with abobotulinum toxin requiring 2 to 3 times the relative dose in ‘units’ compared to the other formulations. Even though dosing is described in terms of units, it is evident that the presumed clinical effect of 1 unit is not interchangeable between formulations . In addition to this, even within individual formulations, there is evidence to suggest that the specific dose influences both efficacy as well as the duration of effect, and therefore a comparison among studies is often difficult if varying doses are used .
More controversial, is the relative potency between onabotulinum and incobotulinum, since the dose in units is often reported as equivalent. A meta-analysis of the relative potency between these two medications was recently published . The author concluded that there was no difference in relative potencies between the two products using a standard unit dosing. However, this study only assessed one outcome measure, response rate at day 30, thus limiting its usefulness. It is unclear if this method of dosing also results in similar outcomes with respect to complication rates and long-term efficacy. Furthermore, of the eight studies meeting the primary inclusion criteria of the meta-analysis, only one study included an assessment of incobotulinum toxin.
As a result of these controversies, a formal assessment of all available evidence would assist clinicians and provide a summary of the evidence. Although previous meta-analyses have been conducted, they have considerable limitations as well as narrow scopes of assessment. One previous meta-analysis assessing the duration of action of Botox did not include a formal systematic review, but rather reviewed four self-identified ‘landmark studies’ . Due to this method of study selection, there is a very high risk of bias. Gadhia and Walmsley (2009) published a systematic review of botulinum toxin for facial aesthetics; however, this study only included trials comparing each medication to a placebo and excluded any active drug comparison . Based on a pilot search by our team, it appeared as though this study did not identify a significant number of trials meeting their inclusion criteria. Furthermore, the authors did not undertake a formal meta-analysis of the data. Flynn (2010) conducted a review of the botulinum toxin preparations as well as their individual duration of effect . This study identified a large number of peer-reviewed papers incorporating both randomized and non-randomized trials. This study identified great heterogeneity in terms of the definition of duration of action and thus comparative analysis was not attempted. Unfortunately, the inclusion of a wide range of study designs made a non-biased interpretation very difficult.
Due to the large number of non-randomized, non-blinded, industry-sponsored trials, clinicians have great difficulty determining if one specific medication carries an advantage over others in terms of both efficacy and safety. Furthermore, all previous reviews had significant flaws, not limited to poor identification of articles, a lack of a systematic review process as well as incomplete data reporting. Given the large number of double-blind randomized trials published assessing the cosmetic use of botulinum toxin, a formal systematic review and meta-analysis would assist physicians in making appropriate decisions, particularly given the significant amount of marketing by manufacturers. This review is also timely, since incobotulinum has recently been approved by Health Canada and the Food and Drug Administration (FDA) in 2013.
Aims and objectives
The aim of this systematic review is to evaluate the comparative effectiveness and harms of three preparations of botulinum toxin A for the treatment of facial wrinkling in adult patients. When treating facial rhytides with any one of the three botulinum toxin A formulations (onabotulinum toxin A, incobotulinum toxin A and abobotulinum toxin A) in adult patients, what are the comparative treatment: 1) benefits in terms of time to treatment response, patient and/or observer assessment of rhytid reduction, and sustainability of treatment response; and 2) harms in terms of procedural complications and adverse events?
This systematic review has been prospectively registered (CRD4201200337) with the PROSPERO international prospective register of systematic reviews . The review will comply with the standards and guidelines proposed by the Cochrane Handbook for Systematic Reviews of Interventions. Once completed, the reporting of our findings will adhere to the standards of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) .
Randomized controlled trials (RCTs) investigating the cosmetic use of a particular formulation of botulinum toxin A with no treatment, sham/placebo therapy, another formulation of botulinum toxin A, or another active treatment in adults with facial rhytides will be included. We will only include studies published in the English language. Studies which include additional cosmetic treatments in addition to botulinum toxin A during the study period (dermal fillers, skin care, or other skin therapy) will be assessed if they meet the above inclusion criteria.
Information sources and literature search
Literature search strategies will be developed in consultation with an experienced librarian at the University of Ottawa (ON, Canada). A second librarian at the University of Toronto (ON, Canada) will perform an assessment of the search strategy and provide peer feedback. A computerized literature search will be performed independently by two reviewers and records will be de-duplicated. Articles will be identified by searching Embase (via OVID), Cumulative Index to Nursing and Allied Health Literature (CINAHL), MEDLINE, World Health Organization (WHO) International Clinical Trials Registry Platform, European Union (EU) Clinical Trials Register, Cochrane Library databases of clinical trials, and ClinicalTrials.gov (National Institutes of Health, USA). Appendix A includes the Embase and MEDLINE search strategies. Additionally, references of the retained articles will be reviewed to identify additional relevant articles that were not found with the initial search strategy. A search for other published systematic and standard reviews will be conducted to assess reference lists for missed articles. Company representatives from each of the three botulinum toxin formulations will be contacted to request unpublished trial data as well as to ensure all relevant trials have been identified.
To search the WHO International Clinical Trials Registry Platform, EU Clinical Trials Register, Cochrane Library databases and ClinicalTrials.gov, four searches will be conducted, each with one of the following keywords: botulinum toxin as well as each of the medication drug and trade names. Only clinical trials listed as completed will be included in the search. The search will be limited to articles published between the 1970 and 2013, since botulinum toxin A was not developed prior to this date.
Study selection process
Three reviewers will independently review record titles and abstracts to assess eligibility (JB, JQ, DE). Eligible articles will be independently reviewed by the same three reviewers in full-text form for formal inclusion in the final review. All disagreements between reviewers will be resolved during a consensus meeting. These reviewers will also assess the possibility of duplicate publications.
Data items and data collection process
Standardized forms for data extraction will be created after pilot testing on a small subset of publications. All data will be extracted by the lead investigator (JB) and confirmed by two co-investigators (DE and JQ).
A priori outcomes of botulinum toxin therapy
Outcomes of treatment effectiveness
Time to treatment response or onset of action (based upon patient or expert/observer reported response assessment)
Duration of action or sustainability of response
Patient reported improvement at 30 days, and between 112 and 120 days, or nearest approximations
Expert/observer reported improvement at 30 days, and between 112 and 120 days, or nearest approximations
Changes in quality of life (assessed using validated instruments)
Detection of neutralizing antibodies
Short-term unintended effects of treatment or treatment delivery (harms)
Injection site pain or hyperesthesia, edema, ecchymosis or cutaneous infections
Use of botulinum anti-toxin
Longer-term unintended effects of treatment (harms)
Functional neurologic deficits or disfigurements (for example brow or lid ptosis, blepharoptosis, ectropion or entropion)
Strabismus and diplopia
Risk of bias assessment
Using the Cochrane Collaboration’s tool for assessing risk of bias, three reviewers (JB, DE, JQ) will assess for risk of selection, performance, detection, attrition, reporting and other biases for all included studies by outcomes of interest . A minimum of two reviews assessing the same risk will be required to assign a particular risk to a study characteristic. If each review scores a paper uniquely, this will be resolved at a consensus meeting. Additionally, for harms outcomes, we will assess whether outcomes were actively collected or passively measured when required.
Results will be reported descriptively first. Outcome data may be available as dichotomous, continuous, count, or time-to-event data. Relative risk for dichotomous outcomes, mean difference, ratio of means, or standardized mean differences for continuous, rate ratios of counts, and hazard ratios of time-to-event data will be preferred measures of analysis. Studies with zero events in one arm will be meta-analyzed without continuity correction with either the Peto method or the Mantel-Haenszel method . Studies with zero events in both arms will be excluded from meta-analyses. When adequate head-to-head trails are available, meta-analysis will follow routine methods for pooling across studies, provided there are no major concerns about methodological and clinical diversity between studies. The random effects approach of DerSimonian and Laird will be employed for meta-analysis .
Indirect comparisons will be undertaken in a network meta-analysis (NMA) to investigate comparative effectiveness across the three botulinum toxins when direct evidence is deemed imprecise or absent for a given outcome. NMA is an approach to evidence synthesis which allows for the combination of direct and indirect comparative evidence of three or more treatments in a unified analysis. The applicable scenario is when treatments A and B are compared with each other when no (or few) trials of A versus B exist (that is no direct head-to-head evidence), but substantial evidence exists for trials of A versus C and B versus C exist (indirect evidence) [27–29].
It is possible that studies may have assigned interventions in trials of multiple body parts in the following two ways: 1) patients were randomized to one or another intervention, but each intervention was applied to multiple body sites and data were analyzed by body sites (outcomes data from such studies would be impacted by a clustering effect to be accounted for in our meta-analysis); and 2) each patient’s multiple body sites were randomized (the split-body design) to two different interventions and data were analyzed as if each site were a patient (outcomes data from such studies would be impacted by a crossover effect to be accounted for in our meta-analysis).
For these studies, appropriate analyses would need to factor in either the intra-class or intra-cluster correlation coefficient, or the within-patient differences and paired analysis, respectively, in addition to the between patient variability. If this is not possible, the resulting unit of analysis error may impact the precision of study summary estimates (more precise or less precise, respectively), thereby leading to inappropriate weighting in the meta-analysis .
Statistical heterogeneity between studies will be quantified with I-squared statistics and the P value from the chi-squared test (a P value of ≤0.10 instead of 0.05 will be used to determine statistical significance). Sparse data will not be meta-analyzed but described narratively.
Meta-regression with multiple study level covariates will be attempted when there are at least six moderate to large size studies for a continuous covariate and at least four studies for each level of a categorical covariate. Otherwise, clinical and methodological diversity in studies will be explored in subgroup analysis for the following study level covariates, data permitting : 1) methodological covariates: study risk of bias and study design (trials using a split-body design versus those without or a cluster design); and 2) clinical covariates: age, sex, region of study conduct (developed versus developing countries), and prior use of toxins and procedural variability (for example expertise, precautions, needle used, dose of toxin, injection technique).
When quantitative synthesis is deemed inappropriate, a qualitative synthesis of data will be presented.
Grading the strength of evidence and assessment of applicability
For a given outcome, reviewers’ confidence of the body of evidence in support of a conclusion will be graded as per previously published guidance . Mandatory domains that will be assessed include risk of bias, consistency, directness and precision. Our pre-specified gradable outcomes are outcomes that are most likely to influence decision-making. They include: 1) patient reported outcomes (onset, efficacy at day 30 and duration of effect); 2) expert observer reported outcomes (onset, efficacy at day 30 and duration of effect); 3) local neurological defects or disfigurement; 4) headache; and 5) incidence of Botox non-responders post-therapy. For the body of evidence, we will summarize the population, intervention, comparator, setting and study duration data that may be used to assess external validity of evidence by various stakeholders and decision makers.
From a historical perspective, onabotulinum toxin A (Botox) was initially approved by the FDA for the treatment of strabismus and blepharospasm in 1989. In 2001, onabotulinum toxin A was approved for moderate to severe glabellar rhytides by Health Canada, followed by the FDA and EU in 2002. France, Spain and the UK soon followed in 2003, 2004 and 2006, respectively. Abobotulinum toxin A (Dysport) was not approved by the FDA for glabellar rhytides until 2009 and is still not approved by Health Canada for cosmetic indications. In 2012, a new botulinum formulation, incobotulinum toxin A (Xeomin), was approved by Health Canada for glabellar wrinkling. This product has been available in Europe and is expected to be approved for glabellar wrinkling in the USA by 2013. Given the anticipated approval by the FDA of a new medication, we feel this review will provide clinicians with the opportunity to read a non-biased, critical appraisal of the current status of the literature.
Although we are confident this review will achieve our objective, it is important to note that there are anticipated limitations and challenges. One anticipated difficulty relates to reporting and grading of outcomes, particularly efficacy outcomes. Typically, both clinicians and patients rate the extent of their wrinkling using validated scales. Commonly, the FWS is the primary outcome measure for clinician assessments, while the subject global assessment (SGA) scale is used for patient self-assessment . The FWS consists of a 4-point ordinal scale ranging from no wrinkling to severe wrinkling. This scale is accompanied by a photo guide to assist in appropriate grading. The SGA is a percentage measure used to assess a change in appearance with a range from −100% to +100% improvement. Unfortunately, both these scales have been demonstrated to have low to moderate inter-rater reliability . An additional scale, the GLSS , has demonstrated reasonable reliability measures. Similar to the FWS, this is a 4-point scale with photo guide. Interobserver reliability was noted to be 0.62, while intraobserver reliability was between 0.57 and 0.91. Furthermore, it is likely that not all studies will utilize one or both of these scales, thus complicating direct comparisons.
In addition to the actual grading method, there is likely to be variability across studies in terms of the definition of a ‘positive effect’ of treatment. The majority of studies reviewed in a pilot search defined a reduction in the FWS of 2 points as a positive effect; however, a number of studies utilized a reduction of 1 point as the definition of effect. Furthermore, some studies only included patients who started the trial with a baseline score of 2 or 3, while others included all baseline scores. To complicate issues further, facial wrinkling of patients can be assessed at rest or at maximum frown/motion, which can accentuate different areas of the face.
An additional potential difficulty will be an assessment of duration of action. Studies often utilize a variety of methods to determine and define ‘duration’. Similar to efficacy, rating scales along with a definition of response are used and followed over time until a percentage of patients no longer meet the definition of a response at a predetermined time point. However, there is no guideline as to what percentage truly represents duration. Furthermore, a major confounding variable in this regard is related to the notion that patients who have repeated treatments with botulinum toxin may have longer durations than naive patients, since there is a potential for muscle atrophy. Both factors create considerable difficulty when determining overall duration of action.
A more controversial topic is the development of anti-botulinum toxin antibodies. This study will attempt to identify cases of antibody development; however, we anticipate a number of difficulties. The evidence currently available for cosmetic botulinum toxin use suggests that although the incidence is low, there is an increased risk with repeated injections, particularly if high doses are utilized . We anticipate that the majority of studies will have an inclusion criteria limiting the prior toxin use, thus there may be a considerable selection bias in terms of assessing immunogenicity. Nevertheless, we will collect this data, since it is both clinically important and highlighted as a potential distinguishing feature between toxin formulations in company marketing. Unfortunately, it is unlikely that these studies will perform formal serum antibody testing, thus reporting of antibody development is likely to be subjective and based on passive reporting. Ideally, studies should perform formal serum antibody testing to adequately identify potential non-responders. Interestingly, it is believed that if antibodies develop, switching to an alternate formulation may allow for continued treatment without the antibody targeting that specific formulation. The results of two case series suggest otherwise, since in both cases switching formulations to an additional formulation of botulinum toxin A did not result in a positive result. In two cases, patients were switched to onabotulinum, while in another two cases patients were switched to incobotulinum, both continuing to demonstrate a lack of efficacy due to antibodies . We hope that this review will help to provide further evidence as well as guidance in this regard.
Even considering the potential difficulties, this review will provide clinicians and surgeons with the most up-to-date, unbiased evidence available, and will benefit patients and practitioners in the expanding field of facial cosmetic medicine.
cosmetic/or dermatological agent/(20,732)
rhytidoplasty/or skin surgery/(7,339)
face surgery/or minor surgery/or plastic surgery/or skin surgery/(68,088)
(cosmetic adj3 (procedure or injection or drug)).ti,ab. (955)
“frown lines”.ti,ab. (113)
“crow’s feet”.ti,ab. (210)
(muscle* adj3 (frontalis or procereus or orbicularis)).ti,ab. (2,295)
expbotulinum toxin A/(11,536)
11 and 22 (968)
from 23 keep 1–968 (968)
cosmetic techniques/or rhytidoplasty/(4,807)
otolaryngology/or surgery, plastic/(31,779)
(cosmetic adj3 (procedure or injection or drug)).ab,ti. (737)
“frown lines”.ab,ti. (95)
“crow’s feet”.ab,ti. (157)
(muscle* adj3 (frontalis or procerus or orbicularis)).ab,ti. (1,703)
(muscle$ adj3 “corrugator supercilii”).ab,ti. (87)
exp botulinum toxins/(11,067)
or/13 to 22 (11,294)
12 and 23 (786)
Cumulative Index to Nursing and Allied Health Literature
Food and Drug Administration
Facial wrinkle scale
Glabellar line severity scale
Preferred reporting for systematic reviews and meta-analyses
Randomized controlled trial
Subject global assessment
World Health Organization.
This material has never been published and is not currently under evaluation in any other peer-reviewed publication. This paper has received an unrestricted educational research grant from Allergan Inc, Canada.
- De Boulle K, Fagien S, Sommer B, Glogau R: Treating glabellar lines with botulinum toxin type A-hemagglutinin complex: a review of the science, the clinical data, and patient satisfaction. Clin Interv Aging. 2010, 5: 101-118.View ArticlePubMedPubMed CentralGoogle Scholar
- Schlessinger J, Monheit G, Kane MA, Mendelsohn N: Time to onset of response of abobotulinumtoxina in the treatment of glabellar lines: a subset analysis of phase 3 clinical trials of a new botulinum toxin type A. Dermatol Surg. 2011, 37: 1434-1442. 10.1111/j.1524-4725.2011.02075.x.View ArticlePubMedGoogle Scholar
- Rzany B, Ascher B, Monheit G: Treatment of glabellar lines with botulinum toxin type A (Speywood Unit): a clinical overview. J Eur Acad Dermatol Venereol. 2010, 24 (Suppl 1): 1-14.View ArticlePubMedGoogle Scholar
- Cliff SH, Judodihardjo H, Eltringham E: Different formulations of botulinum toxin type A have different migration characteristics: a double-blind, randomized study. J Cosmet Dermatol. 2008, 7: 50-54. 10.1111/j.1473-2165.2008.00361.x.View ArticlePubMedGoogle Scholar
- de Almeida AT, De Boulle K: Diffusion characteristics of botulinum neurotoxin products and their clinical significance in cosmetic applications. J Cosmet Laser Ther. 2007, 9 (Suppl 1): 17-22.View ArticlePubMedGoogle Scholar
- Stephan S, Wang TD: Botulinum toxin: clinical techniques, applications, and complications. Facial Plast Surg. 2011, 27: 529-539. 10.1055/s-0031-1298786.View ArticlePubMedGoogle Scholar
- Tighe AP, Schiavo G: Botulinum neurotoxins: mechanism of action. Toxicon. 2013, 67: 87-93.View ArticlePubMedGoogle Scholar
- Eisele KH, Fink K, Vey M, Taylor HV: Studies on the dissociation of botulinum neurotoxin type A complexes. Toxicon. 2011, 57: 555-565. 10.1016/j.toxicon.2010.12.019.View ArticlePubMedGoogle Scholar
- Gu S, Rumpel S, Zhou J, Strotmeier J, Bigalke H, Perry K, Shoemaker CB, Rummel A, Jin R: Botulinum neurotoxin is shielded by NTNHA in an interlocked complex. Science. 2012, 335: 977-981. 10.1126/science.1214270.View ArticlePubMedPubMed CentralGoogle Scholar
- Sharma SK, Singh BR: Immunological properties of Hn-33 purified from type A Clostridium botulinum. J Nat Toxins. 2000, 9: 357-362.PubMedGoogle Scholar
- Sugawara Y, Matsumura T, Takegahara Y, Jin Y, Tsukasaki Y, Takeichi M, Fujinaga Y: Botulinum hemagglutinin disrupts the intercellular epithelial barrier by directly binding E-cadherin. J Cell Biol. 2010, 189: 691-700. 10.1083/jcb.200910119.View ArticlePubMedPubMed CentralGoogle Scholar
- Frevert J, Dressler D: Complexing proteins in botulinum toxin type A drugs: a help or a hindrance?. Biologics. 2010, 4: 325-332.PubMedPubMed CentralGoogle Scholar
- Aoki KR, Irvine R, Gallagher C: Botox produces functional weakness in non-injected muscles adjacent to the target muscle. J Biomech. 2008, 41: 2066-2067. 10.1016/j.jbiomech.2008.03.030. author reply 2067View ArticlePubMedGoogle Scholar
- Carruthers A, Carruthers J: Prospective, double-blind, randomized, parallel-group, dose-ranging study of botulinum toxin type A in men with glabellar rhytids. Dermatol Surg. 2005, 31: 1297-1303.View ArticlePubMedGoogle Scholar
- Jandhyala R: Relative potency of incobotulinumtoxinA vs onabotulinumtoxinA a meta-analysis of key evidence. J Drugs Dermatol. 2012, 11: 731-736.PubMedGoogle Scholar
- Glogau R, Kane M, Beddingfield F, Somogyi C, Lei X, Caulkins C, Gallagher C: OnabotulinumtoxinA: a meta-analysis of duration of effect in the treatment of glabellar lines. Dermatol Surg. 2012, 38: 1794-1803. 10.1111/j.1524-4725.2012.02582.x.View ArticlePubMedGoogle Scholar
- Gadhia K, Walmsley AD: Facial aesthetics: is botulinum toxin treatment effective and safe? A systematic review of randomised controlled trials. Br Dent J. 2009, 207: E9-10.1038/sj.bdj.2009.813. discussion 216–217View ArticlePubMedGoogle Scholar
- Flynn TC: Botulinum toxin: examining duration of effect in facial aesthetic applications. Am J Clin Dermatol. 2010, 11: 183-199. 10.2165/11530110-000000000-00000.View ArticlePubMedGoogle Scholar
- PROSPERO international prospective register of systematic reviews.http://www.crd.york.ac.uk/PROSPERO/,
- Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 (updated March 2011). 2011, Oxford: The Cochrane Collaboration,http://www.cochrane-handbook.org,Google Scholar
- Preferred Reporting for Systematic Reviews and Meta-Analyses (PRISMA).http://www.prisma-statement.org/statement.htm,
- Carruthers A, Carruthers J: A validated facial grading scale: the future of facial ageing measurement tools? J Cosmet. Laser Ther. 2010, 12: 235-241. 10.3109/14764172.2010.514920.View ArticleGoogle Scholar
- Honeck P, Weiss C, Sterry W, Rzany B: Reproducibility of a four-point clinical severity score for glabellar frown lines. Br J Dermatol. 2003, 149: 306-310. 10.1046/j.1365-2133.2003.05436.x.View ArticlePubMedGoogle Scholar
- Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA: The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011, 343: d5928-10.1136/bmj.d5928.View ArticlePubMedPubMed CentralGoogle Scholar
- Fu R, Gartlehner G, Grant M, Shamliyan T, Sedrakyan A, Wilt TJ, Griffith L, Oremus M, Raina P, Ismaila A, Santaguidag P, Lauh J, Trikalinosh TA: Conducting quantitative synthesis when comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidemiol. 2011, 64: 1187-1197. 10.1016/j.jclinepi.2010.08.010.View ArticlePubMedGoogle Scholar
- DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.View ArticlePubMedGoogle Scholar
- Cipriani A, Barbui C, Rizzo C, Salanti G: What is a multiple treatments meta-analysis?. Epidemiol Psychiatr Sci. 2012, 21: 151-153. 10.1017/S2045796011000837.View ArticlePubMedGoogle Scholar
- Mills EJ, Bansback N, Ghement I, Thorlund K, Kelly S, Puhan MA, Wright J: Multiple treatment comparison meta-analyses: a step forward into complexity. Clin Epidemiol. 2011, 3: 193-202.View ArticlePubMedPubMed CentralGoogle Scholar
- Salanti G, Higgins JP, Ades AE, Ioannidis JP: Evaluation of networks of randomized trials. Stat Methods Med Res. 2008, 17: 279-301.View ArticlePubMedGoogle Scholar
- Owens DK, Lohr KN, Atkins D, Treadwell JR, Reston JT, Bass EB, Chang S, Helfand M: AHRQ series paper 5: grading the strength of a body of evidence when comparing medical interventions–agency for healthcare research and quality and the effective health-care program. J Clin Epidemiol. 2010, 63: 513-523. 10.1016/j.jclinepi.2009.03.009.View ArticlePubMedGoogle Scholar
- Conkling N, Bishawi M, Phillips BT, Bui DT, Khan SU, Dagum AB: Subjective rating of cosmetic treatment with botulinum toxin type A: do existing measures demonstrate interobserver validity?. Ann Plast Surg. 2012, 69: 350-355. 10.1097/SAP.0b013e31824a43e0.View ArticlePubMedGoogle Scholar
- Prager W, Rappl T: Phase IV study comparing incobotulinumtoxinA and onabotulinumtoxinA using a 1:1.5 dose-conversion ratio for the treatment of glabellar frown lines. J Cosmet Dermatol. 2012, 11: 267-271. 10.1111/jocd.12001.View ArticlePubMedGoogle Scholar
- Borodic G: Immunologic resistance after repeated botulinum toxin type a injections for facial rhytides. Ophthal Plast Reconstr Surg. 2006, 22: 239-240. 10.1097/01.iop.0000217703.80859.a3.View ArticlePubMedGoogle Scholar
- Dressler D, Wohlfahrt K, Meyer-Rogge E, Wiest L, Bigalke H: Antibody-induced failure of botulinum toxin a therapy in cosmetic indications. Dermatol Surg. 2010, 36 (Suppl 4): 2182-2187.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.