- Open Access
- Open Peer Review
Methods and efficacy of extracellular vesicles derived from mesenchymal stromal cells in animal models of disease: a preclinical systematic review protocol
Systematic Reviews volume 8, Article number: 322 (2019)
Over the past decade, mesenchymal stromal cells have been increasingly investigated for their therapeutic potential in several different illnesses. However, cell therapy can be limited by potentially serious adverse events including cell embolus formation and tumorigenesis. Importantly, the protective effects of mesenchymal stromal cells are largely mediated by paracrine mechanisms including release of extracellular vesicles. This systematic review intends to synthesize the current knowledge of mesenchymal stromal cell-derived extracellular vesicles as a therapeutic option for preclinical models of disease, inflammation, or injury.
A systematic literature search of MEDLINE, Embase, and BIOSIS databases will be conducted. Interventional preclinical in vivo studies using extracellular vesicles derived from any tissue source of mesenchymal stromal cells will be included. Studies will be screened by abstract, and full-text by two independent reviewers. Eligible studies will undergo data extraction with subcategorization into domains based on disease. Methods utilized for extracellular vesicle characterization and isolation will be collected, as well as information on interventional traits, such as tissue source of mesenchymal stromal cells, dosage regimen, and vesicle modifications. Reported outcomes will be collected to determine which diseases studied may be impacted most from treatment with mesenchymal stromal cell-derived extracellular vesicles.
This systematic review will summarize preclinical studies investigating the therapeutic efficacy of both small and large extracellular vesicles derived by mesenchymal stromal cells. Extracellular vesicles represent a possibility to harness the benefits of mesenchymal stromal cells with added benefits of reduced manufacturing costs and an improved safety profile. Hence, there has been an exponential increase in interest for developing this cell-free therapy with hundreds of preclinical studies published to date. However, a vast amount of heterogeneity between groups relates to methods of extracellular vesicle isolation, characterization, and study design. This review will capture this heterogeneity and identify the most commonly used and optimal approaches to evaluate mesenchymal stromal cell-derived extracellular vesicle treatment. A meta-analysis of outcomes within each disease domain will help elucidate which fields of research demonstrate promise for developing extracellular vesicles as a novel cell-free therapy. Summarizing this robust information on extracellular vesicles as an intervention can provide guidance for designing preclinical studies with hopes of future clinical translation.
Mesenchymal stromal cells represent a subset of adult stem-like cells which have been extensively investigated for therapeutic potential in a variety of disease states. Mesenchymal stromal cells have been isolated from numerous tissue sources including adipose tissue, umbilical cord, and synovial membrane , and they can be derived from induced pluripotent stem cells . Their multilineage differentiation potential, in vitro expansive capacity, and ability for immunomodulation has led to nearly 500 clinical trials , including studies of septic shock , acute respiratory distress syndrome , and ischemic heart disease . In particular, mesenchymal stromal cells have received approval as a therapy to treat graft versus host disease in New Zealand, Canada, and Japan [7, 8]. Cell therapies may be limited by potentially serious adverse events of cell embolus and tumor formation . Thus, there is immense interest in harnessing the therapeutic effects of mesenchymal stromal cells in ways that avoid potential harms.
Mesenchymal stromal cells’ effects are largely mediated by paracrine mechanisms, and so mesenchymal stromal cell-derived extracellular vesicles may represent a safer cell-free alternative to whole cell injections. Extracellular vesicles contain biologically active factors and signaling molecules to facilitate intercellular communication. With opportunities for diminished manufacturing and storage costs for extracellular vesicles, they can also be produced as a more readily available “off-the-shelf” product, as extracellular vesicles are more stable than whole cells when cryogenically frozen. Research into the development of cell-free therapies has focused primarily on two types of extracellular vesicles, medium-large vesicles known as microvesicles, and small extracellular vesicles, which include exosomes.
Microvesicles and exosomes are subsets of extracellular vesicles that range from 150–1000 and 30–150 nm in diameter, respectively  (Fig. 1). Both microvesicles and exosomes are prolifically produced by mesenchymal stromal cells  and are believed to carry bioactive cargo, such as microRNA, transcription factors, growth factors, and other regulatory proteins that help mediate their potentially efficacious properties . Extracellular vesicles may serve as ideal vesicles for encapsulating therapeutic products, protect these products from degradation, and aid their delivery to specific target tissues. The opportunity to introduce or manipulate the expression of contents inside extracellular vesicles (e.g., through overexpression of protective microRNAs) has created an intriguing new domain of regenerative medicine.
The systematic review stemming from this protocol will synthesize current evidence on mesenchymal stromal cell-derived microvesicles and exosomes as therapeutic options in preclinical models of disease, inflammation, or injury. A scoping review previously published by our group systematically reviewed preclinical data on extracellular vesicles up to 2013 and found that sixteen of seventeen preclinical studies demonstrated therapeutic benefits associated with administration of mesenchymal stromal cell-derived extracellular vesicles . Subsequently, the terminology surrounding extracellular vesicle research has matured, and interest in studying microvesicles and exosomes has increased exponentially, necessitating a re-evaluation of this body of evidence.
We will review in vivo preclinical studies evaluating mesenchymal stromal cell-derived extracellular vesicles as an intervention for any animal model of disease or injury. Our primary objective will assess the methodology being utilized in these animal studies including (1) interventional characteristics, (2) methods of extracellular vesicle enrichment and characterization, and (3) experimental design. Given the expected heterogeneity of methods used (e.g., cell sources, isolation techniques) and outcomes assessed across various disease domains, a synthesis of these issues is needed to provide context for any subsequent meta-analysis. For our secondary objective, studies will be categorized by disease domains with subsequent meta-analyses of study outcomes to determine the therapeutic efficacy of mesenchymal stromal cell-derived extracellular vesicles in different conditions. Results of this analysis will help guide future preclinical studies of extracellular vesicles and inform whether possible human participant studies are feasible.
Methods and design
The team members for this systematic review encompass researchers across different scientific disciplines. The team has expertise in systematic reviews (DAF, MML, JM, DSA), basic science studies investigating novel cell therapies (AT, MML, DJS, DSA), and translational cell therapy trials (DJS, DAF) [6, 14, 15]. As well, DB participated in the development of the recently published Minimal Information for Studies of Extracellular Vesicles 2018 (MISEV2018) position statement and provides considerable experience in the field of extracellular vesicle research . The student leads for this project (AT and MS) have experience in both basic science and clinical epidemiology and will be the two primary reviewers for article selection and data extraction.
This systematic review protocol is reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analysis Protocol (PRIMSA-P) reporting guidelines (Additional file 1) . A summary of the protocol has been registered at the International Prospective Registry of Systematic Reviews (PROSPERO CRD42019123918).
Inclusion—in vivo preclinical animal models of disease, organ injury, tumor growth, or altered immune response. Exclusion—ex vivo, in vitro, and invertebrate animal models will be excluded.
Inclusion— mesenchymal stromal cell-derived extracellular vesicles including microvesicles (150–1000 nm) and exosomes (30–150 nm). Extracellular vesicles can be derived from xenogeneic, syngeneic, or allogeneic mesenchymal stromal cells from any tissue source. All routes of intervention administration will be considered, including direct tissue, intravenous, and intra-arterial injections. Experiments involving pre-treatment of mesenchymal stromal cells, co-treatment, and/or genetic manipulation (e.g., over- or under-expression of genes) before extracellular vesicle isolation will be classified as “modifications” for subgroup analysis. Exclusion—studies where extracellular vesicles are not directly administered to animals as a therapy (e.g., used as a pre-treatment for other interventions) or investigated only for their biodistribution will be excluded.
Studies with any comparator (e.g., vehicle control, placebo, mesenchymal stromal cells, and fibroblast microvesicles) will be considered.
Inclusion—studies that provide information regarding intervention characteristics, methodologic approaches and experimental design parameters utilized in studies will be included. For the purposes of a potential quantitative synthesis and meta-analysis, we will extract each study’s primary outcome. If a primary outcome has not been outlined in the study, expert opinion or consensus statements will be sought to determine which in vivo outcome may be most clinically relevant for diseases treated.
Inclusion—interventional in vivo studies with a comparator-control will be included. Studies may be randomized, pseudo-randomized, or non-randomized. Exclusion—unpublished gray literature, abstracts, review articles, editorials, and letters will be excluded. Single arm interventional studies will also be excluded.
We will search Ovid MEDLINE®, Ovid MEDLINE® In-Process & Other Non-Indexed Citations, Embase Classic + Embase, and BIOSIS from inception to present day. In addition, hand searches of the bibliographies of included articles and relevant reviews will be performed.
The search strategies (Additional file 2) to be used for this review will be generated by a health sciences librarian (RS) with experience designing systematic literature searches. A second information specialist with no association to the project will also review the strategy using Peer Review of Electronic Search Strategies (PRESS) before the final search procedure is executed [18, 19]. The search strategy will utilize both calculated vocabulary and MeSH terms (e.g., mesenchymal stem cells, mesenchymal stromal cells, extracellular vesicles, exosomes, and microvesicles), acronyms (e.g., MSCs, microvesicles, and extracellular vesicles), and MeSH terms with alterations as required per database. Our previous search strategy published in 2015 was updated to reflect evolving terminology in the extracellular vesicle field . Preclinical filters will also be applied to improve search efficiency [20,21,22]. No search restrictions will be created for language or publication date.
Search results will be uploaded to Distiller Systematic Review Software (DistillerSR, Evidence Partners, Ottawa, Canada). DistillerSR is an online software that allows for improved transparency, reproducibility, and accessibility for literature review.
Two reviewers (AT, MS) will independently screen titles and abstracts from search results using the predefined inclusion criteria outlined above. A calibration test involving sets of 10 studies will be performed (AT, MS) to refine the screening question and ensure high inter-rater correlation (kappa > 0.8), prior to formally commencing the screening process. For all titles that appear to meet the inclusion criteria or where there is any uncertainty, we will obtain the full-text article. Two reviewers (AT, MS) will assess the eligibility of full-text articles. A calibration test involving a set of 10 studies will be performed (AT, MS) to ensure high inter-rater correlation. After every calibration test, the entire review team will be consulted to resolve any issues concerning full-text inclusion. After refining the full-text screening criteria, a formal screening process (AT, MS) will be commenced. Any disagreement will be resolved through discussion with a third-party member (MML, DSA). Reasons for study exclusion at this level will be recorded. There will be no restrictions on language. Articles of non-English text will be translated by native speakers at the Ottawa Methods Centre.
Data collection process
A standardized data extraction form will be designed by the review team and uploaded to DistillerSR. Information will be extracted independently and in duplicate from each eligible study (AT, MS). Calibration exercises of 10 studies will be conducted, and the review team will be consulted to refine the data extraction form. After commencing formal data abstraction, any disagreements will be first discussed between two independent reviewers (AT, MS). If no resolution can be made, a third-party team member will be consulted (MML).
Broad categories of data items include methods of vesicle separation and characterization (Table 1), intervention details (e.g., tissue type of mesenchymal stromal cell, dose, route of administration, and timing of administration) (Table 2), study characteristics (e.g., study design, population of species, model of disease) (Table 3), and preclinical outcomes.
Risk of bias assessment
For each included study, risk of bias assessments will be carried out by two independent reviewers (AT, MS) using the Systematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool . The SYRCLE tool was adapted from the Cochrane Risk of Bias Tool to assess the methodologic quality using criteria specific to animal studies. Items in this tool include assessments for selection bias (sequence generation, baseline characteristics, allocation concealment), performance bias (random housing, blinding), detection bias (random and blinded outcome assessment), attrition bias (completeness of outcome data), and reporting bias. Each parameter of bias for each included study will be scored as having a low, high, or unclear risk of bias. Any disagreements between the two reviewers will be resolved through discussion with a third-party member (MML).
Before a meta-analysis will be deemed appropriate to execute, the heterogeneity of included studies will be assessed. A senior author (MML, DA, DB) will review the study populations and study characteristics to judge the presence of methodologic heterogeneity. If sufficient homogeneity across studies exists, a meta-analysis will be considered appropriate to carry out. Continuous endpoints will be pooled using standardized mean differences with an inverse variance random effects method [24, 25]. Dichotomous outcomes (e.g., mortality) from each study will be pooled and described as risk ratios with 95% confidence intervals using the DerSimonian and Laird random-effects method (Comprehensive Meta-Analysis v3.1) . Statistical heterogeneity of effect sizes will be assessed using the Cochrane I2 statistic test . Thresholds for interpretation of I2 are as follows: 0–40% (low heterogeneity), 30–60% (moderate heterogeneity), 50–90% (substantial heterogeneity), and 75–100% (considerable heterogeneity) . If there is considerable heterogeneity (75–100%), sources of heterogeneity will be explored through subgroup and sensitivity analyses.
Planned subgroup analyses include intervention characteristics, such as tissue source of mesenchymal stromal cells (e.g., bone marrow, umbilical cord, and adipose), size of extracellular vesicles (e.g., small extracellular vesicles from 30–150 nm, or medium/large extracellular vesicles from 150–1000 nm), method of extracellular vesicle isolation (e.g., ultracentrifugation, tangential flow filtration, and size exclusion chromatography), and methods of vesicle characterization (e.g., Western Blot, electron microscopy, and flow cytometry). Additionally, studies will be subgrouped by disease domain for preclinical outcome assessment.
Understanding that there has been a markedly heightened interest to evaluate the therapeutic potential of mesenchymal stromal cell-derived extracellular vesicles, this review will first assess the feasibility of conducting a meta-analysis based on the final number of included preclinical studies. If a feasible number of articles are included, our team will summarize the methodology data and conduct a meta-analysis of outcomes. If the included number of articles is too large to feasibly perform multiple analyses in a single publication, a systematic review of the overall methodology being used for in vivo extracellular vesicle studies will be first published. Subsequently, analyses for each disease domain with more details (e.g., risk of bias and outcome measures) will be published as separate manuscripts in peer-reviewed journals. Finally, findings will be disseminated through international conferences with basic and translational scientists to help guide future preclinical and clinical study design of extracellular vesicle therapy.
If any amendments to this protocol are necessary, the date and specific changes to the protocol will be documented on PROSPERO with rationales as to why the alterations were required.
Our systematic review intends to identify and summarize preclinical studies investigating the therapeutic efficacy of both small and large extracellular vesicles derived from mesenchymal stromal cells. This work updates our previous study that captured studies through 2013 . Although only 17 studies were included in the previous systematic review, the therapeutic potential for this novel cell-free therapy was evident as many disease and injury states had been investigated. Since then, many more research groups around the world have begun to study extracellular vesicles, and they are now well-recognized to carry biologically active factors that mediate the therapeutic effects of mesenchymal stromal cells. Extracellular vesicles represent a novel investigative direction within regenerative medicine.
We anticipate that this comprehensive synthesis and meta-analysis of preclinical studies assessing the beneficial or adverse effects of mesenchymal stromal cell-derived extracellular vesicles will generate valuable data to help guide future preclinical study design. More importantly, these findings can help provide considerations of future translational human participant studies.
Availability of data and materials
Kern S, Eichler H, Stoeve J, Klüter H, Bieback K. Comparative analysis of mesenchymal stem cells from bone marrow, umbilical cord blood, or adipose tissue. Stem Cells. 2006;24(5):1294–301.
Jung Y, Bauer G, Nolta JA. Concise review: induced pluripotent stem cell-derived mesenchymal stem cells: progress toward safe clinical products. Stem Cells. 2012;30(1):42–7.
Squillaro T, Peluso G, Galderisi U. Clinical trials with mesenchymal stem Cells: an update. Cell Transplant. 2016;25(5):829–48.
McIntyre LA, Stewart DJ, Mei SH, et al. Cellular immunotherapy for septic shock. A phase I clinical trial. Am J Respir Crit Care Med. 2018;197(3):337–47.
Matthay MA, Calfee CS, Zhuo H, et al. Treatment with allogeneic mesenchymal stromal cells for moderate to severe acute respiratory distress syndrome (START study): a randomised phase 2a safety trial. Lancet Respir Med. 2018.
Lalu MM, Mazzarello S, Zlepnig J, et al. Safety and efficacy of adult stem cell therapy for acute myocardial infarction and ischemic heart failure (SafeCell Heart): a systematic review and meta-analysis. Stem Cells Transl Med. 2018;7(12):857–66.
Gao F, Chiu S, Motan D, et al. Mesenchymal stem cells and immunomodulation: current status and future prospects. Cell Death Dis. 2017;7(1):e2062.
Galipeau J, Sensebe L. Mesenchymal stromal cells: clinical challenges and therapeutic opportunities. Cell stem cell. 2018;22(6):824–33.
Prockop DJ, Brenner M, Fibbe WE, et al. Defining the risks of mesenchymal stromal cell therapy. Cytotherapy. 2010;12(5):576–8.
György B, Szabó TG, Pásztói M, et al. Membrane vesicles, current state-of-the-art: emerging role of extracellular vesicles. Cell Mol Life Sci. 2011;68(16):2667–88.
Yeo RW, Lai RC, Zhang B, et al. Mesenchymal stem cell: an efficient mass producer of exosomes for drug delivery. Advanced drug delivery reviews. 2013;65(3):336–41.
Katsuda T, Kosaka N, Takeshita F, Ochiya T. The therapeutic potential of mesenchymal stem cell-derived extracellular vesicles. Proteomics. 2013;13(10-11):1637–53.
Akyurekli C, Le Y, Richardson RB, Fergusson D, Tay J, Allan DS. A systematic review of preclinical studies on the therapeutic potential of mesenchymal stromal cell-derived microvesicles. Stem Cell Rev Rep. 2015;11(1):150–60.
Taljaard M, Ward MR, Kutryk MJ, et al. Rationale and design of enhanced angiogenic cell therapy in acute myocardial infarction (ENACT-AMI): the first randomized placebo-controlled trial of enhanced progenitor cell therapy for acute myocardial infarction. Am Heart J. 2010;159(3):354–60.
Granton J, Langleben D, Kutryk MB, et al. Endothelial NO-synthase gene-enhanced progenitor cell therapy for pulmonary arterial hypertension: The PHACeT trial. Circ Res. 2015;117(7):645–54.
Théry C, Witwer KW, Aikawa E, et al. Minimal information for studies of extracellular vesicles 2018 (MISEV2018): a position statement of the International Society for Extracellular Vesicles and update of the MISEV2014 guidelines. J Extracell Vesicles. 2018;7(1):1535750.
Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
McGowan J, Sampson M, Lefebvre C. An evidence based checklist for the peer review of electronic search strategies (PRESS EBC). Evidence Based Library and Information Practice. 2010;5(1):149–54.
Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–52.
de Vries RB, Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M. A search filter for increasing the retrieval of animal studies in Embase. Lab Anim. 2011;45(4):268–70.
Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M. Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed. Lab Anim. 2010;44(3):170–5.
Leenaars M, Hooijmans CR, van Veggel N, et al. A step-by-step guide to systematically identify all relevant animal studies. Lab Anim. 2012;46(1):24–31.
Hooijmans CR, Rovers MM, de Vries RB, Leenaars M, Ritskes-Hoitinga M, Langendam MW. SYRCLE’s risk of bias tool for animal studies. BMC Med Res Methodol. 2014;14(1):43.
DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88.
Friedrich JO, Adhikari NK, Beyene J. The ratio of means method as an alternative to mean differences for analyzing continuous outcome variables in meta-analysis: a simulation study. BMC Med Res Methodol. 2008;8(1):32.
Collaboration C. Review Manager (RevMan) version 5.3. Copenhagen: The Nordic Cochrane Centre. In:2014.
Higgins JPT AD, Sterne JAC, editors. Cochrane handbook for systematic reviews of interventions Available from: http://handbook-5-1cochraneorg/. 2011.
Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.
Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34.
AT is a doctoral student supported by the Vanier Canada Graduate Scholarship with the Canadian Institutes of Health Research (CIHR). MML is supported by The Ottawa Hospital Anesthesia Alternate Funds Association. We would like to thank Risa Shorr, Librarian and Information Specialist with the Ottawa Hospital Research Institute, Ottawa, Ontario, for designing the search strategy for this systematic review.
This work received no external or internal sources of funding.
Ethics approval and consent to participate
Consent for publication
DJS is President and CEO of Northern Therapeutics (Montreal, QC, Canada). The remaining authors have no competing interests to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tieu, A., Slobodian, M., Fergusson, D.A. et al. Methods and efficacy of extracellular vesicles derived from mesenchymal stromal cells in animal models of disease: a preclinical systematic review protocol. Syst Rev 8, 322 (2019) doi:10.1186/s13643-019-1242-y
- Mesenchymal stromal cells
- Mesenchymal stem cells
- Extracellular vesicles
- Systematic review protocol