The safety and efficacy of on-site paramedic and allied health treatment interventions targeting the reduction of emergency department visits by long-term care patients: systematic review protocol
Systematic Reviews volume 7, Article number: 206 (2018)
Older adults are more likely to access the emergency department, which suffers from overcrowding and congestion, for conditions that could potentially be treated in other settings. Older adults living in long-term care centers have access to healthcare resources in their residence, and several programs have been created with the intent of treating medical conditions on-site. The aim of this study is to identify and systematically review programs and interventions at long-term care centers that aim to treat patients on-site, avoiding unscheduled transportation to the emergency department.
We will follow the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. We will perform a comprehensive search of Embase, MEDLINE, CINAHL, ClinicalTrials.gov, PROSPERO, and the Cochrane Central Registry of Controlled Trials using a broad search strategy. Two independent reviewers will assess titles and abstracts against inclusion criteria, and we will further evaluate relevant full-text articles for inclusion. We will assess the risk of bias using the Newcastle-Ottawa scale for included non-randomized studies and the Cochrane Risk of Bias tool for randomized trials. We will present a narrative synthesis of results and complete a meta-analysis only if enough homogeneity is found. We will create funnel plots to evaluate possible reporting bias and use The Grading of Recommendations Assessment Development and Evaluation (GRADE) methodology to assess the confidence in cumulative evidence.
As pressure on the healthcare system continues to rise, many areas are looking for alternative models of care. Several programs have been put in place in long-term care centers that seek to avoid transportation to the emergency department by providing enhanced care on-site. These programs are quite variable, and, to date, there is no standardized program or model of care.
Systematic review registration
The population of Canada is aging, living longer, and utilizing more healthcare resources than previous generations . These factors add to the challenges faced by an already overwhelmed healthcare system that is struggling to cope with high demand and limited resources. In particular, emergency departments (ED) are crowded, resulting in long waits for care, and negative patient outcomes [2, 3]. This congestion has a ripple effect which impacts paramedic services and patients waiting for emergency care in the community. Emergency department congestion contributes to long waits for paramedics to transfer the care of their patients to the ED staff, referred to as offload delay, which in turn delays paramedic response to the next emergency call. At times, offload delays have put so much pressure on emergency services that there have been no ambulances available in the community to respond to the next emergency call [4,5,6,7,8,9]. It is in this context that different factions of the healthcare community have been investigating alternative models of patient care to relieve the pressure on paramedics, emergency departments, and the healthcare system.
Older adults use hospital services more than other age groups and are more likely to access the emergency department for conditions that could potentially be treated in other settings . Although only a small proportion of emergency visits are from long-term care patients, this group is more vulnerable to adverse events from the transfer of their care to the emergency department . They also have access to health care resources in the long-term care center, making them a group of interest for interventions that provide care in the place of residence avoiding ED visits. Community Paramedic programs, where paramedics augment the care of individuals in the community, are one example of these programs. Several such programs have been put in place with models of care that can vary significantly from program to program [11,12,13,14,15]. There has been no systematic evaluation of these programs to date.
The aim of this systematic review is to identify programs and interventions that avoid transporting long-term care patients to the emergency department by providing care on-site and to evaluate the safety and efficacy of these programs.
We will complete a systematic review and report a narrative synthesis. We will conduct a meta-analysis only if appropriate. This systematic review is registered with the international prospective register of systematic reviews PROSPERO (CRD42018091636). We have adhered to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement and the completed checklist is included as an additional file .
Specifically, the systematic review will answer the following questions:
Among patients living in long-term care facilities, what is the safety and efficacy of interventions that treat patients on-site, avoiding unscheduled transportation to the emergency department?
Among patients living in long-term care facilities, what are the additional patient and system impacts of implementing treat on-site interventions beyond safety and efficacy?
We will use the following inclusion criteria to select studies for this systematic review:
P—Patients living in long-term care facilities, which we define below.
I—Any intervention or program provided by a non-physician that aims to reduce unscheduled patient transports to the emergency department
C—Standard care or transportation to the emergency department
O—All reported patient and system effects of any kind
We will include studies that contain patients 18 years of age and older, living in long-term care facilities primarily meant for the elderly. These facilities must be long-term care and not retirement residences or assisted living facilities, as the medical care available to residents is different between these facilities as are the patterns of ED use. We will include a long-term care facility also caring for younger patients with chronic disease in addition to the main population of older adults, providing they are not a facility that specializes in the care of these younger adults. We will include studies that encompass any patient condition. We will exclude hospitals that specialize in chronic care.
We will include any intervention or program aimed at reducing the transport of patients to the emergency department. Programs where reducing transportation to the emergency department is a secondary goal will be considered, if the number of ED transports is measured. These programs can be preventative or for acute conditions. The intervention or program must have been completed by a care provider other than a physician, for example, a paramedic or a nurse. We may consider for inclusion programs where physicians are part of a multi-disciplinary care team on an individual basis, providing allied health providers play a significant role in the intervention. We will include programs or interventions for any conditions.
Usual care or transportation to the emergency department will be the comparator.
We will collect outcomes taking a broad perspective. Outcomes will be collected as they are reported, and surrogate outcomes will be included if appropriate. In the event, outcomes are reported as composite measures, we will extract the composite and individual outcomes. Pre-defined outcomes of interest include the following:
Patient outcomes: the proportion of hospital admission, length of stay, death, condition-specific morbidity or adverse events, health-related quality of life, frailty measures, functional status, and patient impacts and perspectives. Quality of life, frailty measures, and functional status will only be collected if a validated tool was used.
System outcomes: the proportion or number of ED transports averted, repeat 911 or ED access, healthcare resource utilization, paramedic system response times, offload delays and ED crowding or congestion measures, and measures of overall system function (for example, end of shift overtime rates). We will consider other outcomes depending on what is available in the literature.
Study designs will be included taking a broad perspective. Experimental, quasi-experimental, and observational study designs will be included. We will exclude case reports, case series, and review articles, although we intend to review the reference list of review articles if any are found. Abstracts will be excluded unless a full-text article can be found.
There will be no restriction based on length of patient follow-up time.
Articles reported in the English or French language will be included. If articles are found that appear relevant but full text is not available in English or French, we will include them in the Appendix.
We will exclude studies that relate to patients who live in dwellings other than long-term care centers and involve an intervention that is primarily led by a physician or does not have a significant involvement by allied healthcare providers and does not have the goal of caring for patients in place or reducing unscheduled transports to the emergency department.
We will search Excerpta Medica Database (Embase), MEDLINE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), ClinicalTrials.gov, PROSPERO, and the Cochrane Central Registry of Controlled Trials with no date restrictions (SL). The reference lists of included studies, as well as any systematic reviews found, will be searched for other relevant articles (SL). We will search the primary authors of included articles to ensure all related research has been found. Gray literature will be searched using the pertinent areas of the Canadian Agency for Drugs and Technologies in Health (CADTH) Gray Matters Checklist (SL) . We will present a list of included articles to subject matter experts and ask them to identify any additional documents that are not on the list. If clarification is required regarding study details, two attempts will be made to contact study authors. These attempts will be made 3 weeks apart.
Medical subject headings and text words related to long-term care and hospital transfers have been used to create a search strategy. Our search strategy has been reviewed by Lindsey Sikora, Health Sciences Librarian at the University of Ottawa. A MEDLINE search strategy is included in the Appendix. We will adapt this strategy for Embase and CINAHL and test it to see if it yields a high proportion of known studies.
We will use Endnote software (version X7.5.3) to import references and abstracts from electronic databases. We will then use Covidence software to remove duplicates and facilitate the screening and tracking of articles. Full-text articles will be uploaded to Covidence for second-stage screening, and we will document the reason for exclusion for any articles excluded at this stage.
Stage 1—two independent trained reviewers will assess the title and abstract of each article identified by our search strategy (SL and second reviewer to be recruited). Articles thought to be relevant by both reviewers will proceed to stage 2, and we will report a measure of agreement. Stage 2—we will assess the full text of articles thought to be potentially relevant by both trained reviewers in stage 1, against the inclusion and exclusion criteria. Disagreements about inclusion decisions at either stage will be resolved by discussion and, if consensus cannot be reached, a third senior co-investigator will adjudicate (CV). If multiple articles are found that appear to be about the same work, we will assess these publications by examining author names, study locations, and intervention details to determine if they are duplicates.
One reviewer will collect data from included studies using a piloted standardized form (SL). If multiple articles are found that refer to the same study, we will link articles together. Data from each linked study may be collected onto its own extraction form and later combined, or one extraction form may be used for all linked studies depending on what types of duplicate publications are found.
We will extract data on patient characteristics (age, gender, level of dependence, cognitive impairment), system characteristics (healthcare system payer information, type of prehospital system, levels of care providers in prehospital system), intervention characteristics (presenting patient condition, severity of illness, intervention details), long-term care center characteristics (number of beds, location, skilled care services, funding model), and study characteristics (study designs, methodologies and outcomes, funding). If long-term care center characteristics are not reported in the article but are publicly available, we will collect them.
Outcomes and prioritization
The primary outcome will focus on the proportion of ED transports averted, defined as those patients who were treated at the long-term care center within the respective program, but not subsequently conveyed to the emergency department unless the transport to the emergency department was a scheduled visit. If patients were transported to an alternative destination, such as a clinic or family physician, we will collect that information but still consider it an avoided ED transport.
Secondary outcomes included
The safety of interventions in long-term care homes and will include the proportion of patients who suffer adverse events. Adverse events will include return visits to the ED, hospital admission, death, or condition-specific adverse events. Given the potential for a broad range of patient conditions in the literature, we will not restrict the length of follow-up for adverse events that are reported as being associated with the patient’s episode of illness or treatment. Hospital admission, death, and condition-specific adverse events will be analyzed together as well as individually.
Hospital length of stay
Health-related quality of life as measured by general or disease-specific validated instruments
Frailty measures as measured by the Clinical Frailty Scale or another validated scale
Functional status as measured by a validated scale that is assessed by interview or observation but not self-reported measures
Patient perspectives as reported
The number of repeat 911 calls or emergency department access while under the care of the respective program, or within 7 days of completing the treatment program
Paramedic system response times, defined as the number of minutes it takes a paramedic or emergency medical worker to arrive on the scene of an emergency from the time the call for assistance is placed
The mean time in minutes that paramedics spend in offload delay, defined as the time waiting to transfer a patient to a hospital bed and hand over patient care after giving a report to the hospital staff
Measures of emergency department crowding or congestion as reported in the literature
Measures of overall emergency system function as reported. Examples may include the number of times a paramedic service has no available resource for the next emergency call (level zero) or are at critical levels of responder availability, end of shift overtime, response time standard compliance or the number of offload nursing hours required in the emergency department
The primary outcome will remain the same irrespective of the significance found in the included studies, or whether it has been reported as a priority in the literature. The definitions of individual outcome measurements may be altered depending on what is found in the literature. For example, if offload delay is more commonly reported in a measure other than mean time, the definition may be altered to reflect this. If there is an outcome reported in the literature that we have not considered and find important, we will collect it and state in the manuscript that it was not part of our initial list of outcomes. If standard errors are not reported in included studies, we will reconstruct them from confidence intervals and point estimates.
Risk of bias
We will evaluate all included studies for risk of bias using a tool appropriate to study type. Randomized control trials will be assessed using The Cochrane Risk of Bias tool . Risk of bias will be identified as low, high, or unclear in a table format for each domain. Each section in the Risk of Bias tool will be considered independently, and there will be no overall score calculated. If the risk of bias cannot be determined in a specific category because there is not enough information, the risk of bias in that category will be designated as unclear. The Cochrane Handbook instructions will be used to make a judgment on low- and high-risk bias ratings . Non-randomized studies will be assessed using the Newcastle-Ottawa Scale . The strengths and limitations of each study as well as the potential impacts they may have had on the outcome will be presented. Risk of bias will be determined independently by two reviewers and then compared for agreement. We will resolve any disagreement by discussion or third party arbitration if required.
We will summarize the characteristics and findings of all included studies, regardless of the risk of bias, in a narrative synthesis. We will present the results in table form as well as text. Any relevant subgroups that are discovered will be reported, and, when appropriate, similarities and differences between studies will be examined.
If included studies or a subgroup of included studies are homogeneous in patient conditions and study design, they will be meta-analyzed using a random or fixed effects model as appropriate. Studies will be assessed by two reviewers to determine if enough methodological and clinical homogeneity exists to warrant a meta-analysis. Dichotomous outcomes will be determined using odds ratios (OR’s) and 95% confidence intervals. Standardized mean differences with 95% confidence intervals will be used to analyze continuous outcomes. The standardized mean differences will be weighted by the precision of the estimates of each study. Study characteristics will be examined using descriptive characteristics. In the event of small sample sizes or skewed data, we will use non-parametric tests for analysis or the data will be presented descriptively. We will examine forest plots for statistical heterogeneity and factor in clinical relevance. The I2 statistic will also be considered with a value of 40% or greater considered moderate heterogeneity. A sensitivity analysis or subgroup analysis will be undertaken if heterogeneity is visible on the forest plots. Risk of bias, type of healthcare system, and funding models of the long-term care centers are potential variables for subgroup analysis. Subgroup analysis will also be completed for young patients with chronic diseases providing the study reports this group separately.
To assess reporting bias, we will compare published protocols and trial registries with publications. We will evaluate if selective outcome reporting has occurred by comparing the outcomes that were planned and those that were published to see if there are differences. If greater than 10 studies are included in the review, funnel plots will be used to examine possible reporting bias.
Confidence in cumulative evidence
We will use The GRADE methodology to assess the quality of evidence and will report the results in an evidence table [21,22,23,24,25]. Quality of evidence will be assessed independently for each patient outcome and will be rated as very low, low, moderate, or high according to the GRADE scale.
Canadian Agency for Drugs and Technologies in Health
Cumulative Index to Nursing and Allied Health Literature
Excerpta Medica Database
Grading of Recommendations Assessment Development and Evaluation
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
Quality of life
Canadian Institute for Health Information. Health care in Canada, 2011: a focus on seniors and aging. Ottawa, ON: CIHI; 2011.
Hoot NR, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Ann Emerg Med. 2008;52(2):126–36.
Ospina MB, Bond K, Schull M, Innes G, Blitz S, Friesen C, Rowe BH. Measuring overcrowding in emergency departments: a call for standardization [technology report no 67.1]. Ottawa: Canadian Agency for Drugs and Technologies in Health; 2006.
Cooney, Derek R, et al. Ambulance diversion and emergency department offload delay: resource document for the National Association of EMS Physicians position statement. Prehospital Emergency Care. 2011;15(4):555–61.
Porter K. Ottawa exposed to lawsuits over failure to meet ambulance response targets: report. Canada: CBCnews. CBC/Radio; 2016. Web. 14 July 2017
Gorman M. Why paramedics must spend hours waiting outside hospital ERs. Canada: CBCnews, CBC/Radio; 2017. www.cbc.ca/news/canada/nova-scotia/health-care-ambulance-offload-delays-paramedics-hospitals-1.4345855
News, CBC. AHS tackles ER ‘offload delays’ for paramedics. Canada: CBCnews, CBC/Radio; 2010. www.cbc.ca/news/canada/calgary/ahs-tackles-er-offload-delays-for-paramedics-1.904420
Citizen, David Reevely Ottawa. David Reevely: Ottawa ran out of ambulances 22 times in the past two weeks, city admits. National Post, 2016, nationalpost.com/news/politics/david-reevely-ottawa-ran-out-of-ambulances-22-times-in-the-past-two-weeks-city-admits.
Carter A. ‘Patients will literally die’: times when no ambulances available on the rise. CBCnews, CBC/Radio Canada. 2017; www.cbc.ca/news/canada/hamilton/code-zero-1.4231984.
Canadian Institute for Health Information. Sources of potentially avoidable emergency department visits: report. Ottawa: CIHI; 2014.
Kane RL, Huckfeldt P, Tappen R, Engstrom G, Rojido C, Newman D, Yang Z, Ouslander JG. Effects of an intervention to reduce hospitalizations from nursing homes: a randomized implementation trial of the INTERACT program. JAMA Intern Med. 2017;177(9):1257–64.
Loeb M, Carusone SC, Goeree R, Walter SD, Brazil K, Krueger P, Simor A, Moss L, Marrie T. Effect of a clinical pathway to reduce hospitalizations in nursing home residents with pneumonia: a randomized controlled trial. Jama. 2006;295(21):2503–10.
Ouslander JG, Perloe M, Givens JVH, Kluge L, Rutland T, Lamb G. Reducing potentially avoidable hospitalizations of nursing home residents: results of a pilot quality improvement project. J Am Med Dir Assoc. 2009;10(9):644–52.
Bandurchin A, McNally MJ, Ferguson-Paré M. Bringing back the house call: how an emergency mobile nursing service is reducing avoidable emergency department visits for residents in long-term care homes. Nursing leadership (Toronto, Ont). 2011;24(1):59–71.
Marshall EG, Clarke B, Peddle S, Jensen J. Care by design new model of coordinated on-site primary and acute care in long-term care facilities. Canadian Family Physician. 2015;61(3):e129–e34.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Grey Matters: A practical tool for searching health-related grey literature. (2015). Retrieved March 12, 2018, from https://www.cadth.ca/resources/finding-evidence/grey-matters
Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011;343:d5928.
Higgins JPT, Altman DG, Sterne JAC (editors). Chapter 8: assessing risk of bias in included studies. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from www.handbook.cochrane.org.
Wells GA, Shea B, O’connell D, Peterson J, Welch V, Losos M, Tugwell P. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Ottawa: Ottawa Hospital Research Institute; 2011. p. 2011.
Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.
Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.
Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of clinical epidemiology. 2011;64(4):401–6.
Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407–15.
Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol. 2011;64(12):1277–82.
Lindsey Sikora, Health Sciences Librarian, University of Ottawa.
No funding was received for this work.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Search strategy MEDLINE
Homes for the Aged/
Emergency Service, Hospital/
Emergency Medical Services/
(nursing adj2 home).tw
1 or 2 or 3 or 6
(emergenc* adj3 (respond* or aid* or technician*)).tw
(emergenc* adj3 service*).tw
Emergency Medical Services/ or “Transportation of Patients”/
exp “Transportation of Patients”/
(hospital adj2 transfer).tw
(patient adj2 trans*).tw
Allied Health Personnel/
4 or 5 or 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18
7 and 19
limit 20 to “all adult (19 plus years)”
About this article
Cite this article
Leduc, S., Kelly, P., Thiruganasambandamoorthy, V. et al. The safety and efficacy of on-site paramedic and allied health treatment interventions targeting the reduction of emergency department visits by long-term care patients: systematic review protocol. Syst Rev 7, 206 (2018). https://doi.org/10.1186/s13643-018-0868-5