Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Australian Aboriginal and Torres Strait Islander-focused primary healthcare social and emotional wellbeing research: a systematic review protocol

Systematic Reviews20154:189

DOI: 10.1186/s13643-015-0180-6

Received: 28 September 2015

Accepted: 21 December 2015

Published: 30 December 2015

Abstract

Background

Research with a focus on Aboriginal and Torres Strait Islander Australian’s (hereafter referred to as Indigenous1) needs is crucial to ensure culturally appropriate evidence-based strategies are developed to improve health. However, concerns surrounding this research exist, arising from some previous research lacking community consultation, resulting in little community benefit or infringing on important cultural values. Values and Ethics: Guidelines for Ethical conduct in Aboriginal and Torres Strait Islander Health Research (hereafter referred to as Values and Ethics), developed by The National Health and Medical Research Council of Australia in 2003, is the ethical standard for Indigenous-focused health research. Researchers must address its Values in research design and conduct. However, its impact on research processes is unclear. Local Protocols should also be considered. This review aims to systematically examine practices related to Values and Ethics, Local Protocols and the processes of conducting Indigenous-focused primary healthcare research in collaboration with external researchers.

Methods

The following electronic databases and grey literature will be searched (2003 to current): MEDLINE, EMBASE, CINAHL, Informit and HealthInfoNet—an Indigenous-specific research and program website. Indigenous-focused research will be included. Research must be conducted in one or more primary healthcare services, in collaboration with external researchers and with a focus on social and emotional well being. One reviewer will review titles and abstracts to remove obviously irrelevant research articles. Full-text research articles will be retrieved and independently examined by two reviewers. Data and quality assessment will be completed by one reviewer and verified by a second reviewer. Quality will be assessed using modified versions of established quality assessment tools.

Discussion

This review will provide information on research processes and the impact of Values and Ethics on Indigenous-focused primary healthcare research, informing communities and primary healthcare staff around research practices, and researchers and policy makers of strengths and weaknesses of practice.

Systematic review registration

PROSPERO CRD42015024994

Keywords

Aboriginal and Torres Strait Islander Indigenous Australia Primary healthcare Research Social and emotional wellbeing Mental health

Background

Health research intended to benefit Aboriginal and Torres Strait Islander (hereafter referred to as Indigenous1) people has frequently been conducted poorly, with little collaboration between the researchers and Indigenous communities, often without providing any short- or long-term benefit to the communities or individuals involved. Non-Indigenous researchers have commonly held control of Indigenous-focused research [1], and health research has been criticised for its repetitive portrayal of poor Indigenous health status, lack of community collaboration [2], and little or no clear positive benefit to the communities or individuals involved [3, 4]. These factors, on the historical backdrop of colonisation, have led to a distrust of Western researchers by some Indigenous people [5, 6].

There has been a concerted effort to change the approach to Indigenous-focused health research, placing a greater emphasis on community benefit, collaboration, knowledge transfer and relationships between communities and researchers. This has resulted in the development of several strategies to improve research processes. The Interim Guideline on Ethical Matters in Aboriginal and Torres Strait Islander Health Research was developed in 1991 [7]; however, it was quickly revised, as it was found to lack focus on sound research principles [8], failed to establish processes for the ongoing review of projects, and was considered to be ‘watered-down’ from its original principles [5].

In 2003 the revised Value and Ethics: Guideline for Ethical Conduct in Aboriginal and Torres Strait Islander Health Research [9] (hereafter referred to as Value and Ethics) was published. Values and Ethics [9] was developed as an authoritative statement and has the same status as the National Statement for Health Research [10]. It outlines the following Values that researchers, academic institutions and funders must consider when conducting Indigenous-focused health research: reciprocity, respect, equality, responsibility, survival and protection, and spirit and integrity [9]. The impact of Values and Ethics [9] on research processes, and on community benefit, is unclear [11, 12].

Values and Ethics [9] emphasises several key principles, including the conduct of research that addresses community-determined priority areas, developing community capacity through skills or knowledge development and including communities as equal partners in the research process. To complete research according to these principles, researchers need to be adaptable, and additional time and resources may be necessary in comparison with non-Indigenous focused research. However, there has been a perception that funding agencies, institutional and academic structures rarely allocate sufficient resources or make allowances for researchers to complete this work. This presents a unique and challenging environment for Indigenous-focused research to occur [1113]. An evaluation of Values and Ethics [9] is being jointly conducted by The Lowitja Institute and National Health and Medical Research Council of Australia and revisions of the document are under consideration [14, 15].

Increasingly, researchers and communities are documenting components of setting up and managing research projects. Examples of community-controlled research [16], community participation in research [17], documentation of Local Protocols [18, 19], a description of important principles for research [20] and recommendations for completing specific research methods with Indigenous communities, for example conducting survey-based research [8], have been published. However, there are few examples specific actions taken by researchers to address Values and Ethics [9] when conducting health research [21, 22].

One setting where consideration of Values and Ethics [9] is required is research conducted in Primary Health Care (PHC) services. PHC is an important component of the healthcare system. Effective PHC in Indigenous communities has been effective in improving patient outcomes and reducing costs in the hospital system [23]. Health research set in, and relevant to Indigenous communities is needed to ensure that services are of high quality, use the best available evidence, and are culturally appropriate. PHC research is a challenging and resource-intensive process [24], and additional challenges exist when conducting research in Indigenous-focused PHC services [25]. PHC research may be initiated externally, by researchers who identify a problem and approach PHC services to participate, or initiated within a PHC service, where staff identify a problem and conduct their own research—they may also invite external researchers to be involved.

Maintaining and improving the social and emotional wellbeing (SEWB) of Indigenous people is often the goal of PHC services and staff. The term SEWB describes a strength-based holistic perspective of mental health that acknowledges the socio-historical and personal influences on mental health [26]. This term is preferred by some communities, including by many Indigenous Australians. The SEWB of Australia’s Indigenous people is poor compared to Australia’s non-Indigenous population. Suicide rates are twice as high, and Indigenous people are nearly three times as likely to experience high or very high levels of psychological distress than the non-Indigenous population [27]. This disparity exists within a complex historical and social environment. Evidence-based strategies to improve the SEWB of Indigenous communities must be developed.

Conducting Indigenous-focused health research in the PHC setting is challenging; however, it is crucial, as culturally appropriate SEWB services are needed to address the disparity in health between Indigenous and non-Indigenous Australians [13]. An understanding of externally and internally initiated PHC-based research to improve SEWB, including the barriers and enablers to conducting research in this setting, is needed.

We will undertake a systematic review of research conducted with collaboration between Australian PHC services and external researchers, and a focus on improving Indigenous SEWB.

Methods

This protocol has been registered with PROSPERO CRD42015024994 and reported adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-P (PRISMA) statement [28]. Research will be assessed according to Rationale and Standard for the systematic review of qualitative literature in health services research [29] and MOOSE Guidelines for Meta-Analyses and Systematic Reviews of Observational Studies guidelines [30].

Objective

We will systematically review the conduct of published Indigenous-focused SEWB PHC research in relation to Values and Ethics [9]. Our primary aim is to identify actions, (as reported by the author and identified by the reviewers), that relate to Values and Ethics [9] and Local Protocols (any processes or procedures developed by a community that researchers are expected to adhere to when conducting research or interacting with the community). Our secondary aims are to identify the enablers and barriers to research (as reported by authors) and to comment on ways the research may be translated into practice.

This review will support improved community-researcher relationships by providing Indigenous communities and PHC staff with information to understand current practices, and policy makers and researchers working in the field with information on how research is planned and implemented in line with Values and Ethics [9].

Types of research

Research using qualitative, quantitative or mixed methods in the PHC setting, designed to improve Indigenous SEWB will be included. For the purpose of this review, this includes research addressing workforce issues, training, service coordination, resource development, evaluation of interventions, PHC planning, service-level policy, services, processes or the evidence base related to PHC. Only research where the researchers generated original data will be included.

Published evidence and grey literature will be included, including journal articles, reports and evaluations completed by external researchers or PHC service staff.

Research setting

Research must be mostly conducted (where at least half of the research or recruitment occurs) in one or more PHC services and include collaboration between PHC service staff and external researchers.

Types of participants

Eligible research must have an explicit focus on Australian Indigenous patients or staff of an Indigenous-focused PHC service.

Types of interventions

Interventions aiming to improve the SEWB of Indigenous people attending PHC services, including those focusing on social, emotional, spiritual and cultural wellbeing will be included. Eligible research will have an explicit focus on one of the following areas:
  • The broad concept of SEWB or mental health

  • Depression disorders

  • Anxiety disorders

  • Smoking or alcohol use, including dual diagnosis

Excluded research

We will exclude research with no collaboration between external researchers and PHC service staff or patients, e.g., opinion pieces, internal evaluations, resource reviews or literature reviews. Research with a focus on a specific component of SEWB (e.g., violence, suicide, parenting or perinatal care) rather than the broad concept of SEWB will be excluded, with the exception of research related to depression, anxiety, alcohol consumption, smoking and dual diagnosis. Study protocols with no available findings will be excluded.

Types of outcome measures

Research meeting the above criteria will be analysed for actions taken that relate to the Values outlined in Values and Ethics [9] and Local Protocols. A list of potential actions, based on Values and Ethics [9], will be used to describe where values were met (or otherwise) according to the definitions in Additional file 1. We will document the Values that have been explicitly followed. Where processes are described that are in line with Values and Ethics [9] but no explicit reference to Values and Ethics [9] is provided, we will describe these actions.

We will outline where researchers have followed Local Protocols. Drawing on the data described above, we will comment on ways the research may be translated into practice and impact on community-researcher relationships.

Search methods for identification of research

The following databases will be searched (from 2003) to identify research published in English: MEDLINE, EMBASE, CINAHL and Informit. HealthInfoNet, a website containing a regularly updated list of Indigenous-focused health research, programs and other knowledge, will also be searched. This timeframe was selected to correspond with the development of Values and Ethics [9]. A comprehensive search strategy using the following key words will be developed: primary healthcare, Aboriginal and Torres Strait Islander and social and emotional wellbeing. An example of the search strategy is illustrated in Table 1. Programs and projects listed on the HealthInfoNet website, categorised under the social and emotional wellbeing topic area will be reviewed. The full search strategy for other databases will be available upon request.
Table 1

Medline via Ovid search strategy

1. (Primary care or General practi* or Primary health care).tw. or Community mental health services/or Family practice/or Home care services/ or Family physicians/or Community health services/or Community health nursing/or Community pharmacy services/or Community health workers/or Preventive health services/

2. (Community mental health* or Family practice or Family medicine or Family physician* or Home care or Home based or Home health* or Community health* or Community nurs* or health visit* or Community pharmac* or Preventive care or Prevention program* or Preventive service* or Preventive health or Health promotion or aboriginal medical service or aboriginal community medical service).tw.

3. 1 or 2

4. oceanic ancestry group/or aborigin*.tw. or indigenous.tw. or torres strait* islander*.tw.

5. exp australia/ or australia*.tw. or au.in. or australia*.in. or northern territory.tw. or northern territory.in. or tasmania.tw. or tasmania.in. or new south wales.tw. or new south wales.in. or victoria.tw. or victoria.in. or queensland.tw. or queensland.in.

6. 4 and 5

7. 3 and 6

8. mental health/

9. mental health.mp.

10. mental disorder.mp.

11. mental disorder/

12. (social adj2 wellbeing).mp.

13. (well adj2 being).mp.

14. (social and emotional wellbeing).mp. [mp=title, abstract, original title, name of substance word, subject heading word, keyword heading word, protocol supplementary concept word, rare disease supplementary concept word, unique identifier]

15. grief/

16. “grief and loss”.mp.

17. Stress, Psychological/

18. stress.mp.

19. (trauma adj2 abuse).mp.

20. domestic violence/or child abuse/or elder abuse/ or spouse abuse/

21. (removal adj2 famil*).mp.

22. substance-related disorders/or alcohol-related disorders/ or amphetamine-related disorders/or inhalant abuse/ or marijuana abuse/or psychoses, substance-induced/

23. (substance adj2 (abuse or misuse)).mp.

24. (family adj2 (breakdown or breakup)).mp.

25. (cultur* adj2 dislocation).mp.

26. Prejudice/or racism.mp.

27. (racial adj2 discrimination).mp.

28. Socioeconomic Factors/

29. (social adj2 disadvantage*).mp.

30. Depression/or depression.mp.

31. anxiety/or anxiet*.mp.

32. distress.mp.

33. 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28 or 29 or 30 or 31 or 32

32. 7 and 33

Footnote:* includes all available forms of that word e.g Australia* includes Australia, Australians and Australia's

Data collection and analysis

Selection of research

All research articles (titles and abstracts) identified during the search will be imported into an EndNote library [31]. Duplicates will be removed. One reviewer (SF) will review titles and abstracts according to the criteria, to remove obviously irrelevant articles. Full text articles will be retrieved, and the remaining articles will be independently examined by two reviewers against the criteria. Disagreement surrounding the inclusion of an article will be resolved by discussion, or reviewed by a third reviewer (MH) if a consensus cannot be reached.

Programs and projects listed on the HealthInfoNet website social and emotional wellbeing page will be reviewed by SF, and obviously irrelevant programs will be excluded. The remaining programs and projects will be reviewed following the process mentioned above. Where there is a lack of clarity surrounding the project or program, up to three attempts will be made to contact the authors, via phone or email, to determine if further documents are publically available. Only programs with a publication, report or evaluation will be included in the review.

Data management and extraction

Data extraction and quality assessment will be completed simultaneously. Data will be extracted by one reviewer (SF) and verified by a second reviewer (AME). Research articles will be examined and data related to the outcome measures and review questions will be identified and extracted using data extraction forms specificity designed for this review.

To address the primary outcome, actions related to the use of Values and Ethics’ Values (reciprocity, respect, equality, responsibility, survival and protection and spirit and integrity) [9] and Local Protocols as reported by the author or identified by the reviewer will be extracted.

To address the secondary outcomes, the enablers and barriers as reported by the author and the implications for research practice will be extracted.

Data synthesis

The main findings will include a narrative synthesis of Value and Ethics’ use, enablers and barriers to research, impact on practice and impact on community-researcher relationships.

Quality assessment of research findings

Research meeting the above criteria will be categorised according to the research method and assessed for quality using the Qualitative Research Checklist from Critical Appraisal Skills Programme [32] (qualitative), Quality Assessment Tool For Quantitative Studies [33] (quantitative), or the Cochrane Collaboration’s tool for assessing risk of bias [34] (clinical trials).

Quality will be assessed by one reviewer (SF) and verified by a second reviewer (AME). Both reviewers will discuss research if a lack of consensus occurs. Assistance from a third interviewer (MH) will be sought if consensus cannot be reached. For research using multiple methods, research will be assessed according to the method that relates most closely to the primary aim of the research. Where mixed methods including a randomised control trial are used, a risk of bias assessment will also be completed. No research will be excluded based on quality.

Discussion

This systematic review will provide an overview of the research processes, enablers and barriers and impact on practice and on community-researcher relationships, to conducting Indigenous-focused SEWB PHC research in relation to Values and Ethics [9]. The findings from this review will provide Indigenous communities and PHC staff with information regarding current practices, highlight the use of Values and Ethics [9] and enable policy makers and researchers to identify better processes in order to plan and implement future research in line with Values and Ethics [9].

The identification of successful processes will assist future research design. By systematically identifying and collating enablers and barriers encountered when conducting research, this review will fill an important gap in the healthcare literature, relating to the successful and ethical conduct of Indigenous-focused PHC research conducted in collaboration with the external researchers. This review will provide insight into the impact and implementation of Values and Ethics [9].

Endnotes

1 The term “Indigenous peoples” is used throughout the paper refers to all Aboriginal and/or Torres Strait Islander peoples of Australia. It is used to reflect the fact that Australia’s Indigenous people do not represent a homogenous group.

Abbreviations

Indigenous: 

Aboriginal and Torres Strait Islander

Local Protocols: 

any processes or procedures developed by a community that researchers are expected to adhere to when conducting research or interacting with the community

PHC: 

primary healthcare

PRISMA: 

Peferred Items for Systematic Review and Meta-Analysis protocols

PROSPERO: 

International prospective register of systematic reviews

SEWB: 

social and emotional wellbeing

Values and Ethics: 

Value and Ethics: Guideline for Ethical Conduct in Aboriginal and Torres Strait Islander Health Research

Declarations

Acknowledgements

The authors would like to acknowledge staff at The University of Sydney Medical Library, for their help developing the search strategy for this review.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
The George Institute for Global Health
(2)
The University of Sydney

References

  1. Brough M. Healthy imaginations: a social history of the epidemiology of Aboriginal and Torres Strait Islander health. Med Anthropol. 2001;20(1):65–90.PubMedView ArticleGoogle Scholar
  2. Mc Loughlin F, Hadgraft N, Atkinson D, Marley J. Aboriginal health research in the remote Kimberley: an exploration of perceptions, attitudes and concerns of stakeholders. BMC Health Serv Res. 2014;14(1):517–28.PubMedPubMed CentralView ArticleGoogle Scholar
  3. Hayman N, Papaarangi M, King M. Improving health outcomes for Indigenous peoples: what are the challenges? [editorial]. Cochrane Database Syst Rev. 2015;8:ED000104.PubMedGoogle Scholar
  4. Kendall E, Sunderland N, Barnett L, Nalder G, Matthews C. Beyond the rhetoric of participatory research in indigenous communities: advances in Australia over the last decade. Qual Health Res. 2011;21(12):1719–28.PubMedView ArticleGoogle Scholar
  5. Humphery K. Dirty questions: Indigenous health and ‘Western research’. Aust N Z J Public Health. 2001;25(3):197–202.PubMedView ArticleGoogle Scholar
  6. Ethical research in Indigenous Australian contexts and its practical implementation [database on the Internet]. Edith Cowen University. 2012. Available from: http://ro.ecu.edu.au/cgi/viewcontent.cgi?article=1130&context=ecuworks2012. Accessed: 1 February 2015.
  7. Gillam L, Pyett P. A commentary on the NH&MRC draft values and ethics in aboriginal and Torres Strait Islander health research. Monash Bioeth Rev. 2003;22(4):8–19.PubMedView ArticleGoogle Scholar
  8. Donovan R, Spark R. Towards guidelines for survey research in remote Aboriginal communities. Aust N Z J Public Health. 1997;21(1):7.View ArticleGoogle Scholar
  9. National Health and Medical Research Council. Values and Ethics: guidelines for ethical conduct in Aboriginal and Torres Strait Islander health research. 2003. https://www.nhmrc.gov.au/guidelines-publications/e52. Accessed 1 September 2014.
  10. National Health and Medical Research Council: national statement on ethical conduct in human research. (2007 (updated 2014)). https://www.nhmrc.gov.au/guidelines-publications/e72. Accessed 1 September 2014.
  11. Bainbridge R, Tsey K, Brown C, McCalman J, Cadet-James Y, Margolis S, et al. Coming to an ethics of research practice in a remote Aboriginal Australian community. Contemp Nurse. 2013;46(1):18–27.PubMedView ArticleGoogle Scholar
  12. Dunbar T, Scrimgeour M. Ethics in Indigenous research—connecting with community. Bioeth Inq. 2006;3(3):179–85.View ArticleGoogle Scholar
  13. Carson K, Smith B. Methodological challenges and options for addressing them in Aboriginal and Torres Strait Islander health research. Australas Epidemiol. 2014;21(2):47–50.Google Scholar
  14. Australian Institute of Aboriginal and Torres Strait Islander Studies, The Lowitja Institute. Evaluation of the National Health and Medical Research Council documents: Values and Ethics: guidelines for ethical conduct in Aboriginal and Torres Strait Islander health research 2003 and keeping research on track: a guide for Aboriginal and Torres Strait Islander peoples about health research ethics. (2005). https://www.nhmrc.gov.au/_files_nhmrc/file/health_ethics/human/issues/nhmrc_evaluation_values_ethics_research_on_track_150513.pdf. Accessed 1 November 2014.
  15. Australian Institute of Aboriginal and Torres Strait Islander Studies, The Lowitja Institute. Researching right way Aboriginal and Torres Strait Islander health research ethics: a domestic and international review. 2013. https://www.nhmrc.gov.au/_files_nhmrc/file/health_ethics/human/issues/nhmrc_evaluation_literature_review_atsi_research_ethics_150513.pdf. Accessed 20 February 2015.
  16. Couzos S, Lea T, Murray R, Culbong M. ‘We are not just participants—we are in charge’: the NACCHO ear trial and the process for Aboriginal community-controlled health research. Ethn Health. 2005;10(2):91–111.PubMedView ArticleGoogle Scholar
  17. Dunbar T, Arnott A, Scrimgeour M, Henry J, Murakami-Gold L. Working towards change in Indigenous health research. Cooperative Research Centre for Aboriginal and Tropical Health. 2004. https://www.lowitja.org.au/sites/default/files/docs/LinksReport.pdf. 20 March 2015.
  18. Henderson R, Simmons D, Bourke L, Muir J. Development of guidelines for non-Indigenous people undertaking research among the Indigenous population of north-east Victoria. Med J Aust. 2002;176(10):482–5.PubMedGoogle Scholar
  19. Hurley A. Respect, acknowledge, listen: practical protocols for working with the Indigenous community of Western Sydney. 2003. http://www.wipo.int/export/sites/www/tk/en/databases/creative_heritage/docs/ccdnsw_indig_westsydney.pdf. Accessed 20 February 2015.
  20. Jamieson LM, Paradies YC, Eades S, Chong A, Maple-Brown L, Morris P, et al. Ten principles relevant to health research among Indigenous Australian populations. Med J Aust. 2012;197(1):16–8.PubMedView ArticleGoogle Scholar
  21. Eades S, Read A. The Bibbulung Gnarneep project: practical implementation of guidelines on ethics in indigenous health research. Med J Aust. 1999;170(9):433–6.PubMedGoogle Scholar
  22. Knight J, Comino E, Harris E, Jackson-Pulver L. Indigenous research: a commitment to walking the talk. The Gudaga study—an Australian case study. Bioeth Inq. 2009;6(4):467–76.View ArticleGoogle Scholar
  23. Zhao Y, Thomas S, Guthridge S, Wakerman J. Better health outcomes at lower costs: the benefits of primary care utilisation for chronic disease management in remote Indigenous communities in Australia’s Northern Territory. BMC Health Serv Res. 2014;14:463.PubMedPubMed CentralView ArticleGoogle Scholar
  24. Shelton B, Wofford J, Gosselink C, McClatchey M, Brekke K, Conry C, et al. Recruitment and retention of physicians for primary care research. J Community Health. 2002;27(2):79–89.PubMedView ArticleGoogle Scholar
  25. Sibthorpe B, Bailie R, Brady R, Ball S, Sumner-Dodd P, Hall W. The demise of a planned randomised controlled trial in an urban Aboriginal medical service. Med J Aust. 2002;177:222–4.PubMedGoogle Scholar
  26. A review of the social and emotional wellbeing of Indigenous Australian peoples [database on the Internet]2008. Available from: http://www.healthinfonet.ecu.edu.au/sewb_review. Accessed: 3 July 2015
  27. Australian Bureau of Statistics. Australian Aboriginal and Torres Strait Islander health survey: first results, Australia, 2012–13. 2014. http://www.abs.gov.au/ausstats/abs@.nsf/Latestproducts/9F3C9BDE98B3C5F1CA257C2F00145721?opendocument. Accessed 21 September 2014.
  28. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.PubMedPubMed CentralView ArticleGoogle Scholar
  29. Popay J, Rogers A, Williams G. Rationale and standards for the systematic review of qualitative literature in health services research. Qual Health Res. 1998;8(3):341–51.PubMedView ArticleGoogle Scholar
  30. Stroup D, Berlin J, Morton S, Olkin I, Williamson G, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–12.PubMedView ArticleGoogle Scholar
  31. Thompson Reuters. Endnote. 2015. http://endnote.com/. Accessed 1 October 2014.
  32. Critical appraisal skills programme (CASP). Qualitative research checklist 31.05.13. 2013. http://www.casp-uk.net/#!casp-international/c1zsi. Accessed 20 January 2015.
  33. National Collaborating Centre for Methods and Tools. Quality assessment tool for quantitative studies. ON: McMaster Universtiy, Hamilton. 2008. http://www.ephpp.ca/index.html. Accessed 20 January 2015.
  34. The Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. 2011. www.cochrane-handbook.org. Accessed 1 October 2014.

Copyright

© Farnbach et al. 2015