Skip to main content
Download PDF

The state of population health research performance in the Middle East and North Africa: a meta-research study

Systematic Reviews volume 10, Article number: 1 (2021) Cite this article

Abstract

Background

Population health (PH) research capacity and performance are essential pillars of evidence-based practice to help address health inequalities. Best evidence is provided by systematic reviews (SRs). None of the published bibliometric analysis specifically assess the production of SRs on PH in the Middle East and North Africa (MENA). The aim of our study is to investigate publication patterns and time trends of SRs reporting PH in the MENA region to evaluate the state of PH research performance in the region.

Method

The study protocol was developed a priori (protocol registration number: CRD42017076736). PubMed was searched. Two independent reviewers screened 5747 identified articles. We investigated author affiliation and collaboration, yearly citations of the SRs and journal information. Joinpoint regression was used to explore these characteristics overtime.

Results

Our meta-research included 387 SRs published between 2008 and 2016 which reported data on PH in 20 MENA countries. Publication of SRs increased over time in journals with impact factor < 4 and in the categories of yearly number of citations < 50 (p values ≤ 0.0024). Authors belonging to the region published increasingly (p value = 0.0001) over time. Thirty percent of the SRs were from authors solely from the region, while an additional 30% were from the region collaborating with Western country authors. Of these collaborative reviews, 79% were led by authors from the region. However, collaboration in the region (with the exclusion of collaboration with Western country authors) was rare (0.8%). These authors from the region published more in open-access journals while authors from Western countries collaborating or not with authors from the region published more in hybrid or non-open-access journals (p value < 0.0001). Collaboration between authors from MENA and Western countries led to published SRs in journals with impact factor ≥ 10. Systematic reviews with global coverage were published more by authors from Western countries, while SRs with country-level coverage were published by authors from the region (p value < 0.0001).

Conclusion

The incremental trend of PH SR publications on MENA likely reflects the ongoing improvement in research performance in the region. Authors from the region appear to be taking a lead role in conducting and disseminating MENA PH research. Open-access journals are a major contributor in facilitating MENA research dissemination.

Systematic review registration

PROSPERO registration number CRD42017076736

Peer Review reports

Background

Evidence-based practice is not only critical for ensuring the highest quality in patient care but also for policy-making and implementing public health interventions at both local and national levels. Best evidence is generated by well-conducted systematic reviews (SRs), since they critically appraise and synthesize data produced by primary studies addressing a specific research question [1]. The capability of a country to generate detailed knowledge and understanding of its health challenges is essential for developing and implementing preventative strategies to address health problems through evidence-based decision-making [2]. This is typically undertaken through published primary studies and thereafter critically synthesized in SRs. Researchers, policymakers, and clinicians should be informed with the best evidence available pertaining to their country’s population health (PH) in order to identify context-appropriate solutions.

Existing bibliometric analyses evaluate research performance at global and country-levels [3,4,5,6]. However, none of them specifically assess the production of SRs on PH in the Middle East and North Africa (MENA). The aim of our study is to investigate publication patterns and time trends of SRs reporting on PH topics in the MENA region to evaluate the state of PH research performance in the region. The objectives of our study are to (1) assess publication patterns and time trends of SRs on PH in MENA, (2) evaluate collaboration in published SRs, (3) identify common topics explored in PH research pertaining to MENA, and (4) explore the role of journals’ access policies in research dissemination from MENA.

Methods

Our meta-research study is part of the Population Health Publications Assessment Project aiming to assess the methodological quality and the use of gray literature in published SRs on population health in MENA [7,8,9,10]. An a priori protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO registration number CRD42017076736) [11] and published (https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-018-0751-4) [7]. We primarily conducted a SR of SRs to identify the SRs reporting data on PH in MENA published between January 2008 and December 2016 (2008 was chosen as the point of initiation since this was the publication year of the first version of the Cochrane Handbook for Systematic Reviews of Interventions) [12]. We first published the quality analysis of the literature search conducted in the identified cohort of SRs [8]. Thereafter, bibliometric analysis, as a statistical evaluation of published scientific articles [13], was applied to this cohort of SRs.

Inclusion and exclusion criteria

We included SRs reporting data on any PH topic within 20 MENA countries, namely Algeria, Bahrain, Djibouti, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Morocco, Oman, Pakistan, Palestine, Qatar, Saudi Arabia, Sudan, Syria, Tunisia, United Arab Emirates, and Yemen. Selection details of the 20 countries have been published [7]. Based on PRISMA-P terminology [14], we defined a SR as a review of primary studies reporting a search strategy for at least one electronic database along with eligibility criteria, which were applied during a multi-stage process of study selection. PH was defined as “the health outcomes of a group of individuals, including the distribution of such outcomes within the group” [15]. Narrative review or systematic analysis synthetizing primary studies which were not identified and selected following a systematic process were excluded.

Literature search and data management

The literature search was conducted on PubMed [16], the first public digital archives [17] including MEDLINE database, which is also included in Embase [18] and Scopus [19]. We utilized search criteria combining MENA countries, regions and populations’ names and limited to reviews, systematic reviews, and meta-analyses. By searching PubMed, we likely included most of the SRs on PH in MENA published in peer-reviewed journals during 2008–2016. Details of the search strategy have been published [7]. Similar search criteria have been utilized for SRs on PH in MENA and published in peer-reviewed journals [10, 20,21,22,23].

A total of 5747 articles were identified. After two independent multi-stage screenings including title/abstract and full-text screening, 387 SRs were included in the analysis (PRISMA flowchart and characteristics of included SRs are in additional files 3 and 4). Data extraction was conducted by two reviewers and cross-checked for accuracy. From each SR the research topic, year of publication, journal’s name, MENA country/countries covered by the SR, and authors’ country of affiliation(s) were extracted.

SR authors were categorized based on the country of their institutional affiliation. Authors were categorized as: belonging to the MENA countries if one of their institutional affiliations was in one of the 20 selected countries; to be from neighboring countries if their institutional affiliations were in a country not included in the 20 selected MENA countries but from other Middle East countries or South Asia or Africa; and from non-MENA and non-neighboring (NMNN) countries if their institutional affiliations were not from the 20 selected MENA countries, other Middle East countries, South Asia, or Africa. Due to the geographic proximity of the neighboring countries, which often share socio-economic and cultural aspects with some of the 20 selected countries, we differentiated those authors affiliated to institutions located in these countries from authors from NMNN countries located, for instance, in Europe, Australia, or the North American continent. The rationale for this is that a few of the neighboring countries such as Iran [24,25,26,27], Turkey [27], and Somalia [25, 26] are sometimes included in the definition of the MENA region.

We discussed the health topics addressed by the included SRs according to the disease burden in MENA. Research topics studied by the included SRs were categorized following Global Burden of Disease (GBD) study classification [27]. The three main categories were communicable, maternal, neonatal, and nutritional diseases (GBD code: A); non-communicable diseases (NCDs; GBD code: B); and injuries (GBD code: C). A fourth category “other” was used when the topic did not match any of GBD categories. The GBD disability adjusted life years (DALYs) estimates in the MENA region between 2008 and 2016 for these topics were retrieved from the Institute for Health Metrics and Evaluation website [27].

The journal’s impact factor (JIF) during the year of publication was obtained from the Institute of Scientific Information’s Journal Citation Report (ISI-JCR, ISI http://www.scijournal.org/list-of-impact-factor-journal_I.shtml). Since citations measured by Google Scholar might more appropriately reflect the impact of a publication in the scientific community and in the society (for instance, in dissertations, websites, non-indexed journals, non-English sources, book chapters), the number of citations were collected on Google Scholar [28]. Number of citations per year for each SR was calculated as the total number of citations divided by the number of years since publication. A period of at least 1 year was given between the date of publication of a SR (up to December 31, 2016) and the date of the collection of the number of citations (on January 17, 2018). From the journals’ websites, we collected information on the publisher’s name, open access status, and potential affiliation to a society, association, or university.

Analysis

Publication pattern and time trends analyses were conducted on the basis of author institutional affiliation as per the following categories: (1) “Inside”—authors affiliated to institutions located in MENA and/or neighboring countries, (2) “Outside”—authors affiliated to institutions located in NMNN countries, and (3) “North-South collaboration”—authors affiliated to institutions located in MENA and/or neighboring countries collaborating with authors from NMNN countries. The time trend for yearly number of publications was assessed using linear regression in unstratified and stratified data. We assessed significance of the association using the F test and the goodness-of-fit of the models using adjusted R-squared statistics. We also conducted analyses by yearly number of citations and JIF. Fisher’s exact test was utilized to assess the differences between the number of publications between SRs and journals characteristics. Authors’ affiliation in SRs was used as a proxy for research capacity [4]. Association statistical significance threshold was at 0.01. We used R-3.3.1 software and SPSS V.25 for our analyses.

Results

Time trends

A linear statistically significant increase in the annual number of published SRs was identified (from 16 in 2008 to 81 in 2016, 406% increase, Table 1 and Additional file 1). Systematic reviews were increasingly published by (i) “Inside” authors (two to 29, + 1350% increase), (ii) “Outside” authors (eight to 26, + 225% increase), and (iii) by authors from the “North-South collaboration” category (six to 26, + 333% increase). Similarly, a linear statistically significant increase in the annual number of published SRs at country-level coverage was also identified (Adj. R2 = 0.71, p value = 0.0024), from five in 2008 to 18 in 2016 (+ 260% increase).

Table 1 Univariate regression analysis of systematic review production time trend by publication characteristics
Full size table

Between 2008 and 2016, a statistically significant linear increase in the number of published SRs was also demonstrated in the categories 0 ≤ JIF < 2 and 2 ≤ JIF < 4, which represents 90% of the journals tracked by ISI-JCR [29] and for the yearly number of citations n < 10 and 10 ≤ n < 50. However, in the JIF categories 4 ≤ JIF < 6 and JIF ≥ 6 (i.e., the top 10% and 5% of journals tracked by ISI-JCR, respectively [29]), the increase was not significant, and in the yearly citations categories 50 ≤ n < 100 and n ≥ 100, only a couple of SRs were published each year. When we excluded studies with global and multi-region coverage, there was also a linear statistically significant increase of published SRs in the JIF < 4 categories (Adj. R2 = [0.74–0.83], p values < 0.0020). Regarding the yearly number of citations, when we excluded SRs with global and multi-region coverage, the increase in the number of published SRs was statistically significant for the category n < 10 (from eight in 2008 to 26 in 2016; + 225% increase, Adj. R2 = 0.87, p value = 0.0001) and for the category 10 ≤ n < 50 (from one in 2008 to 23 in 2016; + 2200% increase, Adj. R2 = 0.64, p value = 0.0058).

Yearly number of citations

Nevertheless, we observed a significant increase of yearly number of citations along with the increase of JIF (p value < 0.0001, Table 2). In the SRs published in journals with a JIF < 2, 79% (139/176) were cited less than 10 times a year. Conversely, the 11 SRs with over 100 yearly citations were all published in journals with a JIF > 7. Therefore, SRs published in high JIF journals are cited more frequently than SRs published in journals with a low JIF.

Table 2 Journal impact factors analysis
Full size table

Authors’ affiliations

Authors from MENA and/or neighboring countries published 30% (“Inside” category: 115/387) of the SRs and collaborated with authors from NMNN countries in an additional 30% (“North-South collaboration” category: 115/387) of the published SRs (Table 3). We identified one SR with authors affiliated solely to institutions located in different MENA countries (Fig. 1). Similarly, South-South collaboration between authors affiliated solely to institutions located in MENA and institutions located in neighboring countries were rare (0.5%; 2/387). Authors from MENA and/or neighboring countries collaborating with authors from NMNN countries were leading the research (first and/or last author position) in 79% of the North-South collaborations (53%; 61/115 SRs from MENA and 26%; 30/115 SRs from neighboring countries). In total, authors from MENA and/or neighboring countries were leading the research in 54% (203/387 SRs) of the published SRs on PH in MENA countries (Fig. 1).

Table 3 Analysis of author’s country of affiliation and collaboration productivity
Full size table
Fig. 1
figure 1

Contribution, collaborations and leadership by author affiliations during 2008–2016. MENA countries (native): authors affiliated to institutions located in MENA countries covered by the systematic review. MENA countries (non-native): authors affiliated to institutions located in MENA countries not covered by the systematic review

Full size image

Nevertheless, published SRs reporting data on MENA led by authors from MENA and/or neighboring countries is a recent phenomenon. In 2008–2010, the number of published SRs by “Inside” authors (12%, 7/59) was 2.9 and 4.6 times lower than in the two other categories (“North-South collaboration”: 37%, 22/59 and “Outside”: 51%, 30/59, respectively), while in 2014–2016, “Inside” authors published 34% (70/206) of the SRs, while “North-South collaboration” authors published 32% (66/206) and “Outside” authors 34% (71/206).

Publisher and journal profiles

The vast majority of the top 10 publishers (out of 62 publishers) with the highest average number of published SRs per journals were non-commercial [30] (90%) and local (70%, data not shown). A wide range of journals (N = 243) published SRs reporting data on PH in MENA. Among them, 65 journals (17%, 65/243) published SRs reporting data on PH in MENA exclusively when these SRs had a global and multi-region coverage (85 published SRs out of 387, 22%). Most of the journals (87%, 213/243) published one or two SRs covering at least one of the MENA countries. Eighteen journals (7%, 18/243) published at least four SRs reporting data on PH in MENA (publishing 27% of SRs, 106/387). A large proportion of them were open-access journals (72%, 13/18) and 39% of them were specialized in infectious disease.

Author affiliation versus journal profile

A significant difference in the type of journals where SRs were published was observed according to author affiliation (Table 3). Most of the SRs by “Inside” authors were published in open-access journals (64%, 74/115), while most of the SRs by “Outside” authors were published in hybrid or non-open-access journals (62%, 98/157). We also observed that journals with an open-access policy have significantly lower JIFs than non-open access journals (Table 2). The number of yearly citations of published SRs varies significantly according to journal access, with lower citation frequencies for open and hybrid-access journals than for non-open access journals (p value < 0.0001, Additional file 2).

Among the journals publishing at least four SRs, local journals (28%, 5/18)—which were all open access and with a JIF<2—published the highest number of SRs by “Inside” authors (67%, 22/33 SRs by “Inside” authors), and none published global or multi-regional SRs. Two journals were international with open access, focusing on publishing methodologically sound research regardless of the perceived impact the research may have on their JIF (22%, 23/106 SRs, data not shown). These journals published the second highest number of SRs by “Inside” authors (24%, 8/33 SRs). Additionally, a large proportion of the SRs (61%, 14/23 SRs) published in these journals did not have a global or multi-region coverage.

We also assessed journals with very high impact factors (JIF ≥ 10). Twenty-three SRs (6%, 23/387) were published in journals with a JIF ≥ 10 (data not shown). “Outside” authors published 70% (16/23) of these SRs and the remaining 30% were published by the “North-South collaboration” category. Among the SRs obtaining over 50 citations per year, 78% (21/27 publications) were by “Outside” authors and the remaining 22% were a North-South collaboration. Research collaboration with authors from Western countries appears to be one of the key factors for authors from MENA and/or neighboring countries to be able to publish in high impact factor journals, and thereafter for the articles to be highly cited, likely as a result of being published in such journals.

Systematic reviews’ geographical coverages

Systematic reviews with country-level or MENA subregion coverage were published significantly more in journals with a JIF < 2, the exception being SRs covering the African areas (Table 2). While SRs with global or multi-regions coverage were published significantly more in journals with a JIF ≥ 4. Consequently, the yearly number of citations was significantly highest for those SRs, while country-level and MENA sub-regional SRs—including those covering the African areas—were predominantly receiving less than 10 citations per year (additional file 2). Systematic reviews with global or multi-region coverage were published significantly more by “Outside” authors (Table 3). While country-level and MENA sub-regional SRs were mainly published by “Inside” authors, the exception being the SRs covering the African area, which were more published by authors in the “North-South collaboration” category.

Systematic reviews’ health topics

Between 2008 and 2016, the most common topic addressed in the SRs reporting data on the MENA region was NCDs (48%, 185/387, Fig. 2). Among the NCDs, cancer, mental health, metabolic syndrome including diabetes, and cardiovascular disease were commonly researched topics. In 2008, the most common topic addressed in the SRs was infectious disease, including foodborne, blood-borne, and sexually transmitted infections and anti-microbial resistance (44%, 7/16). Between 2008 and 2016, the 18 journals that published at least four SRs reporting data on PH in MENA countries published 41% (54/133) of the SRs on infectious disease. Among these journals, seven specialized in infectious disease topics (39%). Over the years, the proportion of SRs addressing infectious disease topics decreased to 36% (29/81, 2016). Between 2008 and 2016, 86% (133/155) of the SRs addressing the health topic communicable, maternal, neonatal, and nutritional diseases were on infectious disease. No SR was published on maternal disorders. In 2016, three SRs on metabolic syndrome, six on diabetes, three on cardiovascular disease, two on substance use abuses, two on neonatal disorders, and four on nutritional deficiency were published, while in 2008, no SRs on these topics were published. While the ratio between the burden of NCDs and communicable, maternal, neonatal, and nutritional diseases—measured with DALYs—was increasing over time (2.1 in 2008 to 3.2 in 2016), the proportion of published SRs addressing these topics did not change significantly over time and was not proportional to the disease burden (Fig. 3).

Fig. 2
figure 2

Population health topics covered by the published systematic reviews reporting data on MENA in 2008–2016

Full size image
Fig. 3
figure 3

Time trends of DALYs and proportion of published systematic reviews. CD communicable, maternal, neonatal, and nutritional diseases (GBD code: A). NCD non-communicable diseases (NCD, GBD code: B)

Full size image

Discussion

The increase in SRs published annually is likely due to an increase in the publication of primary studies conducted in MENA countries. Systematic reviews by authors from the MENA region also increased—both those collaborating with authors from Western countries as well as those not. Our findings suggest ongoing research capacity building and performance improvement in the region. Development of PH research in the region will enhance PH [31] via evidence-based policy-making and interventions [4].

International research collaborations, which have been facilitated by globalization [32], play a major role in the production of population health data and the development of evidence-based solutions pertaining to global health problems [31]. Collaboration between authors from MENA and/or neighboring countries with authors from Western countries has increased for SRs. North-South research collaboration dynamics have been usually reported as being between unequal partners institutions with power remaining with the North [33,34,35,36], which raises ethical concerns in the “social world” of global health [37, 38]. Our findings suggest that while published SRs on PH in MENA were previously also dominated by authors affiliated in Western countries, researchers from MENA appear to be taking now the lead by increasingly publishing SRs on topics of importance for the region and collaborating with authors from Western countries. For published SRs, North-South collaboration dynamics appear to be changing in the region with partners from the South identifying their PH research gaps and research capacity needs and addressing them by seeking specific expertise from the North. South-led published SRs are probably not affected by the barriers faced by South-led basic science research, i.e., lack of resources and research skills [39]. Conducting SRs requires minimal equipment as compared to basic science research conducted in wet laboratories, where more sophisticated and expensive equipment maybe required. Additionally, handbooks and guidelines to support researchers in rigorously conducting and reporting SRs are freely available online since the last two decades [12, 40, 41].

While we observed South-South research partnerships, collaboration between authors from MENA and neighboring countries was rare if the collaboration did not include authors from Western countries. Researchers from MENA appear to seek for peers’ expertise mainly from researchers located in Western countries. However, we believe that MENA and neighboring countries experience similar health challenges and could benefit from future cooperation [42]. In the context of globalization, some universities and colleges from North America and Europe established campuses within the region and this has contributed to build in the region research capacity at high levels [43]. Barriers to South-led research previously identified such as donor influence for the choice of research topics and lack of resources and research skills [39] could be addressed by South-South collaborations established with such imported branches of Western institutions, Regional, and country-level collaboration between researchers from MENA and/or neighboring countries can promote PH development by strengthening research capacity and performance via common objectives and shared local expertise.

In addition to making international research collaborations simpler [32], globalization has also facilitated communication of scholarly peer reviewed research by allowing accessibility and usefulness of research through open-access [32]. Authors from the region mainly published SRs that focused on MENA countries or subregions in journals with a JIF < 2 and predominantly in local and international open-access journals. This may be because open-access journals consider methodologically sound research regardless of the perceived impact the research topic may have on their JIF. Journals which are free from JIF dictate play a major role in the global dissemination [44] of the SRs conducted by authors affiliated to institutions located in MENA reporting epidemiological primary studies conducted in MENA. The peer-review process of these journals appear to show less bias against authors affiliated to institutions located in MENA [45,46,47] and/or non-native English speakers [48]. These journals are therefore contributing to the field of global health by supporting ethic of equity [37, 38] and encouraging research performance improvement and enabling research culture in the region by giving a voice to authors from MENA countries and highlighting health issues pertinent to the region [49]. This enhances PH knowledge pertaining to MENA, which may ultimately lead to better-informed policies contributing to national healthcare policy development and implementation of informed evidence-based healthcare practice [50].

However, while open-access journals enable free reader access to published articles [51], most require a fee for publishing. This may be a barrier for researchers from MENA without appropriate funding and contribute to unbalanced North-South partnership [34]. Notably, some international publishers are addressing this issue by waiving fees for authors who are unable to afford the charge [44]. Publishers located in MENA countries should consider waiving fees for eligible authors to attract additional manuscript submission and to promote wider research dissemination.

Historically, reviews on diseases not prevalent in the “Western world” were unlikely to be of interest to researchers from these countries. This may in turn have resulted in minimal citations of reviews on diseases not prevalent in these countries. Such reviews may then lead to a negative impact on the JIF of a journal if published [52]. However, our review now identifies an increase in published SRs reporting data on MENA PH with yearly number of citations between 10 and 50. This suggests that there were probably both an increase in the interest of journal readers toward PH in MENA as well as in researchers reuse of data on MENA countries reported by these SRs. The progress and increase in global health research projects by researchers from Western countries studying health issues of low- and middle-income countries may have diminished the bias of international journals against the “diseases of poverty,” which are rare or nonexistent in high-income countries [52, 53].

Non-communicable disease is a major PH issue in MENA. The DALYs for NCDs between 2008 and 2016 was at least twice as high as communicable, maternal, neonatal, and nutritional diseases, combined [54]. In 2017, the death rate from non-communicable diseases was five-times higher than death rate from infectious disease [55]. Five of the 10 countries with the highest diabetes prevalence worldwide are in MENA [56]. Additionally, obesity prevalence in MENA countries often exceeds the estimated global average (13%) [57] and in some countries exceeds the prevalence in the USA (e.g., 41% in Qatar in 2012 [58] versus 36% in the USA between 2011 and 2014 [59]). Nevertheless, the proportions of SRs addressing NCDs and communicable, maternal, neonatal, and nutritional diseases topics were similar. This may reflect the development of global health research studying infectious diseases [30] and funding influence on the selection of research topics [39]. A substantial proportion of the SRs appearing in the 18 journals that published at least four SRs reporting data on MENA investigated infectious diseases. The dissemination of this data appears to be facilitated by the interest of journals in specific topics. The topics addressed in the SRs reporting population health in MENA do not appear matching the disease burden in the region. Systematic reviews reporting on NCDs and their risk factors would enable the characterization, synthesis, and further understanding the epidemiology of such diseases in the MENA region, and facilitate evidence-based practice in policy-making and public health interventions.

In 2006, a study identified five factors explaining why research from developing countries was underrepresented in international health literature [53]. Four of these were related to poor research capacity in these countries, while the fifth highlighted the bias of international medical journals. In 2001, under-representation of content on PH in low-income countries in general medical journals with a JIF ≥ 10 was revealed [52]. Eighteen years later, our overview demonstrates that publication bias on SRs from MENA authors continues to exist in high impact factor (JIF > 10), non-open (or hybrid) access journals pertaining to topics reporting on MENA countries. One explanation for the low acceptance rate of SRs from the region may be the influence the research may have on the JIF [60]. Our recommendation to journals that publish manuscripts according to the perceived significance of the research work is to ensure double-blind peer review to avoid any discrimination that could arise because of the names and/or the affiliations of the publication authors [47].

We believe this is the first SR of SRs that investigates research capacity and performance in MENA pertaining to SR publication and explores the role of journals in disseminating SRs on and from MENA. The strength of our report is the large and representative sample of published SRs reporting on all PH topics in MENA. Overall, this study provides objective findings about research performance to researchers, clinicians, and policymakers. Comprehending research performance, its enablers and barriers in MENA may help rationalize staffing decisions and direct appropriate funding from national and international entities [61] which support knowledge acquisition and research capacity building [4]. Our findings will help in decision-making and strategy development regarding the publication of research on PH in MENA, and from MENA researchers. Nevertheless, including articles indexed on PubMed between 2008 and 2016 is technically different from those published between 2008 and 2016 [62]. Therefore, we might have missed some SRs, which were published in 2016 but their indexation was delayed. Additionally, we might have also missed some SRs published in journals not indexed on PubMed. However, the exclusion of those articles would unlikely affect our overall findings and conclusions.

Conclusion

An increasing number of SRs reporting epidemiological data from MENA countries are being published, reflecting the ongoing research capacity building and performance improvement in the region. Authors affiliated to institutions located in the region appear to be taking the lead in conducting research and disseminating information related to topics of relevance to PH in MENA. Local and international open-access journals, which give due consideration to methodologically sound research regardless of its impact on the journal impact factor are playing an important role in providing a platform to researchers from the region. Future meta-research assessing the productivity of primary studies in MENA countries is required to better understand PH research capacity and performance in the region.

Availability of data and materials

All data generated or analyzed during this study are included in this published article and its supplementary information files.

Abbreviations

AMSTAR:

Assessment of Multiple Systematic Reviews

ISI-JCR:

Institute of Scientific Information–Journal Citation Report

JIF:

Journal impact factor

MENA:

Middle East and North Africa region

NCDs:

Non-communicable diseases

NMNN:

Non-MENA and non-neighboring countries

PH:

Population health

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

PRISMA-P:

Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols

SR:

Systematic review

References

  1. Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016;21(4):125–7.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Nchinda TC. Research capacity strengthening in the South. Soc Sci Med (1982). 2002;54(11):1699–711.

    Article  Google Scholar 

  3. Badenhorst A, Mansoori P, Chan KY. Assessing global, regional, national and sub-national capacity for public health research: a bibliometric analysis of the Web of Science(TM) in 1996-2010. J Glob Health. 2016;6(1):010504.

    Article  PubMed  PubMed Central  Google Scholar 

  4. McGregor S, Henderson KJ, Kaldor JM. Capacity building in longitudinal HIV research. Lancet Glob Health. 2015;3(1):e18–9.

    Article  PubMed  Google Scholar 

  5. Nafade V, Nash M, Huddart S, Pande T, Gebreselassie N, Lienhardt C, et al. A bibliometric analysis of tuberculosis research, 2007-2016. PLoS One. 2018;13(6):e0199706.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  6. Rezaee-Zavareh MS, Salamati P, Alavian SM. Iran's research needs to be more noticed - Authors' reply. Lancet. 2017;389(10068):504.

    Article  PubMed  Google Scholar 

  7. Chaabna K, Cheema S, Abraham A, Alrouh H, Mamtani R, Sheikh JI. Gray literature in systematic reviews on population health in the Middle East and North Africa: protocol of an overview of systematic reviews and evidence mapping. Syst Rev. 2018;7(1):94.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Chaabna K, Cheema S, Abraham A, Mamtani R. Strengthening literature search strategies for systematic reviews reporting population health in the Middle East and North Africa: a meta-research study. J Evid Based Med. 2020;13(3):192–8. https://doi.org/10.1111/jebm.12394.

  9. Chaabane S, Chaabna K, Abraham A, Mamtani R, Cheema S. Physical activity and sedentary behaviour in the Middle East and North Africa: An overview of systematic reviews and meta-analysis. Sci Rep. 2020;10(1):9363.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Chaabna K, Cheema S, Abraham A, Alrouh H, Lowenfels AB, Maisonneuve P, et al. Systematic overview of hepatitis C infection in the Middle East and North Africa. World J Gastroenterol. 2018;24(27):3038–54.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, et al. PROSPERO at one year: an evaluation of its utility. Syst Rev. 2013;2:4.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Higgins J, Green S. Cochrane handbook for systematic reviews of interventions Version 5.1.0 The Cochrane Collaboration; 2011.

    Google Scholar 

  13. Iftikhar PM, Ali F, Faisaluddin M, Khayyat A, De Gouvia De Sa M, Rao T. A bibliometric analysis of the top 30 most-cited articles in gestational diabetes mellitus literature (1946-2019). Cureus. 2019;11(2):e4131.

    PubMed  PubMed Central  Google Scholar 

  14. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kindig D, Stoddart G. What is population health? Am J Public Health. 2003;93(3):380–3.

    Article  PubMed  PubMed Central  Google Scholar 

  16. National institutes of Health. PubMed.gov US National Library of Medcine Bethesda, USA2016 [Available from: http://www.ncbi.nlm.nih.gov/pubmed.

  17. Masic I, Milinovic K. On-line biomedical databases-the best source for quick search of the scientific information in the biomedicine. Acta Inform Med. 2012;20(2):72–84.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Elsevier. Embase: Elsevier; 2018 [Available from: https://www.elsevier.com/solutions/embase-biomedical-research.

  19. Elsevier. Scopus: Content Coverage Guide: Elsevier; 2017 [Available from: https://www.elsevier.com/__data/assets/pdf_file/0007/69451/0597-Scopus-Content-Coverage-Guide-US-LETTER-v4-HI-singles-no-ticks.pdf.

  20. Chaabna K, Kouyoumjian SP, Abu-Raddad LJ. Hepatitis C virus epidemiology in Djibouti, Somalia, Sudan, and Yemen: systematic review and meta-analysis. PLoS One. 2016;11(2):e0149966.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  21. Chaabna K, Mohamoud YA, Chemaitelly H, Mumtaz GR, Abu-Raddad LJ. Protocol for a systematic review and meta-analysis of hepatitis C virus (HCV) prevalence and incidence in the Horn of Africa sub-region of the Middle East and North Africa. Syst Rev. 2014;3:146.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Chemaitelly H, Chaabna K, Abu-Raddad LJ. The Epidemiology of Hepatitis C Virus in the Fertile Crescent: Systematic Review and Meta-Analysis. PLoS One. 2015;10(8):e0135281.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  23. Chaabna K, Alali W. Enteric Salmonella in humans and food in the Middle East and North Africa: protocol of a systematic review. BMJ Open. 2017;7(7):e017399.

    Article  PubMed  PubMed Central  Google Scholar 

  24. The World Bank. Data: Wold Bank Country and Lending Groups: The World Bank; 2017 [Available from: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.

  25. World Health Organisation. Country groupings: subregional country groupings for the global assessment of disease burden: WHO; N.D. [Available from: http://www.who.int/quantifying_ehimpacts/global/ebdcountgroup/en/.

  26. The Joint United Nations Programme on HIV/AIDS. UNAIDS Middle East & North Africa: UNAIDS; 2017 [Available from: http://www.unaidsmena.org/.

  27. Institute for Health Metrics and Evaluation GBD Compare | Viz Hub: University of Washington; 2017 [Available from: http://vizhub.healthdata.org/gbd-compare/.

  28. Kulkarni AV, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA. 2009;302(10):1092–6.

    Article  CAS  PubMed  Google Scholar 

  29. Research Medecal Library. What is considered a good impact factor? Texas, US: The University of Texas, MD Anderson Cancer Center; 2017 [Available from: http://mdanderson.libanswers.com/faq/26159.

  30. Nonprofit Publisher: Science Direct; 2019 [Available from: https://www.sciencedirect.com/topics/computer-science/nonprofit-publisher.

  31. Hanney SR, Gonzalez-Block MA. Health research improves healthcare: now we have the evidence and the chance to help the WHO spread such benefits globally. Health Res Policy Syst. 2015;13:12.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Globalization of Science: Labfolder; 2019 [Available from: https://www.labfolder.com/blog/globalization-of-science/.

  33. Muldoon KA, Birungi J, Berry NS, Ngolobe MH, Mwesigwa R, Shannon K, et al. Supporting southern-led research: implications for North-South research partnerships. Can J Public Health. 2012;103(2):128–31.

    Article  PubMed  PubMed Central  Google Scholar 

  34. de Graft Aikins A, Arhinful DK, Pitchforth E, Ogedegbe G, Allotey P, Agyemang C. Establishing and sustaining research partnerships in Africa: a case study of the UK-Africa Academic Partnership on Chronic Disease. Glob Health. 2012;8:29.

    Article  Google Scholar 

  35. Reddy P, Desai R, Sifunda S, Chalkidou K, Hongoro C, Macharia W, et al. "You Travel Faster Alone, but Further Together": Learning from a cross country research collaboration from a British Council Newton Fund Grant. Int J Health Policy Manag. 2018;7(11):977–81.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Walsh A, Brugha R, Byrne E. "The way the country has been carved up by researchers": ethics and power in north-south public health research. Int J Equity Health. 2016;15(1):204.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Crane JY. Unequal ‘Partners’. AIDS, Academia, and the Rise of Global Health. Behemoth. 2010;3(3):78–97.

    Article  Google Scholar 

  38. Gautier L, Sieleunou I, Kalolo A. Deconstructing the notion of "global health research partnerships" across Northern and African contexts. BMC Med Ethics. 2018;19(Suppl 1):49.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Van der Veken K, Belaid L, Delvaux T, De Brouwere V. Research capacity building through North-South-South networking: towards true partnership? An exploratory study of a network for scientific support in the field of sexual and reproductive health. Health Res Policy Syst. 2017;15(1):39.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.

    Article  PubMed  Google Scholar 

  41. Institute of Medicine. Finding what works in health care: standards for systematic reviews. Washington, DC: The National Academies Press; 2011.

    Google Scholar 

  42. World Health Organization. WHO's work with countries. Cooperation among countries. 2018 [Available from: http://www.who.int/country-cooperation/what-who-does/inter-country/en/.

    Google Scholar 

  43. Sheikh JI, Cheema S, Chaabna K, Lowenfels AB, Mamtani R. Capacity building in health care professions within the Gulf cooperation council countries: paving the way forward. BMC Med Educ. 2019;19(1):83.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Barbour V, Chinnock P, Cohen B, Yamey G. The impact of open access upon public health. Bull World Health Organ. 2006;84(5):339.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Harris M, Macinko J, Jimenez G, Mullachery P. Measuring the bias against low-income country research: an Implicit Association Test. Glob Health. 2017;13(1):80.

    Article  Google Scholar 

  46. Yousefi-Nooraie R, Shakiba B, Mortaz-Hejri S. Country development and manuscript selection bias: a review of published studies. BMC Med Res Methodol. 2006;6:37.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Tomkins A, Zhang M, Heavlin WD. Reviewer bias in single- versus double-blind peer review. Proc Natl Acad Sci U S A. 2017;114(48):12708–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Ross JS, Gross CP, Desai MM, Hong Y, Grant AO, Daniels SR, et al. Effect of blinded peer review on abstract acceptance. Jama. 2006;295(14):1675–80.

    Article  CAS  PubMed  Google Scholar 

  49. The PLoS Medicine Editors. The impact factor game. PLoS Med. 2006;3(6):e291.

    Article  PubMed Central  Google Scholar 

  50. Ofori-Adjei D, Antes G, Tharyan P, Slade E, Tamber PS. Have online international medical journals made local journals obsolete? PLoS Med. 2006;3(8):e359.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Sabri A, Ahad QM. Open Access Journals, need of developing countries. Reader Comments. PLoS Med. 2006. https://journals.plos.org/plosmedicine/article/comment?id=10.1371/annotation/e16e0819-c4a7-4d9a-b4a5-f6418228b263.

  52. Horton R. Medical journals: evidence of bias against the diseases of poverty. Lancet. 2003;361(9359):712–3.

    Article  PubMed  Google Scholar 

  53. Langer A, Diaz-Olavarrieta C, Berdichevsky K, Villar J. Why is research from developing countries underrepresented in international health literature, and what can be done about it? Bull World Health Organ. 2004;82(10):802–3.

    PubMed  PubMed Central  Google Scholar 

  54. exchange GHD. Deaths and DALYs for 2016 2018 [Available from: http://ghdx.healthdata.org/gbd-results-tool.

  55. exchange GHD. GBD Results Tool. Deaths for 2017 2019 [Available from: http://ghdx.healthdata.org/gbd-results-tool.

  56. The World Bank. Diabetes prevalence (% of population ages 20 to 79) 2016 [Available from: http://data.worldbank.org/indicator/SH.STA.DIAB.ZS.

  57. World Health Organisation. Obesity and overweight fact sheet Geneva, Switzerland2016 [Available from: http://www.who.int/mediacentre/factsheets/fs311/en/.

  58. Supreme Council of Health. WHO Qatar STEPWISE Report 2012 chronic disease risk factor surveillance Doha, Qatar; 2013.

  59. Ogden CL, Carroll MD, Fryar CD, Flegal KM. Prevalence of obesity among adults and youth: United States, 2011-2014. NCHS Data Brief. 2015(219):1–8.

  60. Marcovitch H. Editors, publishers, impact factors, and reprint income. PLoS Med. 2010;7(10):e1000355.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Thomson Reuters. White Paper Using Bibliometrics: a guide to evaluating research performance with citation data: Thomson Reuters; 2008 [Available from: http://ip-science.thomsonreuters.com/m/pdfs/325133_thomson.pdf.

    Google Scholar 

  62. Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, et al. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13(5):e1002028.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge Hekmat Alrouh for his contribution to the literature search and screening and Aida Tariq Nasir for reviewing the tables. Both individuals are previous employees of the Institute for Population Health at Weill Cornell Medicine—Qatar.

Funding

This work was not supported by any funding agency.

Author information

Authors and Affiliations

  1. Institute for Population Health, Weill Cornell Medicine—Qatar, Doha, Qatar

    Karima Chaabna, Sohaila Cheema, Amit Abraham & Ravinder Mamtani

  2. Division of Epidemiology and Biostatistics, IEO European Institute of Oncology IRCCS, Milan, Italy

    Patrick Maisonneuve

  3. Department of Surgery and Department of Family Medicine, New York Medical College, Valhalla, NY, USA

    Albert B. Lowenfels

Authors
  1. Karima Chaabna
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sohaila Cheema
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amit Abraham
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Patrick Maisonneuve
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Albert B. Lowenfels
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ravinder Mamtani
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KC, SC, and RM collectively contributed to the conception of the study. KC and AA were involved in the literature search, screening, and extraction steps. Analysis and manuscript drafting were implemented by KC with support from SC, RM, ABL, and PM. All authors read, edited, and approved the final manuscript.

Corresponding author

Correspondence to Karima Chaabna.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Time trend of annual numbers of systematic reviews on population health in MENA between 2008 and 2016. a: overall trend (unstratified data); b: trends according to author affiliation; c: trends according to journal impact factor (IF); d: trends according to number of yearly citations.

Additional file 2.

Number of yearly citations analysis.

Additional file 3.

PRISMA flowchart of searches, screening, and inclusion and exclusion of systematic reviews.

Additional file 4.

Characteristics of the included systematic reviews on population health in the Middle East and North Africa, 2008-2016.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chaabna, K., Cheema, S., Abraham, A. et al. The state of population health research performance in the Middle East and North Africa: a meta-research study. Syst Rev 10, 1 (2021). https://doi.org/10.1186/s13643-020-01552-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-020-01552-x

Keywords

Systematic Reviews

ISSN: 2046-4053