- Open Access
The state of population health research performance in the Middle East and North Africa: a meta-research study
Systematic Reviews volume 10, Article number: 1 (2021)
Population health (PH) research capacity and performance are essential pillars of evidence-based practice to help address health inequalities. Best evidence is provided by systematic reviews (SRs). None of the published bibliometric analysis specifically assess the production of SRs on PH in the Middle East and North Africa (MENA). The aim of our study is to investigate publication patterns and time trends of SRs reporting PH in the MENA region to evaluate the state of PH research performance in the region.
The study protocol was developed a priori (protocol registration number: CRD42017076736). PubMed was searched. Two independent reviewers screened 5747 identified articles. We investigated author affiliation and collaboration, yearly citations of the SRs and journal information. Joinpoint regression was used to explore these characteristics overtime.
Our meta-research included 387 SRs published between 2008 and 2016 which reported data on PH in 20 MENA countries. Publication of SRs increased over time in journals with impact factor < 4 and in the categories of yearly number of citations < 50 (p values ≤ 0.0024). Authors belonging to the region published increasingly (p value = 0.0001) over time. Thirty percent of the SRs were from authors solely from the region, while an additional 30% were from the region collaborating with Western country authors. Of these collaborative reviews, 79% were led by authors from the region. However, collaboration in the region (with the exclusion of collaboration with Western country authors) was rare (0.8%). These authors from the region published more in open-access journals while authors from Western countries collaborating or not with authors from the region published more in hybrid or non-open-access journals (p value < 0.0001). Collaboration between authors from MENA and Western countries led to published SRs in journals with impact factor ≥ 10. Systematic reviews with global coverage were published more by authors from Western countries, while SRs with country-level coverage were published by authors from the region (p value < 0.0001).
The incremental trend of PH SR publications on MENA likely reflects the ongoing improvement in research performance in the region. Authors from the region appear to be taking a lead role in conducting and disseminating MENA PH research. Open-access journals are a major contributor in facilitating MENA research dissemination.
Systematic review registration
PROSPERO registration number CRD42017076736
Evidence-based practice is not only critical for ensuring the highest quality in patient care but also for policy-making and implementing public health interventions at both local and national levels. Best evidence is generated by well-conducted systematic reviews (SRs), since they critically appraise and synthesize data produced by primary studies addressing a specific research question . The capability of a country to generate detailed knowledge and understanding of its health challenges is essential for developing and implementing preventative strategies to address health problems through evidence-based decision-making . This is typically undertaken through published primary studies and thereafter critically synthesized in SRs. Researchers, policymakers, and clinicians should be informed with the best evidence available pertaining to their country’s population health (PH) in order to identify context-appropriate solutions.
Existing bibliometric analyses evaluate research performance at global and country-levels [3,4,5,6]. However, none of them specifically assess the production of SRs on PH in the Middle East and North Africa (MENA). The aim of our study is to investigate publication patterns and time trends of SRs reporting on PH topics in the MENA region to evaluate the state of PH research performance in the region. The objectives of our study are to (1) assess publication patterns and time trends of SRs on PH in MENA, (2) evaluate collaboration in published SRs, (3) identify common topics explored in PH research pertaining to MENA, and (4) explore the role of journals’ access policies in research dissemination from MENA.
Our meta-research study is part of the Population Health Publications Assessment Project aiming to assess the methodological quality and the use of gray literature in published SRs on population health in MENA [7,8,9,10]. An a priori protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO registration number CRD42017076736)  and published (https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-018-0751-4) . We primarily conducted a SR of SRs to identify the SRs reporting data on PH in MENA published between January 2008 and December 2016 (2008 was chosen as the point of initiation since this was the publication year of the first version of the Cochrane Handbook for Systematic Reviews of Interventions) . We first published the quality analysis of the literature search conducted in the identified cohort of SRs . Thereafter, bibliometric analysis, as a statistical evaluation of published scientific articles , was applied to this cohort of SRs.
Inclusion and exclusion criteria
We included SRs reporting data on any PH topic within 20 MENA countries, namely Algeria, Bahrain, Djibouti, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Morocco, Oman, Pakistan, Palestine, Qatar, Saudi Arabia, Sudan, Syria, Tunisia, United Arab Emirates, and Yemen. Selection details of the 20 countries have been published . Based on PRISMA-P terminology , we defined a SR as a review of primary studies reporting a search strategy for at least one electronic database along with eligibility criteria, which were applied during a multi-stage process of study selection. PH was defined as “the health outcomes of a group of individuals, including the distribution of such outcomes within the group” . Narrative review or systematic analysis synthetizing primary studies which were not identified and selected following a systematic process were excluded.
Literature search and data management
The literature search was conducted on PubMed , the first public digital archives  including MEDLINE database, which is also included in Embase  and Scopus . We utilized search criteria combining MENA countries, regions and populations’ names and limited to reviews, systematic reviews, and meta-analyses. By searching PubMed, we likely included most of the SRs on PH in MENA published in peer-reviewed journals during 2008–2016. Details of the search strategy have been published . Similar search criteria have been utilized for SRs on PH in MENA and published in peer-reviewed journals [10, 20,21,22,23].
A total of 5747 articles were identified. After two independent multi-stage screenings including title/abstract and full-text screening, 387 SRs were included in the analysis (PRISMA flowchart and characteristics of included SRs are in additional files 3 and 4). Data extraction was conducted by two reviewers and cross-checked for accuracy. From each SR the research topic, year of publication, journal’s name, MENA country/countries covered by the SR, and authors’ country of affiliation(s) were extracted.
SR authors were categorized based on the country of their institutional affiliation. Authors were categorized as: belonging to the MENA countries if one of their institutional affiliations was in one of the 20 selected countries; to be from neighboring countries if their institutional affiliations were in a country not included in the 20 selected MENA countries but from other Middle East countries or South Asia or Africa; and from non-MENA and non-neighboring (NMNN) countries if their institutional affiliations were not from the 20 selected MENA countries, other Middle East countries, South Asia, or Africa. Due to the geographic proximity of the neighboring countries, which often share socio-economic and cultural aspects with some of the 20 selected countries, we differentiated those authors affiliated to institutions located in these countries from authors from NMNN countries located, for instance, in Europe, Australia, or the North American continent. The rationale for this is that a few of the neighboring countries such as Iran [24,25,26,27], Turkey , and Somalia [25, 26] are sometimes included in the definition of the MENA region.
We discussed the health topics addressed by the included SRs according to the disease burden in MENA. Research topics studied by the included SRs were categorized following Global Burden of Disease (GBD) study classification . The three main categories were communicable, maternal, neonatal, and nutritional diseases (GBD code: A); non-communicable diseases (NCDs; GBD code: B); and injuries (GBD code: C). A fourth category “other” was used when the topic did not match any of GBD categories. The GBD disability adjusted life years (DALYs) estimates in the MENA region between 2008 and 2016 for these topics were retrieved from the Institute for Health Metrics and Evaluation website .
The journal’s impact factor (JIF) during the year of publication was obtained from the Institute of Scientific Information’s Journal Citation Report (ISI-JCR, ISI http://www.scijournal.org/list-of-impact-factor-journal_I.shtml). Since citations measured by Google Scholar might more appropriately reflect the impact of a publication in the scientific community and in the society (for instance, in dissertations, websites, non-indexed journals, non-English sources, book chapters), the number of citations were collected on Google Scholar . Number of citations per year for each SR was calculated as the total number of citations divided by the number of years since publication. A period of at least 1 year was given between the date of publication of a SR (up to December 31, 2016) and the date of the collection of the number of citations (on January 17, 2018). From the journals’ websites, we collected information on the publisher’s name, open access status, and potential affiliation to a society, association, or university.
Publication pattern and time trends analyses were conducted on the basis of author institutional affiliation as per the following categories: (1) “Inside”—authors affiliated to institutions located in MENA and/or neighboring countries, (2) “Outside”—authors affiliated to institutions located in NMNN countries, and (3) “North-South collaboration”—authors affiliated to institutions located in MENA and/or neighboring countries collaborating with authors from NMNN countries. The time trend for yearly number of publications was assessed using linear regression in unstratified and stratified data. We assessed significance of the association using the F test and the goodness-of-fit of the models using adjusted R-squared statistics. We also conducted analyses by yearly number of citations and JIF. Fisher’s exact test was utilized to assess the differences between the number of publications between SRs and journals characteristics. Authors’ affiliation in SRs was used as a proxy for research capacity . Association statistical significance threshold was at 0.01. We used R-3.3.1 software and SPSS V.25 for our analyses.
A linear statistically significant increase in the annual number of published SRs was identified (from 16 in 2008 to 81 in 2016, 406% increase, Table 1 and Additional file 1). Systematic reviews were increasingly published by (i) “Inside” authors (two to 29, + 1350% increase), (ii) “Outside” authors (eight to 26, + 225% increase), and (iii) by authors from the “North-South collaboration” category (six to 26, + 333% increase). Similarly, a linear statistically significant increase in the annual number of published SRs at country-level coverage was also identified (Adj. R2 = 0.71, p value = 0.0024), from five in 2008 to 18 in 2016 (+ 260% increase).
Between 2008 and 2016, a statistically significant linear increase in the number of published SRs was also demonstrated in the categories 0 ≤ JIF < 2 and 2 ≤ JIF < 4, which represents 90% of the journals tracked by ISI-JCR  and for the yearly number of citations n < 10 and 10 ≤ n < 50. However, in the JIF categories 4 ≤ JIF < 6 and JIF ≥ 6 (i.e., the top 10% and 5% of journals tracked by ISI-JCR, respectively ), the increase was not significant, and in the yearly citations categories 50 ≤ n < 100 and n ≥ 100, only a couple of SRs were published each year. When we excluded studies with global and multi-region coverage, there was also a linear statistically significant increase of published SRs in the JIF < 4 categories (Adj. R2 = [0.74–0.83], p values < 0.0020). Regarding the yearly number of citations, when we excluded SRs with global and multi-region coverage, the increase in the number of published SRs was statistically significant for the category n < 10 (from eight in 2008 to 26 in 2016; + 225% increase, Adj. R2 = 0.87, p value = 0.0001) and for the category 10 ≤ n < 50 (from one in 2008 to 23 in 2016; + 2200% increase, Adj. R2 = 0.64, p value = 0.0058).
Yearly number of citations
Nevertheless, we observed a significant increase of yearly number of citations along with the increase of JIF (p value < 0.0001, Table 2). In the SRs published in journals with a JIF < 2, 79% (139/176) were cited less than 10 times a year. Conversely, the 11 SRs with over 100 yearly citations were all published in journals with a JIF > 7. Therefore, SRs published in high JIF journals are cited more frequently than SRs published in journals with a low JIF.
Authors from MENA and/or neighboring countries published 30% (“Inside” category: 115/387) of the SRs and collaborated with authors from NMNN countries in an additional 30% (“North-South collaboration” category: 115/387) of the published SRs (Table 3). We identified one SR with authors affiliated solely to institutions located in different MENA countries (Fig. 1). Similarly, South-South collaboration between authors affiliated solely to institutions located in MENA and institutions located in neighboring countries were rare (0.5%; 2/387). Authors from MENA and/or neighboring countries collaborating with authors from NMNN countries were leading the research (first and/or last author position) in 79% of the North-South collaborations (53%; 61/115 SRs from MENA and 26%; 30/115 SRs from neighboring countries). In total, authors from MENA and/or neighboring countries were leading the research in 54% (203/387 SRs) of the published SRs on PH in MENA countries (Fig. 1).
Nevertheless, published SRs reporting data on MENA led by authors from MENA and/or neighboring countries is a recent phenomenon. In 2008–2010, the number of published SRs by “Inside” authors (12%, 7/59) was 2.9 and 4.6 times lower than in the two other categories (“North-South collaboration”: 37%, 22/59 and “Outside”: 51%, 30/59, respectively), while in 2014–2016, “Inside” authors published 34% (70/206) of the SRs, while “North-South collaboration” authors published 32% (66/206) and “Outside” authors 34% (71/206).
Publisher and journal profiles
The vast majority of the top 10 publishers (out of 62 publishers) with the highest average number of published SRs per journals were non-commercial  (90%) and local (70%, data not shown). A wide range of journals (N = 243) published SRs reporting data on PH in MENA. Among them, 65 journals (17%, 65/243) published SRs reporting data on PH in MENA exclusively when these SRs had a global and multi-region coverage (85 published SRs out of 387, 22%). Most of the journals (87%, 213/243) published one or two SRs covering at least one of the MENA countries. Eighteen journals (7%, 18/243) published at least four SRs reporting data on PH in MENA (publishing 27% of SRs, 106/387). A large proportion of them were open-access journals (72%, 13/18) and 39% of them were specialized in infectious disease.
Author affiliation versus journal profile
A significant difference in the type of journals where SRs were published was observed according to author affiliation (Table 3). Most of the SRs by “Inside” authors were published in open-access journals (64%, 74/115), while most of the SRs by “Outside” authors were published in hybrid or non-open-access journals (62%, 98/157). We also observed that journals with an open-access policy have significantly lower JIFs than non-open access journals (Table 2). The number of yearly citations of published SRs varies significantly according to journal access, with lower citation frequencies for open and hybrid-access journals than for non-open access journals (p value < 0.0001, Additional file 2).
Among the journals publishing at least four SRs, local journals (28%, 5/18)—which were all open access and with a JIF<2—published the highest number of SRs by “Inside” authors (67%, 22/33 SRs by “Inside” authors), and none published global or multi-regional SRs. Two journals were international with open access, focusing on publishing methodologically sound research regardless of the perceived impact the research may have on their JIF (22%, 23/106 SRs, data not shown). These journals published the second highest number of SRs by “Inside” authors (24%, 8/33 SRs). Additionally, a large proportion of the SRs (61%, 14/23 SRs) published in these journals did not have a global or multi-region coverage.
We also assessed journals with very high impact factors (JIF ≥ 10). Twenty-three SRs (6%, 23/387) were published in journals with a JIF ≥ 10 (data not shown). “Outside” authors published 70% (16/23) of these SRs and the remaining 30% were published by the “North-South collaboration” category. Among the SRs obtaining over 50 citations per year, 78% (21/27 publications) were by “Outside” authors and the remaining 22% were a North-South collaboration. Research collaboration with authors from Western countries appears to be one of the key factors for authors from MENA and/or neighboring countries to be able to publish in high impact factor journals, and thereafter for the articles to be highly cited, likely as a result of being published in such journals.
Systematic reviews’ geographical coverages
Systematic reviews with country-level or MENA subregion coverage were published significantly more in journals with a JIF < 2, the exception being SRs covering the African areas (Table 2). While SRs with global or multi-regions coverage were published significantly more in journals with a JIF ≥ 4. Consequently, the yearly number of citations was significantly highest for those SRs, while country-level and MENA sub-regional SRs—including those covering the African areas—were predominantly receiving less than 10 citations per year (additional file 2). Systematic reviews with global or multi-region coverage were published significantly more by “Outside” authors (Table 3). While country-level and MENA sub-regional SRs were mainly published by “Inside” authors, the exception being the SRs covering the African area, which were more published by authors in the “North-South collaboration” category.
Systematic reviews’ health topics
Between 2008 and 2016, the most common topic addressed in the SRs reporting data on the MENA region was NCDs (48%, 185/387, Fig. 2). Among the NCDs, cancer, mental health, metabolic syndrome including diabetes, and cardiovascular disease were commonly researched topics. In 2008, the most common topic addressed in the SRs was infectious disease, including foodborne, blood-borne, and sexually transmitted infections and anti-microbial resistance (44%, 7/16). Between 2008 and 2016, the 18 journals that published at least four SRs reporting data on PH in MENA countries published 41% (54/133) of the SRs on infectious disease. Among these journals, seven specialized in infectious disease topics (39%). Over the years, the proportion of SRs addressing infectious disease topics decreased to 36% (29/81, 2016). Between 2008 and 2016, 86% (133/155) of the SRs addressing the health topic communicable, maternal, neonatal, and nutritional diseases were on infectious disease. No SR was published on maternal disorders. In 2016, three SRs on metabolic syndrome, six on diabetes, three on cardiovascular disease, two on substance use abuses, two on neonatal disorders, and four on nutritional deficiency were published, while in 2008, no SRs on these topics were published. While the ratio between the burden of NCDs and communicable, maternal, neonatal, and nutritional diseases—measured with DALYs—was increasing over time (2.1 in 2008 to 3.2 in 2016), the proportion of published SRs addressing these topics did not change significantly over time and was not proportional to the disease burden (Fig. 3).
The increase in SRs published annually is likely due to an increase in the publication of primary studies conducted in MENA countries. Systematic reviews by authors from the MENA region also increased—both those collaborating with authors from Western countries as well as those not. Our findings suggest ongoing research capacity building and performance improvement in the region. Development of PH research in the region will enhance PH  via evidence-based policy-making and interventions .
International research collaborations, which have been facilitated by globalization , play a major role in the production of population health data and the development of evidence-based solutions pertaining to global health problems . Collaboration between authors from MENA and/or neighboring countries with authors from Western countries has increased for SRs. North-South research collaboration dynamics have been usually reported as being between unequal partners institutions with power remaining with the North [33,34,35,36], which raises ethical concerns in the “social world” of global health [37, 38]. Our findings suggest that while published SRs on PH in MENA were previously also dominated by authors affiliated in Western countries, researchers from MENA appear to be taking now the lead by increasingly publishing SRs on topics of importance for the region and collaborating with authors from Western countries. For published SRs, North-South collaboration dynamics appear to be changing in the region with partners from the South identifying their PH research gaps and research capacity needs and addressing them by seeking specific expertise from the North. South-led published SRs are probably not affected by the barriers faced by South-led basic science research, i.e., lack of resources and research skills . Conducting SRs requires minimal equipment as compared to basic science research conducted in wet laboratories, where more sophisticated and expensive equipment maybe required. Additionally, handbooks and guidelines to support researchers in rigorously conducting and reporting SRs are freely available online since the last two decades [12, 40, 41].
While we observed South-South research partnerships, collaboration between authors from MENA and neighboring countries was rare if the collaboration did not include authors from Western countries. Researchers from MENA appear to seek for peers’ expertise mainly from researchers located in Western countries. However, we believe that MENA and neighboring countries experience similar health challenges and could benefit from future cooperation . In the context of globalization, some universities and colleges from North America and Europe established campuses within the region and this has contributed to build in the region research capacity at high levels . Barriers to South-led research previously identified such as donor influence for the choice of research topics and lack of resources and research skills  could be addressed by South-South collaborations established with such imported branches of Western institutions, Regional, and country-level collaboration between researchers from MENA and/or neighboring countries can promote PH development by strengthening research capacity and performance via common objectives and shared local expertise.
In addition to making international research collaborations simpler , globalization has also facilitated communication of scholarly peer reviewed research by allowing accessibility and usefulness of research through open-access . Authors from the region mainly published SRs that focused on MENA countries or subregions in journals with a JIF < 2 and predominantly in local and international open-access journals. This may be because open-access journals consider methodologically sound research regardless of the perceived impact the research topic may have on their JIF. Journals which are free from JIF dictate play a major role in the global dissemination  of the SRs conducted by authors affiliated to institutions located in MENA reporting epidemiological primary studies conducted in MENA. The peer-review process of these journals appear to show less bias against authors affiliated to institutions located in MENA [45,46,47] and/or non-native English speakers . These journals are therefore contributing to the field of global health by supporting ethic of equity [37, 38] and encouraging research performance improvement and enabling research culture in the region by giving a voice to authors from MENA countries and highlighting health issues pertinent to the region . This enhances PH knowledge pertaining to MENA, which may ultimately lead to better-informed policies contributing to national healthcare policy development and implementation of informed evidence-based healthcare practice .
However, while open-access journals enable free reader access to published articles , most require a fee for publishing. This may be a barrier for researchers from MENA without appropriate funding and contribute to unbalanced North-South partnership . Notably, some international publishers are addressing this issue by waiving fees for authors who are unable to afford the charge . Publishers located in MENA countries should consider waiving fees for eligible authors to attract additional manuscript submission and to promote wider research dissemination.
Historically, reviews on diseases not prevalent in the “Western world” were unlikely to be of interest to researchers from these countries. This may in turn have resulted in minimal citations of reviews on diseases not prevalent in these countries. Such reviews may then lead to a negative impact on the JIF of a journal if published . However, our review now identifies an increase in published SRs reporting data on MENA PH with yearly number of citations between 10 and 50. This suggests that there were probably both an increase in the interest of journal readers toward PH in MENA as well as in researchers reuse of data on MENA countries reported by these SRs. The progress and increase in global health research projects by researchers from Western countries studying health issues of low- and middle-income countries may have diminished the bias of international journals against the “diseases of poverty,” which are rare or nonexistent in high-income countries [52, 53].
Non-communicable disease is a major PH issue in MENA. The DALYs for NCDs between 2008 and 2016 was at least twice as high as communicable, maternal, neonatal, and nutritional diseases, combined . In 2017, the death rate from non-communicable diseases was five-times higher than death rate from infectious disease . Five of the 10 countries with the highest diabetes prevalence worldwide are in MENA . Additionally, obesity prevalence in MENA countries often exceeds the estimated global average (13%)  and in some countries exceeds the prevalence in the USA (e.g., 41% in Qatar in 2012  versus 36% in the USA between 2011 and 2014 ). Nevertheless, the proportions of SRs addressing NCDs and communicable, maternal, neonatal, and nutritional diseases topics were similar. This may reflect the development of global health research studying infectious diseases  and funding influence on the selection of research topics . A substantial proportion of the SRs appearing in the 18 journals that published at least four SRs reporting data on MENA investigated infectious diseases. The dissemination of this data appears to be facilitated by the interest of journals in specific topics. The topics addressed in the SRs reporting population health in MENA do not appear matching the disease burden in the region. Systematic reviews reporting on NCDs and their risk factors would enable the characterization, synthesis, and further understanding the epidemiology of such diseases in the MENA region, and facilitate evidence-based practice in policy-making and public health interventions.
In 2006, a study identified five factors explaining why research from developing countries was underrepresented in international health literature . Four of these were related to poor research capacity in these countries, while the fifth highlighted the bias of international medical journals. In 2001, under-representation of content on PH in low-income countries in general medical journals with a JIF ≥ 10 was revealed . Eighteen years later, our overview demonstrates that publication bias on SRs from MENA authors continues to exist in high impact factor (JIF > 10), non-open (or hybrid) access journals pertaining to topics reporting on MENA countries. One explanation for the low acceptance rate of SRs from the region may be the influence the research may have on the JIF . Our recommendation to journals that publish manuscripts according to the perceived significance of the research work is to ensure double-blind peer review to avoid any discrimination that could arise because of the names and/or the affiliations of the publication authors .
We believe this is the first SR of SRs that investigates research capacity and performance in MENA pertaining to SR publication and explores the role of journals in disseminating SRs on and from MENA. The strength of our report is the large and representative sample of published SRs reporting on all PH topics in MENA. Overall, this study provides objective findings about research performance to researchers, clinicians, and policymakers. Comprehending research performance, its enablers and barriers in MENA may help rationalize staffing decisions and direct appropriate funding from national and international entities  which support knowledge acquisition and research capacity building . Our findings will help in decision-making and strategy development regarding the publication of research on PH in MENA, and from MENA researchers. Nevertheless, including articles indexed on PubMed between 2008 and 2016 is technically different from those published between 2008 and 2016 . Therefore, we might have missed some SRs, which were published in 2016 but their indexation was delayed. Additionally, we might have also missed some SRs published in journals not indexed on PubMed. However, the exclusion of those articles would unlikely affect our overall findings and conclusions.
An increasing number of SRs reporting epidemiological data from MENA countries are being published, reflecting the ongoing research capacity building and performance improvement in the region. Authors affiliated to institutions located in the region appear to be taking the lead in conducting research and disseminating information related to topics of relevance to PH in MENA. Local and international open-access journals, which give due consideration to methodologically sound research regardless of its impact on the journal impact factor are playing an important role in providing a platform to researchers from the region. Future meta-research assessing the productivity of primary studies in MENA countries is required to better understand PH research capacity and performance in the region.
Availability of data and materials
All data generated or analyzed during this study are included in this published article and its supplementary information files.
Assessment of Multiple Systematic Reviews
Institute of Scientific Information–Journal Citation Report
Journal impact factor
Middle East and North Africa region
Non-MENA and non-neighboring countries
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols
Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016;21(4):125–7.
Nchinda TC. Research capacity strengthening in the South. Soc Sci Med (1982). 2002;54(11):1699–711.
Badenhorst A, Mansoori P, Chan KY. Assessing global, regional, national and sub-national capacity for public health research: a bibliometric analysis of the Web of Science(TM) in 1996-2010. J Glob Health. 2016;6(1):010504.
McGregor S, Henderson KJ, Kaldor JM. Capacity building in longitudinal HIV research. Lancet Glob Health. 2015;3(1):e18–9.
Nafade V, Nash M, Huddart S, Pande T, Gebreselassie N, Lienhardt C, et al. A bibliometric analysis of tuberculosis research, 2007-2016. PLoS One. 2018;13(6):e0199706.
Rezaee-Zavareh MS, Salamati P, Alavian SM. Iran's research needs to be more noticed - Authors' reply. Lancet. 2017;389(10068):504.
Chaabna K, Cheema S, Abraham A, Alrouh H, Mamtani R, Sheikh JI. Gray literature in systematic reviews on population health in the Middle East and North Africa: protocol of an overview of systematic reviews and evidence mapping. Syst Rev. 2018;7(1):94.
Chaabna K, Cheema S, Abraham A, Mamtani R. Strengthening literature search strategies for systematic reviews reporting population health in the Middle East and North Africa: a meta-research study. J Evid Based Med. 2020;13(3):192–8. https://doi.org/10.1111/jebm.12394.
Chaabane S, Chaabna K, Abraham A, Mamtani R, Cheema S. Physical activity and sedentary behaviour in the Middle East and North Africa: An overview of systematic reviews and meta-analysis. Sci Rep. 2020;10(1):9363.
Chaabna K, Cheema S, Abraham A, Alrouh H, Lowenfels AB, Maisonneuve P, et al. Systematic overview of hepatitis C infection in the Middle East and North Africa. World J Gastroenterol. 2018;24(27):3038–54.
Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, et al. PROSPERO at one year: an evaluation of its utility. Syst Rev. 2013;2:4.
Higgins J, Green S. Cochrane handbook for systematic reviews of interventions Version 5.1.0 The Cochrane Collaboration; 2011.
Iftikhar PM, Ali F, Faisaluddin M, Khayyat A, De Gouvia De Sa M, Rao T. A bibliometric analysis of the top 30 most-cited articles in gestational diabetes mellitus literature (1946-2019). Cureus. 2019;11(2):e4131.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Kindig D, Stoddart G. What is population health? Am J Public Health. 2003;93(3):380–3.
Masic I, Milinovic K. On-line biomedical databases-the best source for quick search of the scientific information in the biomedicine. Acta Inform Med. 2012;20(2):72–84.
Elsevier. Embase: Elsevier; 2018 [Available from: https://www.elsevier.com/solutions/embase-biomedical-research.
Elsevier. Scopus: Content Coverage Guide: Elsevier; 2017 [Available from: https://www.elsevier.com/__data/assets/pdf_file/0007/69451/0597-Scopus-Content-Coverage-Guide-US-LETTER-v4-HI-singles-no-ticks.pdf.
Chaabna K, Kouyoumjian SP, Abu-Raddad LJ. Hepatitis C virus epidemiology in Djibouti, Somalia, Sudan, and Yemen: systematic review and meta-analysis. PLoS One. 2016;11(2):e0149966.
Chaabna K, Mohamoud YA, Chemaitelly H, Mumtaz GR, Abu-Raddad LJ. Protocol for a systematic review and meta-analysis of hepatitis C virus (HCV) prevalence and incidence in the Horn of Africa sub-region of the Middle East and North Africa. Syst Rev. 2014;3:146.
Chemaitelly H, Chaabna K, Abu-Raddad LJ. The Epidemiology of Hepatitis C Virus in the Fertile Crescent: Systematic Review and Meta-Analysis. PLoS One. 2015;10(8):e0135281.
Chaabna K, Alali W. Enteric Salmonella in humans and food in the Middle East and North Africa: protocol of a systematic review. BMJ Open. 2017;7(7):e017399.
The World Bank. Data: Wold Bank Country and Lending Groups: The World Bank; 2017 [Available from: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
World Health Organisation. Country groupings: subregional country groupings for the global assessment of disease burden: WHO; N.D. [Available from: http://www.who.int/quantifying_ehimpacts/global/ebdcountgroup/en/.
The Joint United Nations Programme on HIV/AIDS. UNAIDS Middle East & North Africa: UNAIDS; 2017 [Available from: http://www.unaidsmena.org/.
Institute for Health Metrics and Evaluation GBD Compare | Viz Hub: University of Washington; 2017 [Available from: http://vizhub.healthdata.org/gbd-compare/.
Kulkarni AV, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA. 2009;302(10):1092–6.
Research Medecal Library. What is considered a good impact factor? Texas, US: The University of Texas, MD Anderson Cancer Center; 2017 [Available from: http://mdanderson.libanswers.com/faq/26159.
Nonprofit Publisher: Science Direct; 2019 [Available from: https://www.sciencedirect.com/topics/computer-science/nonprofit-publisher.
Hanney SR, Gonzalez-Block MA. Health research improves healthcare: now we have the evidence and the chance to help the WHO spread such benefits globally. Health Res Policy Syst. 2015;13:12.
Globalization of Science: Labfolder; 2019 [Available from: https://www.labfolder.com/blog/globalization-of-science/.
Muldoon KA, Birungi J, Berry NS, Ngolobe MH, Mwesigwa R, Shannon K, et al. Supporting southern-led research: implications for North-South research partnerships. Can J Public Health. 2012;103(2):128–31.
de Graft Aikins A, Arhinful DK, Pitchforth E, Ogedegbe G, Allotey P, Agyemang C. Establishing and sustaining research partnerships in Africa: a case study of the UK-Africa Academic Partnership on Chronic Disease. Glob Health. 2012;8:29.
Reddy P, Desai R, Sifunda S, Chalkidou K, Hongoro C, Macharia W, et al. "You Travel Faster Alone, but Further Together": Learning from a cross country research collaboration from a British Council Newton Fund Grant. Int J Health Policy Manag. 2018;7(11):977–81.
Walsh A, Brugha R, Byrne E. "The way the country has been carved up by researchers": ethics and power in north-south public health research. Int J Equity Health. 2016;15(1):204.
Crane JY. Unequal ‘Partners’. AIDS, Academia, and the Rise of Global Health. Behemoth. 2010;3(3):78–97.
Gautier L, Sieleunou I, Kalolo A. Deconstructing the notion of "global health research partnerships" across Northern and African contexts. BMC Med Ethics. 2018;19(Suppl 1):49.
Van der Veken K, Belaid L, Delvaux T, De Brouwere V. Research capacity building through North-South-South networking: towards true partnership? An exploratory study of a network for scientific support in the field of sexual and reproductive health. Health Res Policy Syst. 2017;15(1):39.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.
Institute of Medicine. Finding what works in health care: standards for systematic reviews. Washington, DC: The National Academies Press; 2011.
World Health Organization. WHO's work with countries. Cooperation among countries. 2018 [Available from: http://www.who.int/country-cooperation/what-who-does/inter-country/en/.
Sheikh JI, Cheema S, Chaabna K, Lowenfels AB, Mamtani R. Capacity building in health care professions within the Gulf cooperation council countries: paving the way forward. BMC Med Educ. 2019;19(1):83.
Barbour V, Chinnock P, Cohen B, Yamey G. The impact of open access upon public health. Bull World Health Organ. 2006;84(5):339.
Harris M, Macinko J, Jimenez G, Mullachery P. Measuring the bias against low-income country research: an Implicit Association Test. Glob Health. 2017;13(1):80.
Yousefi-Nooraie R, Shakiba B, Mortaz-Hejri S. Country development and manuscript selection bias: a review of published studies. BMC Med Res Methodol. 2006;6:37.
Tomkins A, Zhang M, Heavlin WD. Reviewer bias in single- versus double-blind peer review. Proc Natl Acad Sci U S A. 2017;114(48):12708–13.
Ross JS, Gross CP, Desai MM, Hong Y, Grant AO, Daniels SR, et al. Effect of blinded peer review on abstract acceptance. Jama. 2006;295(14):1675–80.
The PLoS Medicine Editors. The impact factor game. PLoS Med. 2006;3(6):e291.
Ofori-Adjei D, Antes G, Tharyan P, Slade E, Tamber PS. Have online international medical journals made local journals obsolete? PLoS Med. 2006;3(8):e359.
Sabri A, Ahad QM. Open Access Journals, need of developing countries. Reader Comments. PLoS Med. 2006. https://journals.plos.org/plosmedicine/article/comment?id=10.1371/annotation/e16e0819-c4a7-4d9a-b4a5-f6418228b263.
Horton R. Medical journals: evidence of bias against the diseases of poverty. Lancet. 2003;361(9359):712–3.
Langer A, Diaz-Olavarrieta C, Berdichevsky K, Villar J. Why is research from developing countries underrepresented in international health literature, and what can be done about it? Bull World Health Organ. 2004;82(10):802–3.
exchange GHD. Deaths and DALYs for 2016 2018 [Available from: http://ghdx.healthdata.org/gbd-results-tool.
exchange GHD. GBD Results Tool. Deaths for 2017 2019 [Available from: http://ghdx.healthdata.org/gbd-results-tool.
The World Bank. Diabetes prevalence (% of population ages 20 to 79) 2016 [Available from: http://data.worldbank.org/indicator/SH.STA.DIAB.ZS.
World Health Organisation. Obesity and overweight fact sheet Geneva, Switzerland2016 [Available from: http://www.who.int/mediacentre/factsheets/fs311/en/.
Supreme Council of Health. WHO Qatar STEPWISE Report 2012 chronic disease risk factor surveillance Doha, Qatar; 2013.
Ogden CL, Carroll MD, Fryar CD, Flegal KM. Prevalence of obesity among adults and youth: United States, 2011-2014. NCHS Data Brief. 2015(219):1–8.
Marcovitch H. Editors, publishers, impact factors, and reprint income. PLoS Med. 2010;7(10):e1000355.
Thomson Reuters. White Paper Using Bibliometrics: a guide to evaluating research performance with citation data: Thomson Reuters; 2008 [Available from: http://ip-science.thomsonreuters.com/m/pdfs/325133_thomson.pdf.
Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, et al. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13(5):e1002028.
We would like to acknowledge Hekmat Alrouh for his contribution to the literature search and screening and Aida Tariq Nasir for reviewing the tables. Both individuals are previous employees of the Institute for Population Health at Weill Cornell Medicine—Qatar.
This work was not supported by any funding agency.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Time trend of annual numbers of systematic reviews on population health in MENA between 2008 and 2016. a: overall trend (unstratified data); b: trends according to author affiliation; c: trends according to journal impact factor (IF); d: trends according to number of yearly citations.
Number of yearly citations analysis.
PRISMA flowchart of searches, screening, and inclusion and exclusion of systematic reviews.
Characteristics of the included systematic reviews on population health in the Middle East and North Africa, 2008-2016.
About this article
Cite this article
Chaabna, K., Cheema, S., Abraham, A. et al. The state of population health research performance in the Middle East and North Africa: a meta-research study. Syst Rev 10, 1 (2021). https://doi.org/10.1186/s13643-020-01552-x
- Research capacity
- Middle East and North Africa
- Gulf Cooperation Council
- Population health
- North Africa
- Middle East
- Systematic review