Racism as a determinant of health: a protocol for conducting a systematic review and meta-analysis
Systematic Reviews volume 2, Article number: 85 (2013)
Racism is increasingly recognized as a key determinant of health. A growing body of epidemiological evidence shows strong associations between self-reported racism and poor health outcomes across diverse minority groups in developed countries. While the relationship between racism and health has received increasing attention over the last two decades, a comprehensive meta-analysis focused on the health effects of racism has yet to be conducted. The aim of this review protocol is to provide a structure from which to conduct a systematic review and meta-analysis of studies that assess the relationship between racism and health.
This research will consist of a systematic review and meta-analysis. Studies will be considered for review if they are empirical studies reporting quantitative data on the association between racism and health for adults and/or children of all ages from any racial/ethnic/cultural groups. Outcome measures will include general health and well-being, physical health, mental health, healthcare use and health behaviors. Scientific databases (for example, Medline) will be searched using a comprehensive search strategy and reference lists will be manually searched for relevant studies. In addition, use of online search engines (for example, Google Scholar), key websites, and personal contact with experts will also be undertaken. Screening of search results and extraction of data from included studies will be independently conducted by at least two authors, including assessment of inter-rater reliability. Studies included in the review will be appraised for quality using tools tailored to each study design. Summary statistics of study characteristics and findings will be compiled and findings synthesized in a narrative summary as well as a meta-analysis.
This review aims to examine associations between reported racism and health outcomes. This comprehensive and systematic review and meta-analysis of empirical research will provide a rigorous and reliable evidence base for future research, policy and practice, including information on the extent of available evidence for a range of racial/ethnic minority groups
Racism is increasingly recognized as a key determinant of health [1–3]. Racism constitutes phenomena that result in avoidable and unfair inequalities in power, resources and opportunities across racial or ethnic groups. It can be expressed as beliefs, stereotypes, prejudices or discrimination and can range from open threats and insults to phenomena deeply embedded in social systems and structures . Racism can occur at multiple levels, including: internalized (that is, the incorporation of racist attitudes, beliefs or ideologies into one’s worldview), interpersonal (interactions between individuals) and systemic (for example, the racist production, control and access to labor, material and symbolic resources within a society) [4, 5].
The contribution of racism as a social determinant of health is receiving growing attention . Racism is thought to affect health through a number of pathways: (1) limited access to social resources such as employment, housing and education and/or increased exposure to risk factors (such as unnecessary contact with the criminal justice system); (2) negative affective/cognitive and other pathopsychological processes; (3) allostatic load and other pathophysiological processes; (4) reduced engagement with healthy behaviors (for example, exercise) and/or increased adoption of unhealthy behaviors (for example, substance misuse) either directly as stress coping or indirectly via reduced self-regulation; (5) direct physical injury caused by race-based violence [2, 7–11].
While a number of conceptual diagrams depicting these pathways exist in the current literature [5, 8, 9, 12], in Figure 1 we present a model highlighting the multiple pathways through which racism can affect health. Rather than a comprehensive account of the pathways whereby racism may be related to health, this model will guide our meta-analysis, based on empirical evidence within the current literature.
A number of existing literature reviews have focused on racism and health, including four meta-analyses [9, 14–16], which have focused on specific population groups, national contexts or broader exposures (that is, discrimination more generally). Previous reviews and meta-analyses have found associations between racism (frequently operationalized as self-reported experiences of racial discrimination) and a range of adverse health outcomes [2, 10, 11]. Early reviews focused on adverse mental and physical health outcomes in the USA (for example, Williams et al. ; Brondolo et al. ; Williams et al. ; Wyatt et al. ), finding evidence of consistent associations between racism and mental health outcomes while associations between racism and physical health outcomes were mixed. These reviews were mostly small scale, focused on African-Americans and predominantly on negative physical and mental health. A comprehensive meta-analysis focused on racism and health outcomes has not yet been published.
A systematic review by Paradies  identified 138 international empirical population-based studies of self-reported racism and a wide range of health outcomes, finding that the strongest and most consistent associations existed between racism and negative mental health and health-related behaviors. Williams and Mohammed  published a comprehensive review of studies conducted between 2005 and 2007 across various settings and population groups. Reviewing 115 studies on perceived racial discrimination and health, they found a consistent relationship between discrimination and a wide range of health outcomes, particularly poor mental health status. Another comprehensive review by Pascoe and Smart Richman, combined with a meta-analysis  examined 192 studies on the association between perceived discrimination (not restricted to racial discrimination but with 66% of identified studies focusing on this topic) and mental and physical health. In all, 134 of these studies were included in the meta-analysis, which showed that discrimination had a significant negative effect on both mental and a somewhat weaker but still significant negative association with physical health.
Several reviews and meta-analyses were conducted recently on racism and racial discrimination experienced by specific population groups, such as Asian-Americans, African-Americans as well as children and young people from various racial/ethnic groups. Gee et al.’s  review of 62 empirical studies on racial discrimination and health outcomes among Asian-Americans found a consistent relationship between racial discrimination and mental health problems but less consistent relationships between racial discrimination and physical and behavioral problems. Lee and Ahn conducted 2 meta-analyses, the first involving 23 studies of Asian-Americans  and another involving 51 studies of Latinos in the USA . Both meta-analyses found a strong correlation between racial discrimination and poor mental health. Pieterse et al.’s  meta-analysis examined associations between perceived racism and mental health in 66 studies of Black Americans, and found a positive association between racism and distress. Priest et al.’s  systematic review focused on children and young people. Examining 121 studies, they found that negative mental health was the most consistently associated with racial discrimination while other outcomes such as positive mental health, behavior problems and well-being showed mostly significant associations as well.
Previous reviews and meta-analyses of the association between racism and health have had several limitations to their scope. In most reviews and all meta-analyses directly on this topic, participants were from particular population groups and/or national contexts, and the study outcomes examined were restricted to specific health outcome categories, such as mental health (see Table 1 for a summary of previous meta analysis main inclusion criteria). (The only meta-analysis to have used a more general framework, Pascoe and Smart Richman , examined discrimination more broadly and did not report racism/racial discrimination separately from other types of discrimination). No previous meta-analyses have examined the magnitude of the associations between racism and health outcomes across all existing studies nor compared the differential effects of racism across a broad range of health outcomes. Neither the magnitude of associations between racism and health across participant subgroups (for example, based on age, gender, race/ethnicity) nor dose-response associations between racism and health outcomes have yet been meta-analyzed for the greater sample of studies specifically on this topic.
Moreover, no previous reviews and/or meta-analyses have examined studies using longitudinal designs separately from and in comparison to non-longitudinal designs. Cross-sectional studies have obvious limitations regarding the temporal ordering of variables and causal inference. This limitation is particularly relevant for our topic: not only may racism cause illness but illness may cause one to perceive and report racism . Accordingly, it is critical to fill the gap in the literature by evaluating the longitudinal associations between racism and health/illness, so as to better understand the causal direction.
Additionally, a focus on longitudinal studies will also explore questions of etiology. Several longitudinal studies have suggested that the association between racism and mental illness appears after a short latency period, whereas the association between racism and physical illness only appears after a longer latency period [21, 22]. What this implies is that some of the studies finding null associations between racism and physical health may arise because the studies did not include a long enough etiological period; this further suggests that cross-sectional studies may be biased towards type 2 error in relation to physical outcomes.
The current review and meta-analysis will constitute the most comprehensive research on this topic to date. An extensive systematic search strategy employing broad inclusion criteria (described below) will be used to identify relevant studies and reduce the potential for reporting biases.
This systematic review and meta-analysis will examine the key characteristics of studies focusing on reported racism and health, including: (1) where and when studies have been conducted, the racial/cultural/ethnic background, age and gender of study populations, study designs, sample sizes, and data sources used; (2) if racism is defined, how exposure to racism is measured in terms of method of administration, timeframes of exposure as well as targets and perpetrators of racism; (3) the magnitude of associations between reported racism and health in overall and across various outcomes, including a comparison between the differential effect of racism on outcomes from the following categories: physical health, pregnancy and birth outcomes, health behaviors/risk behaviors, negative and positive mental health, general health and well-being, and healthcare use; (4) the magnitude of associations between reported racism and health in longitudinal designs separately from and in comparison to non-longitudinal designs, including change in magnitude of association over time; and (5) the magnitude of associations between reported racism and health and participant subgroups (for example, racial/ethnic groups, national contexts, gender, age groups), and the extent to which associations are consistent across groups, including a subgroup comparison between minority and majority groups.
Based on previous reviews and meta-analyses, the general hypotheses that guide our meta-analysis include: (1) the overall effect of racism on health across health outcomes will be significant, and racism will be significantly associated with increased risk of physical illness and mental illness, poor health behaviors and increased risk behaviors, poor pregnancy and birth outcomes, poor general health and well-being, and low healthcare use; (2) the association with racism will generally be stronger among studies employing mental health compared to physical health and other outcomes; (3) with regards to physical health outcomes, racism will show a more robust association (that is, larger effect size, smaller standard errors) among longitudinal studies with longer follow-up periods compared to longitudinal studies with shorter follow-up periods or with cross-sectional studies; and (4) the effect of racism on health outcomes will be consistently statistically significant across racial/ethnic minority and majority groups, national contexts, gender groups and age groups.
While previous reviews and meta-analyses provide some evidence supporting these hypotheses among specific groups and in particular contexts, this proposed review and meta-analysis will allow a more comprehensive and quantitative assessment of the evidence for these associations across the whole body of existing studies focused on racism and health.
Methods and design
The research will consist of a systematic review and a meta-analysis. The systematic review will follow the reporting guidelines and criteria set in Preferred Reporting Items for Systematic Reviews (PRISMA) .
Criteria for considering studies
Types of studies
We will include published and unpublished empirical studies that examine the relationship between racism and health outcomes. Only studies using quantitative methods and reporting quantitative data will be included. These may include: cross-sectional, cohort (prospective and retrospective), case control, experimental, and intervention designs (randomized controlled trials, cluster randomized controlled trials, and non-randomized controlled studies, before and after studies, interrupted time series studies). We will exclude from the meta-analysis any studies that do not report empirical associations between racism and health. Further, studies with inappropriate and/or insufficient data to allow meta-analysis will be documented, but excluded from the analysis.
Types of populations
All age groups and participants from any racial, ethnic, cultural or religious group will be included.
While acknowledging that measurement of racism is a complex and developing field, this review will focus on reported racism as the exposure. This will include racism self-reported by individuals, proxy reports (for example, a child’s experiences of racism as reported by the child’s carer) and experiences of vicarious racism (for example, witnessing racism experienced by family or friends). Measures of exposure to racism use different retrospective timeframes (for example, 1 month prior to measurement, 12 months prior to measurement). All exposure timeframes will be included. Studies that report only results from broader measures of discrimination, wherein the specific effect of racism cannot be isolated, will be documented but excluded from the meta-analysis.
Guided by key outcomes identified in previous systematic reviews in the field, the following health outcomes will be included: (1) physical health (infectious disease and chronic conditions and markers for example, body mass index (BMI), waist to hip ratio (WHR), blood pressure, metabolic and cardiovascular disease); (2) pregnancy and birth outcomes (for example, premature birth, low birth weight); (3) health behaviors/risk behaviors (for example, alcohol, tobacco, substance use); (4) negative mental health (for example, depression, psychological distress, stress, anxiety, social and emotional difficulties); (5) positive mental health (for example, self-esteem, self-worth, resilience); (6) general health (for example, feeling unhappy, feeling unhealthy); (7) well-being, life satisfaction, quality of life; and (8) healthcare use, satisfaction with healthcare system (for example, use of screening tests, access to healthcare and treatment, adherence to treatment).
Identification of eligible studies and data extraction
The search will be conducted in English and include studies from the earliest time available to the present. Studies in languages other than English will be excluded from the review. For a list of terms that will be used, please see Additional file 1. The following databases and electronic collections will be searched: Medline, PsycInfo, Sociological Abstracts, Social Work Abstracts, ERIC, CINAHL, Academic Search Premier, Web of Science, ProQuest (for dissertation/theses). Reference lists will be manually searched for relevant studies. In addition, Google, key websites, book chapters and personal contact with experts will also be included in the search .
Selection of studies
Search results will be imported into Endnote X5 , duplicates deleted, and two reviewers will independently screen all titles and abstracts in order to assess for eligibility for inclusion. Full texts of potentially eligible studies will be obtained when required to assist screening for final inclusion. Any discrepancies between reviewers during the screening process with regard to the inclusion/exclusion of studies will be resolved by consensus and/or by discussion with a third reviewer. Rationale for study exclusion will be recorded as part of the screening process .
Data from included studies will be extracted into an Excel spreadsheet independently by two reviewers, with data then compared and inconsistencies resolved by consensus and/or by a third reviewer. Some studies appear in multiple publications. Data from these studies will all be recorded, but we will use the data from the same study only once during our analysis stage (that is, studies will not be ‘double counted’). Data to be extracted will include : authors; year of publication; type of publication; study years; study design (including sampling procedure); definition of racism; exposure measure(s), including tool/instrument names and author(s), number of items, psychometric properties (focusing on internal consistency measures), method of administration, type of report (self, proxy, vicarious), exposure timeframe, targets and perpetrators of racism; outcome measure(s), including outcome category and subcategory, tools/instruments name, units of measurement, number of items, psychometric properties (focusing on internal consistency measures), outcome timeframe (when reported retrospectively); timepoints (for measurement of outcomes when reported more than once); subgroups (when outcomes are reported separately for subgroups); sample characteristics, including sample size (including subgroup sample size when applicable), study location (country/nation) and participant demographics such as age, racial/ethnic/cultural background, gender, religion, education, income, socioeconomic status and migration status.
Study findings will include: unadjusted strength and direction of associations between self-reported racism and health outcomes, including associations as reported separately for different participant subgroups (that is, subgroup analyses), control and treatment groups, severity of the exposure to racism (that is, analyses of dose-response), and different timepoints; extracted measures will include sample size, test results and the type of data used, for example, correlation coefficient, standardized beta regression coefficients, odds ratios and standardized mean differences.
The strength and direction of associations in studies that adjust for covariates that may influence these associations will also be reported. For each study, the results for the most extensive adjusted model will be reported. Extracted measures will include sample size, test results and the type of data used.
Study quality and critical appraisal
Studies included in the review will be appraised for quality using Critical Appraisal Skills Programme (CASP) tools tailored to each study design .
Data that meet all inclusion criteria will first be summarized descriptively and then analyzed statistically. Data will be analyzed using the statistical software Comprehensive Meta Analysis (CMA) Version 2 . Based on the available measures of association, ways of collapsing and the metric to be used will be determined. For example, if correlation coefficients are used, other statistical measures (for example, regression coefficients with standard deviations, odds ratios, dichotomous measures such as the χ2 test) will be converted to correlation coefficients, with unadjusted odds ratios converted to correlation coefficients using the formula suggested in Digby  (see also Pascoe and Smart Richman ) and standardized mean differences converted using the CMA software . Correlation coefficients, odds ratios, and Cohen’s D will be most relevant to employ as measures of effect. P values and 95% confidence intervals (CIs) will also be reported. Analyses of the association between racism and health will be conducted for different health outcome measures, and should sufficient longitudinal data be reported, for different timepoints and different racial/ethnic/cultural subgroups. Heterogeneity of effect sizes will then be assessed among studies that focus on similar outcomes using the Q and I2 statistics. Using the CMA, weighted effect sizes will be calculated to account for variation in sample sizes, thus giving more weight to effects from larger samples. We anticipate that a random-effects model will be used in aggregating effect sizes. This model is more appropriate than a fixed-effects model given our aim to generalize our findings to the population of studies on racism and health outcomes (Hedges and Vevea ; see also Pieterse et al.  for using a similar approach). Mixed effect models will be used for the moderator analyses, allowing for the testing of differences between levels of study characteristics (for example, study design, study quality). Sensitivity analyses and additional subgroup analyses will be conducted, for example with regard to age and gender.
Three methods will be used to assess publication bias among the sample of studies. First, we will produce funnel plots and examine their symmetry. Second, we will use Egger’s weighted regression method. Third, we will calculate a failsafe N, to estimate the number of unlocated studies with an average zero effect size required to change the results substantively (for a similar use of these methods, see Pieterse et al. ). Another possible measure of bias involves a comparison of mean effect sizes between published and unpublished sources (see ). Should a publication bias be detected, we intend to use Duval and Tweedie’s [31, 32] trim and fill method to estimate and adjust for missing (not reported) studies.
We anticipate that racism will negatively influence health with magnitude of effect varying by study characteristics, subgroups as well as health outcomes.
Strengths and limitations of the review
Strengths of this review include clear definitions and inclusion criteria, and a transparent systematic approach to searching, screening and reviewing studies as well as extracting data using standardized forms and duplication at all stages. Our search area is large enough and our inclusion criteria broad enough to encompass a wide range of exposure measures of racism and racial discrimination as well as health outcomes, and is likely to identify and synthesize current evidence in the field in order to inform future research as well as policy and practice. As much as possible, by using data reported in existing studies, this review will provide comprehensive statistical analyses not previously available. Although every effort will be made to locate unpublished studies, our findings may still be vulnerable to selective reporting. Another limitation of the review is the inclusion of studies published in English only. Despite a predefined systematic approach to screening and reviewing that includes assessment of inter-rater reliability, the study will also involve judgments made by review authors, which can result in bias.
Findings will be disseminated in peer-reviewed publications, conference presentations as well as within publicly available fact sheets and evidence summaries produced in conjunction with review authors’ academic institutions and policy and practice partners.
Mays VM, Cochran SD, Barnes NW: Race, race-based discrimination, and health outcomes among African Americans. Annu Rev Psychol. 2007, 58: 201-205. 10.1146/annurev.psych.57.102904.190212.
Paradies Y: A systematic review of empirical research on self-reported racism and health. Int J Epidemiol. 2006, 35: 888-901. 10.1093/ije/dyl056.
Williams DR, Mohammed SA: Discrimination and racial disparities in health: evidence and needed research. J Behav Med. 2009, 32: 20-47. 10.1007/s10865-008-9185-0.
Berman G, Paradies Y: Racism, disadvantage and multiculturalism: towards effective anti-racist praxis. Ethnic Racial Stud. 2010, 33: 214-232. 10.1080/01419870802302272.
Paradies Y: Defining, conceptualizing and characterizing racism in health research. Crit Public Health. 2006, 16: 143-157. 10.1080/09581590600828881.
Braveman P, Egerter S, Williams DR: The social determinants of health: coming of age. Annu Rev Public Health. 2011, 32: 381-398. 10.1146/annurev-publhealth-031210-101218.
Brondolo E, Brady N, Libby D, Pencille M: Racism as a psychosocial stressor. Handbook of Stress Science. Edited by: Baum A, Contrada R. 2011, New York, NY: Springer, 167-184.
Harrell CP, Burford TI, Cage BN, McNair Nelson T, Shearon S, Thompson A, Green S: Multiple pathways linking racism to health outcomes. Du Bois Rev. 2011, 8: 143-157. 10.1017/S1742058X11000178.
Pascoe EA, Richman LS: Perceived discrimination and health: a meta-analytic review. Psychol Bull. 2009, 135: 531-554.
Priest N, Paradies Y, Trenerry B, Truong M, Karlsen S, Kelly Y: A systematic review of studies examining the relationship between reported racism and health and wellbeing for children and young people. Soc Sci Med. 2013, 95: 115-127.
Gee GC, Ro A, Shriff-Marco S, Chae D: Racial discrimination and health among Asian Americans: evidence, assessment, and directions for future research. Epidemiol Rev. 2009, 31: 1-22. 10.1093/epirev/mxp010.
Williams DR: Race and health: basic questions, emerging directions. Ann Epidemiol. 1997, 7: 322-333. 10.1016/S1047-2797(97)00051-3.
Kelaher M, Ferdinand A, Paradies Y: Experiencing racism in health care: The mental health impacts for Victorian Aboriginal communities. Medical Journal of Australia. Under review. April 2013
Pieterse AL, Todd NR, Neville HA, Carter RT: Perceived racism and mental health among black American adults: a meta-analytic review. J Couns Psychol. 2012, 59: 1-9.
Lee DL, Ahn S: Racial discrimination and Asian mental health: a meta-analysis. Couns Psychol. 2011, 39: 463-489. 10.1177/0011000010381791.
Lee DL, Ahn S: Discrimination against Latina/os: a meta-analysis of individual-level resources and outcomes. Couns Psychol. 2012, 40: 28-65. 10.1177/0011000011403326.
Williams DR, Williams-Morris R: Racism and mental health: the African American experience. Ethn Health. 2000, 5: 243-268. 10.1080/713667453.
Brondolo E, Rieppi R, Kelly KP, Gerin W: Perceived racism and blood pressure: a review of the literature and conceptual and methodological critique. Ann Behav Med. 2003, 25: 55-65. 10.1207/S15324796ABM2501_08.
Williams DR, Neighbors HW, Jackson JS: Racial/ethnic discrimination and health: findings from community studies. Am J Public Health. 2003, 93: 200-208. 10.2105/AJPH.93.2.200.
Wyatt SB, William DR, Calvin R, Henderson FC, Walker ER, Winters K: Racism and cardiovascular disease in African Americans. Am J Med Sci. 2003, 325: 315-331. 10.1097/00000441-200306000-00003.
Gee G, Walsemann K: Does health predict the reporting of racial discrimination or do reports of discrimination predict health? Findings from the National Longitudinal Study of Youth. Soc Sci Med. 2009, 69: 1676-1684.
Pavalko EK, Mossakowski KN, Hamilton VJ: Does perceived discrimination affect health? Longitudinal relationships between work discrimination and women’s physical and emotional health. J Health Soc Behav. 2003, 44: 18-33. 10.2307/1519813.
Moher D, Liberati A, Tetzlaff J, Altman DG, The PG: Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.
Higgins J, Green S: Cochrane Handbook for Systematic Reviews of Interventions 5.1.0. 2011, Cochrane Collaboration: London, UK
Reuters T: Endnote X5. 2011, New York, NY: Thomson Reuters
Kavanagh J, Oliver S, Lorenc T: Reflections on developing and using PROGRESS-PLUS. Equity Update. 2008, 2: 1-3.
Programme CAS: Critical Appraisal Skills Programme (CASP) tools. 2004, Oxford, UK: Public Health Resource Unit
Borenstein M, Hedges LV, Higgins JP, Rothstein HR: Comprehensive Meta-analysis Version 2.2.057. 2010, Biostat: Englewood, NJ
Digby PGN: Approximating the tetrachoric correlation coefficient. Biometrics. 1983, 39: 753-757. 10.2307/2531104.
Hedges LV, Vevea JL: Fixed- and random-effects models in meta-analysis. Psychol Methods. 1998, 3: 486-504.
Duval S, Tweedie R: A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000, 96: 89-98.
Duval S, Tweedie R: Trim and fill: a simple funnel plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56: 455-463. 10.1111/j.0006-341X.2000.00455.x.
MK is supported by an Australian Research Council Future fellowship. NP is supported by a National Health and Medical Research Council Post doctoral fellowship and the Victorian Health Promotion Foundation. This study was partially funded through a linkage grant (LP100200057) provided by the Australian Research Council, Victorian Health Promotion Foundation and Australian Human Rights Commission. PROSPERO registration number: CRD42013005464.
The authors declare they have no competing interests.
YP conceived and designed the study. NP assisted with overall design and preparation of the study protocol and led development of the search strategy. JB primarily developed screening and data extraction methods. MT contributed to developing the background and search strategy. MK contributed to the background and search strategy. AP and AG provided advice on statistical analysis. MK and GG contributed to the background, search strategy and statistical analysis. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Paradies, Y., Priest, N., Ben, J. et al. Racism as a determinant of health: a protocol for conducting a systematic review and meta-analysis. Syst Rev 2, 85 (2013). https://doi.org/10.1186/2046-4053-2-85