Skip to main content

Interventions to mitigate COVID-19 misinformation: protocol for a scoping review

Abstract

Background

The duration and impact of the COVID-19 pandemic depends in a large part on individual and societal actions which is influenced by the quality and salience of the information to which they are exposed. Unfortunately, COVID-19 misinformation has proliferated. To date, no systematic efforts have been made to evaluate interventions that mitigate COVID-19-related misinformation. We plan to conduct a scoping review that seeks to fill several of the gaps in the current knowledge of interventions that mitigate COVID-19-related misinformation.

Methods

A scoping review focusing on interventions that mitigate COVID-19 misinformation will be conducted. We will search (from January 2020 onwards) MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Africa-Wide Information, Global Health, WHO Global Literature on Coronavirus Disease Database, WHO Global Index Medicus, and Sociological Abstracts. Gray literature will be identified using Disaster Lit, Google Scholar, Open Science Framework, governmental websites, and preprint servers (e.g., EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints). Study selection will conform to Joanna Briggs Institute Reviewers’ Manual 2020 Methodology for JBI Scoping Reviews. Only English language, original studies will be considered for inclusion. Two reviewers will independently screen all citations, full-text articles, and abstract data. A narrative summary of findings will be conducted. Data analysis will involve quantitative (e.g., frequencies) and qualitative (e.g., content and thematic analysis) methods.

Discussion

Original research is urgently needed to design interventions to mitigate COVID-19 misinformation. The planned scoping review will help to address this gap.

Systematic review registrations

Systematic Review Registration: Open Science Framework (osf/io/etw9d).

Peer Review reports

Background

The COVID-19 pandemic represents a substantial challenge to global human wellbeing. The duration and impact of the pandemic depends in a large part on individual and societal actions and, therefore, to the quality and salience of the information to which people are exposed [1]. Unfortunately, COVID-19 misinformation has proliferated, especially on social media [2]. Misinformation is defined as information that has the features of being false or clearly unsubstantiated, determined based on expert opinion and evidence [3].

COVID-19 misinformation comes in many forms. For example, unlikely theories about the virus being created as a biological weapon in China. As large-scale vaccination has scaled up, COVID-19 vaccine-related misinformation has also appeared, such as false reports about Bill Gates’ plan to equip COVID-19 vaccines with microchips to track and control peoples’ actions [4]. Such misinformation may cause people to turn to ineffective and possibly harmful remedies, overreact (e.g., by hoarding goods) or, more dangerously, underreact (e.g., by engaging in risky behavior and inadvertently spreading the virus). Misinformation may also delay access to care, negatively affecting health outcomes [5]. Such information may also worsen existing fear around vaccines and limit their uptake by a population [6], perhaps reducing the population level of indirect protection from the vaccine, or even preventing herd immunity that could eliminate the virus.

The growing danger of COVID-19-related misinformation has spurred efforts to develop and evaluate interventions designed to mitigate the spread of falsehoods and sustain public trust in evidence-based care. Interventions have employed a variety of strategies designed to debunk misinformation, including accuracy reminders [1], curated infographics [7], and misinformation refutation [8]. While such strategies have shown some potential in reducing the impact of COVID-19 misinformation, individuals tend to mitigate misinformation through other means, most commonly web searches [9]. Thus, despite a growing number of studies that attempt to mitigate COVID-19 misinformation, we are far from knowing when and how to best intervene. In addition, there is a need to capture adverse events related to these types of interventions. Social media interventions also have backfired and increased belief in falsehoods [10].

To date, no systematic efforts have been made to evaluate interventions that mitigate COVID-19-related misinformation. Past reviews have detailed interventions to mitigate misinformation on social media [11,12,13,14] and the prevalence of misinformation on social media [15, 16] but have not focused on COVID-19. To provide information that can be used to design effective interventions for COVID-19 misinformation, we plan a scoping review that seeks to compile published evidence in the field to identify gaps in current understanding of experimental evidence regarding the mitigation of COVID-19-related misinformation. We will conduct a scoping review rather than use other methods of research synthesis because scoping reviews are appropriate for mapping an area of research [17]. COVID-19 misinformation intervention research outcomes are likely not sufficiently similar to each other to warrant pooling. The review will take a broad view of COVID-19 misinformation, including aspects related to vaccines, COVID-19 origins, and public health measures.

Methods/design

The review protocol has been preregistered within the Open Science Framework database (osf/io/etw9d) will be reported in accordance with the reporting guidance provided in the Preferred Reporting Items for Systematic Reviews and Metaanalyses extension for Scoping Reviews (PRISMA-ScR) [18] (see checklist in Additional file 1). Research objectives, inclusion criteria, and methodological techniques will be determined before study commencement using the Joanna Briggs Institute Reviewers’ Manual 2020 Methodology for JBI Scoping Reviews [19]. This process will adhere to the indicated framework: (1) identifying research question; (2) developing comprehensive search strategy; (3) identifying relevant studies; (4) selecting studies; (5) charting data; and (6) collating, summarizing, and reporting results. The study team will develop a search strategy as recommended by the 2020 Methodology for JBI Scoping Reviews.

This scoping review will be conducted by 13 individuals: 12 researchers from several universities worldwide, from a range of disciplines (e.g., public health, medicine, communication studies, mathematics, nursing, computer science, political science), and an informationist from the Harvey Cushing/John Hay Whitney Medical Library at Yale University. As mentioned above, the objective of the scoping review is to develop a better understanding of the current research landscape around interventions to mitigate COVID-19 misinformation by investigating existing studies and gaps in the research. The broad research questions are “what are the benefits and risks of interventions to mitigate COVID-19 misinformation?” and “what are the gaps in the current knowledge base on interventions to mitigate COVID-19 misinformation?” The search strategy will be performed in line with techniques that enhance methodological transparency and improve the reproducibility of the results and evidence synthesis.

Information sources and search strategy

The primary source of literature will be a structured search of electronic databases (from January 2020 onwards): MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Africa-Wide Information, Global Health, WHO Global Literature on Coronavirus Disease Database, WHO Global Index Medicus, and Sociological Abstracts. The secondary source of potentially relevant material will be a search of preprint servers (e.g., EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints), Disaster Lit, Google Scholar (e.g., the first five pages will be searched), Open Science Framework, governmental websites, and the COVID-19 social science research tracker [20]. The references of included documents will be hand-searched to identify any additional evidence sources. We will also conduct forward citation chaining. The search strategy will be designed by a research librarian and peer-reviewed by using the Peer Review of Electronic Search Strategies (PRESS) checklist [21]. A draft search strategy for Scopus is provided in Additional file 2. We will use search terms consistent with our main search to find articles for inclusion. The same keywords for the main search will be used to search gray literature each time. All gray literature will be compiled in a folder and reviewed similarly to articles obtained from our database searches. EndNote, a bibliographic software, will be used to store, organize, and manage all references [22].

Eligibility criteria

We will include all intervention studies that mitigate COVID-19 misinformation. Only English language studies will be considered for inclusion. Past work suggests that excluding non-English language records from a review has a minimal effect on results [23, 24].

Inclusion criteria

Published research (peer-reviewed and gray literature where primary data was collected such as reports, research letters and briefs) investigating interventions that mitigate COVID-19 misinformation (as long as the authors have denoted the topic of study as misinformation) in all populations and settings will be eligible for inclusion.

Only intervention-based studies will be included (e.g., experimental studies, quasi-experimental studies, randomized controlled trials).

There will be no restrictions on the region.

Studies reported only as conference abstracts will also be included, only if we do not have access to the full paper. Conference abstracts are often left out of systematic reviews as they may not contain adequate information to conduct quality assessment or a meta-analysis. Here, we will include conference abstracts as they are often published earlier than full manuscripts [25], which is key to a thorough scoping review on an ongoing phenomenon.

Exclusion criteria

Commentaries, correspondences, case reports, case series, editorials, and opinion pieces will be excluded. Case reports and case series often contain relatively limited evidence [26].

Qualitative studies will be excluded.

Non-intervention studies will be excluded.

Governmental, other agency guidelines, and white papers will be excluded. Reviews such as systematic reviews and scoping reviews will be excluded, but we will review the references in these for inclusion, if applicable.

Screening and selection procedure

All reports identified from the searches will be screened by two reviewers independently. First, titles and abstracts of articles returned from initial searches will be screened based on the eligibility criteria outlined above. Second, full texts will be examined in detail and screened for eligibility. Third, references of all considered articles will be hand-searched to identify any relevant report missed in the search strategy. We will also conduct forward citation chaining. Any disagreements will be resolved by discussion, or if necessary, with a third reviewer. A flow chart showing details of studies included and excluded at each stage of the study selection process will be provided. We will contact authors where necessary if the abstracts do not provide sufficient information [25]. Covidence will be used to manage the title/abstract and full-text screening phases [27].

Data extraction

Reviewers will undergo a practice exercises till they have a high level of agreement (> 0.8 kappa) and then independently extract data from studies. Reviewers will abstract the data using a pretested data extraction template. We will use a standardized coding protocol to collect information such as title of study, authors, date published; study setting; study design; description of methodology; description of study sample; type of intervention; type of misinformation (if any); and main findings. Even though a formal risk of bias is not planned for this scoping review, we will note which studies are pre-prints and have not been formally peer-reviewed. We will also note if some studies fail to report appropriate information.

Data synthesis

Outcomes and other information collected regarding selected studies will be synthesized using quantitative (e.g., outcomes) and qualitative (e.g., content and thematic analysis) methods, with a narrative summary of findings conducted. Synthesis will be presented in tables, summary data in graphs, and individual data for each study in tables. The broad goal of the synthesis is to identify gaps in research and present recommendations for future research agendas.

Discussion

There has been limited research that compiles available evidence from various settings regarding interventions that mitigate COVID-19 misinformation. Our review will provide an overview of these studies and synthesize available evidence. We will provide an overview of known gaps in the literature, such as how to target corrective information better and to make it more effective, disrupt the formation of linkages between group identities and false claims, and reduce the flow of cues reinforcing those claims from elites and the media [28]. There is much anecdotal work around COVID-19 misinformation, with few intervention studies. The planned review will highlight areas of research focus and gaps that require more attention and capture adverse events related to these types of interventions. Moreover, the COVID-19 context is evolving, especially with large-scale vaccination in the USA likely affecting misinformation in a rapidly shifting fashion, as well as the scientific evidence around the illness adapting to newer studies being conducted throughout the world. Results will thus provide high-level information to inform, support, and customize the design of interventions to mitigate COVID-19 misinformation. As researchers attempt to minimize COVID-19 misinformation, they need to be aware of scientific evidence to develop interventions to achieve their aim. The planned scoping review seeks to provide this evidence by contributing an evaluation of what is currently known about interventions that mitigate COVID-19 misinformation, with the goal of identifying gaps in research and presenting recommendations for future research foci.

The methodological strength of the planned scoping review is the use of a trans-parent and reproducible procedure for a scoping literature review. We state the data sources, search strategy, and data extraction [29]. Through publishing this research protocol, we strengthen the clarity of the search strategy. The information from the planned review may provide guidance going forward, as COVID-19 likely transforms itself into a seasonal endemic infection like influenza [30]. Thus, some of the insights in the planned review may be helpful in the coming decade. Any amendments to this protocol will be documented in the final published scoping review with reference to saved searches and analysis.

The results of the review will first be posted to a preprint server so that results can be of benefit more quickly and then disseminated in a peer-reviewed journal and likely in other media such as: conferences, seminars, symposia. The protocol and final review article will be made open access upon publication. As per PRISMA-ScR guidelines, we will present results in a user-friendly format [31].

Limitations

Our planned review should be read in line with some limitations. Although we plan to search several databases and gray literature sources, we may miss some studies; due to the rapid research pace around the COVID-19 pandemic, it is likely that relevant research, crosscutting across different disciplines, exists in fragmented indexing databases. Not all authors we reach out to may respond and we may thus miss some unpublished work. We may not be able to make policy recommendations due to the lack of quality appraisal of studies [32]. The quickly changing COVID-19 context may be a potential limitation.

Availability of data and materials

The datasets used and analyzed will be made available upon reasonable request.

Abbreviations

PRISMA-ScR:

PRISMA Extension for Scoping Reviews JBI: Joanna Briggs Institute

COVID-19:

Coronavirus disease 2019

References

  1. Pennycook G, McPhetres J, Zhang Y, Rand D. Fighting COVID-19 misinformation on social media: experimental evidence for a scalable accuracy nudge intervention. PsyArXiv Preprints. 2020;10.

  2. Frenkel S, Alba D, Zhong R. Surge of virus misinformation stumps Facebook and Twitter. N Y Times. 2020;8.

  3. Vraga EK, Bode L. Correction as a solution for health misinformation on social media. Am J Public Health. 2020;110:S278–80.

    Article  Google Scholar 

  4. Evanega S, Lynas M, Adams J, Smolenyak K, Insights CG. Coronavirus misinformation: quantifying sources and themes in the COVID-19 ‘infodemic’. JMIR Preprints. 2020.

  5. Wang Y, McKee M, Torbica A, Stuckler D. Systematic literature review on the spread of health-related misinformation on social media. Soc Sci Med. 2019;240:112552.

    Article  Google Scholar 

  6. Loomba S, de Figueiredo A, Piatek S, de Graaf K, Larson HJ. Measuring the impact of exposure to COVID-19 vaccine misinformation on vaccine intent in the UK and US. medRxiv. 2020.

  7. Agley J, Xiao Y, Thompson EE, Golzarri-Arroyo L. COVID-19 misinformation prophylaxis: protocol for a randomized trial of a brief informational intervention. JMIR Res Protoc. 2020;9(12):e24383.

    Article  Google Scholar 

  8. MacFarlane D, Tay LQ, Hurlstone MJ, Ecker UK. Refuting spurious COVID-19 treatment claims reduces demand and misinformation sharing. J Appl Res Memory Cogn. 2020.

  9. Geeng C, Francisco T, West J, Roesner F. Social media COVID-19 misinformation interventions viewed positively, but have limited impact. arXiv preprint arXiv:201211055. 2020.

  10. Nyhan B, Reifler J. When corrections fail: the persistence of political misperceptions. Polit Behav. 2010;32(2):303–30.

    Article  Google Scholar 

  11. Walter N, Brooks JJ, Saucier CJ, Suresh S. Evaluating the impact of attempts to correct health misinformation on social media: a meta-analysis. Health Commun. 2020:1–9.

  12. Wood T, Porter E. The elusive backfire effect: mass attitudes’ steadfast factual adherence. Polit Behav. 2019;41(1):135–63.

    Article  Google Scholar 

  13. Walter N, Murphy ST. How to unring the bell: a meta-analytic approach to correction of misinformation. Commun Monogr. 2018;85(3):423–41.

    Article  Google Scholar 

  14. MpS C, Jones CR, Hall Jamieson K, Albarrac´ın D. Debunking: a meta-analysis of the psychological efficacy of messages countering misinformation. Psychol Sci. 2017;28(11):1531–46.

    Article  Google Scholar 

  15. Suarez-Lledo V, Alvarez-Galvez J. Prevalence of health misinformation on social media: systematic review. J Med Internet Res. 2021;23(1):e17187.

    Article  Google Scholar 

  16. Porter E, Wood TJ. False alarm: the truth about political mistruths in the Trump era: Cambridge University Press; 2019.

    Book  Google Scholar 

  17. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

    Article  Google Scholar 

  18. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.

    Article  Google Scholar 

  19. Peters MD, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synthesis. 2020;18(10):2119–26.

    Article  Google Scholar 

  20. Matias J, Leavitt A. COVID-19 social science research tracker. GitHub. https://github.com/natematias/covid-19-social-science-research; 2020.

  21. Lefebvre C, Duffy S. Peer reviewing search strategies. HTAi Vortal. 2018.

  22. Clarivate Analytics. Endnote X8 for windows. Philadelphia, PA: Clarivate Analytics; 2017.

    Google Scholar 

  23. Nussbaumer-Streit B, Klerings I, Dobrescu A, Persad E, Stevens A, Garritty C, et al. Excluding non-English publications from evidence-syntheses did not change conclusions: a meta-epidemiological study. J Clin Epidemiol. 2020;118:42–54.

    Article  CAS  Google Scholar 

  24. Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012;28(2):138.

    Article  Google Scholar 

  25. Scherer RW, Saldanha IJ. How should systematic reviewers handle conference abstracts? A view from the trenches. Syst Rev. 2019;8(1):264.

    Article  Google Scholar 

  26. Turner RM, Bird SM, Higgins JP. The impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews. PloS one. 2013;8(3):e59202.

    Article  CAS  Google Scholar 

  27. VH Innovation. Covidence systematic review software. Melbourne, Australia; 2017.

  28. Nyhan B. Facts and myths about misperceptions. J Econ Perspect. 2020;34(3):220–36.

    Article  Google Scholar 

  29. Silagy CA, Middleton P, Hopewell S. Publishing protocols of systematic reviews: comparing what was done to what was planned. Jama. 2002;287(21):2831–4.

    Article  Google Scholar 

  30. Murray CJ, Piot P. The potential future of the COVID-19 pandemic: will SARS-CoV-2 become a recurrent seasonal infection? JAMA. 2021.

  31. Miake-Lye IM, Hempel S, Shanman R, Shekelle PG. What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products. Syst Rev. 2016;5(1):28.

    Article  Google Scholar 

  32. Boström AM, Slaughter SE, Chojecki D, Estabrooks CA. What do we know about knowledge translation in the care of older adults? A scoping review. J Am Med Dir Assoc. 2012;13(3):210–9.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the reviewers and editors for their assistance.

Funding

The study was funded by the Foundation for a Smoke-Free World. The funding body had no role in the design, analysis, or interpretation of the data in the study.

Author information

Authors and Affiliations

Authors

Contributions

NK wrote the first draft. NK, KN, LF, NW, KK, JDT, CTB, QD, SMJ, MDC, JLS, and OP contributed to the manuscript write-up and review. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Navin Kumar.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

All authors approved submission.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, N., Walter, N., Nyhan, K. et al. Interventions to mitigate COVID-19 misinformation: protocol for a scoping review. Syst Rev 11, 107 (2022). https://doi.org/10.1186/s13643-022-01917-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-022-01917-4

Keywords