Skip to main content

Using built-in functions of Adobe Acrobat Pro DC to help the selection process in systematic reviews of randomised trials

Abstract

This letter describes a simple way of using Adobe Acrobat Pro DC to help select and auto-extract data from Portable Document Format (PDFs) of randomised trials in order to assist swift early selection of trials for a systematic review.

Peer Review reports

Background

Automated extraction of data from randomised trials of the effects of healthcare is attractive [1]. Systematic reviews contain tabulated data often extracted from source Portable Document Format (PDFs). It is rare that these tabulated data contain explicit source co-ordinates and are rarely shared. Without transparency, the systematic nature of the work is threatened. Without the potential to share, maintenance is needlessly repetitive. There is the potential gain of saving time of [expensive] researchers by extracting from documents with some common structure. However, automated extraction of all study data still requires development for maximal accuracy [2] and may be impossible. This leaves the current reviewers with a problem. Although the hope of ‘jam tomorrow’ is attractive, the reviewers have to deal with the ‘bread and butter’ of routine and manual extraction.

The process of data extraction for a review is, in reality, staged. Stage 1 screens database output (decision—acquire/not acquire full text), i.e. study selection based on title and abstract—involving the lowest level of extraction. Stage 2 involves full text, frequently in PDF—the decision being whether to include/exclude the study, i.e. more detailed study selection combined often with extraction of the non-numeric data justifying the decision. Thereafter, stage 3 commences with full-data extraction. Recognising that stages 1 and 3 may be beyond our basic computing skills, we decided to experiment with Acrobat 11 Pro to see if it can assist in stage 2, i.e. the stage by which study selection is undertaken and basic non-numerical data are extracted to support the selection decision. Other systems exist (Apache Gate, Dr Evidence) but are less ubiquitous than the Acrobat packages.

Methods

We downloaded Adobe Acrobat Pro DC and piloted techniques on a subset of reports. The Cochrane Schizophrenia Group holds all reports of relevant randomised trials in either PDF—Formatted Text and Graphics (PDF-FTG) or PDF Image plus Hidden Text (PDF-IT) format [3]. We converted all PDF Image Only (PDF-I) files to PDF-IT using the built-in Optical Character Recognition (OCR) facilities in Acrobat, from version 7 onwards.

Using the Action Wizard function, we created a .TXT file holding ‘target words’ on which selection of a trial for a particular review is undertaken (stage 2). The length of the list of ‘target words’ should be short so as not to over-clutter the PDF with mark-up—thereby decreasing the value of the eventual highlight (Table 1).

Table 1 Example of the structure of the TXT file for one review

Adobe Acrobat Pro DC allows the batching of a series of commands into one. We used this to merge ‘Find’, ‘Highlight’ and ‘Create Comment Summary’ commands (in ‘Actions List’ within the ‘Action Wizard’ tool). (If they do not exist already in the Action Wizard, there is an option to download the required functions from the Web.) Once the PDF (PDF-IT or PDF-FTG but not PDF-I) is uploaded, the new action can be run.

Results

Adobe Pro DC creates a separate PDF file in which the target words are highlighted and linked to their comment.

The comment takes the form of a full-text word targeted as a result of the initial Acrobat text list (Acrobat highlights the complete word in which the target pattern of letters is found) and a numerical annotation (Fig. 1). The targeted word and the annotation also are listed after each of the original PDF’s text pages. Acrobat allows several options for creating a summary of the comments. One option links the target words by the use of lines drawn across the PDF. Each line contains the accurate coordinates of the target words, and it is possible to go beyond the simple selection of the word and extract that specific target word and coordinates into a table. Currently, this is too manual a process but it gives us a glimpse of the ‘Holy Grail’ of data extraction—where accurate, data extraction creates a sharable machine-readable table with source co-ordinates of each piece of information.

Fig. 1
figure 1

Example of annotated page from a paper [4]

Finally, Acrobat has an option to create a comment summary in MS Excel. This tabulates target words with the page number—although, currently, not the exact co-ordinate where the word occurs. This can be edited to something like Table 2 in seconds.

Table 2 MS Excel table collated and transformed within MS Word

Summary

Part of the manual process within systematic reviews of healthcare by which data are identified and extracted for consideration can feasibly be replaced by using simple actions in Adobe Acrobat Pro DC. For a given review, the manual process can take considerable time. Batch processing in Acrobat Pro takes seconds, and the resulting extracted non-numerical data are traceable to source. Further work should compare full-text study selection, performed blinded and in parallel by two experienced reviewers, with disagreements resolved by a third reviewer who is blinded to which reviewer used the software.

Abbreviations

OCR:

Optical Character Recognition

PDF:

Portable Document Format

References

  1. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Syst Rev. 2014;3:74.

    Article  PubMed Central  PubMed  Google Scholar 

  2. Kiritchenko S, de Bruijn B, Carini S, Martin J, Sim I. ExaCT: automatic extraction of clinical trial characteristics from journal publications. BMC Med Inform Decis Mak. 2010;10:56.

    Article  PubMed Central  PubMed  Google Scholar 

  3. Hughes J, Brailsford DF, Bagley SR, Adams CE. Generating summary documents for a variable-quality PDF document collection. In: Proceedings of the 2014 ACM Symposium on Document Engineering. 2014. p. 49–52.

  4. Shiina A, Shirayama Y, Niitsu T, Hashimoto T, Yoshida T, Hasegawa T, et al. A randomised, double-blind, placebo-controlled trial of tropisetron in patients with schizophrenia. Ann Gen Psychiatry. 2010;9:27.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Clive E. Adams.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SN tested the different software programs and did the first experiment, reproduced the results and drafted the experiment report. CEA presented the first idea and revised and converted the experiment report into the first draft of the manuscript. DFB developed the techniques for producing qualified materials for the experiment and commented on the final edition of the manuscript before submission. All the authors studied and verified the final edition of manuscript. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nur, S., Adams, C.E. & Brailsford, D.F. Using built-in functions of Adobe Acrobat Pro DC to help the selection process in systematic reviews of randomised trials. Syst Rev 5, 33 (2016). https://doi.org/10.1186/s13643-016-0207-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-016-0207-7

Keywords