Skip to main content

Table 2 Performance of the models for the first task of article screening using the adjusted datasetA

From: srBERT: automatic article classification model for systematic review using BERT

  srBERTmy355K srBERTmix Original BERT K-neighbors SVC DecisionTree RandomForest Adaboost MultinomialNB
AUC 90.016 50.000 50.000 58.976 50.000 66.258 66.431 57.319 53.158
Accuracy 89.380 77.120 71.009 75.590 77.123 77.594 78.420 78.066 77.241
Precision 68.900 0.000 0.000 44.715 0.000 51.163 53.416 56.061 51.515
Recall 91.100 0.000 0.000 28.351 0.000 45.361 44.330 19.072 8.763
F1 78.460 0.000 0.000 34.700 0.000 48.087 48.451 28.462 14.978
  1. SR systematic review, BERT bidirectional encoder representations from transformers, srBERTmy355K srBERTmy model trained for 355 K steps, AUC area under the curve, SVC support vector classification, MultinomialNB multinomial naive Bayes model