Skip to main content

Table 2 Performance of the models for the first task of article screening using the adjusted datasetA

From: srBERT: automatic article classification model for systematic review using BERT

 

srBERTmy355K

srBERTmix

Original BERT

K-neighbors

SVC

DecisionTree

RandomForest

Adaboost

MultinomialNB

AUC

90.016

50.000

50.000

58.976

50.000

66.258

66.431

57.319

53.158

Accuracy

89.380

77.120

71.009

75.590

77.123

77.594

78.420

78.066

77.241

Precision

68.900

0.000

0.000

44.715

0.000

51.163

53.416

56.061

51.515

Recall

91.100

0.000

0.000

28.351

0.000

45.361

44.330

19.072

8.763

F1

78.460

0.000

0.000

34.700

0.000

48.087

48.451

28.462

14.978

  1. SR systematic review, BERT bidirectional encoder representations from transformers, srBERTmy355K srBERTmy model trained for 355 K steps, AUC area under the curve, SVC support vector classification, MultinomialNB multinomial naive Bayes model