--------------------------------------------------------------- predicted-5AbstractsGroup-lstm: precision recall f1-score support Business 0.6870 0.6583 0.6723 120 CSAI 0.7200 0.8438 0.7770 128 Law 0.6484 0.6640 0.6561 125 Sociology 0.7200 0.5902 0.6486 122 Trans 0.8872 0.9008 0.8939 131 accuracy 0.7348 626 macro avg 0.7325 0.7314 0.7296 626 weighted avg 0.7344 0.7348 0.7323 626 --------------------------------------------------------------- predicted-5AbstractsGroup_bcn_elmo: precision recall f1-score support Business 0.8548 0.8833 0.8689 120 CSAI 0.8636 0.8906 0.8769 128 Law 0.8582 0.9200 0.8880 125 Sociology 0.9048 0.7787 0.8370 122 Trans 0.9313 0.9313 0.9313 131 accuracy 0.8818 626 macro avg 0.8825 0.8808 0.8804 626 weighted avg 0.8830 0.8818 0.8812 626 --------------------------------------------------------------- predicted-5AbstractsGroup_bert_checkpoint-1900: precision recall f1-score support Business 0.8583 0.9083 0.8826 120 CSAI 0.8960 0.8750 0.8854 128 Law 0.9138 0.8480 0.8797 125 Sociology 0.8468 0.8607 0.8537 122 Trans 0.9104 0.9313 0.9208 131 accuracy 0.8850 626 macro avg 0.8851 0.8847 0.8844 626 weighted avg 0.8857 0.8850 0.8849 626 --------------------------------------------------------------- --------------------------------------------------------------- predicted-sst2_lstm: precision recall f1-score support 0 0.8117 0.8458 0.8284 428 1 0.8451 0.8108 0.8276 444 accuracy 0.8280 872 macro avg 0.8284 0.8283 0.8280 872 weighted avg 0.8287 0.8280 0.8280 872 --------------------------------------------------------------- predicted-sst2_bcn_elmo: precision recall f1-score support 0 0.9078 0.8972 0.9025 428 1 0.9020 0.9122 0.9071 444 accuracy 0.9048 872 macro avg 0.9049 0.9047 0.9048 872 weighted avg 0.9048 0.9048 0.9048 872 --------------------------------------------------------------- INFO:args:test-tmp/sst2\checkpoint-6700 INFO:args: precision recall f1-score support 0 0.9155 0.9369 0.9261 428 1 0.9378 0.9167 0.9271 444 accuracy 0.9266 872 macro avg 0.9267 0.9268 0.9266 872 weighted avg 0.9269 0.9266 0.9266 872 --------------------------------------------------------------- --------------------------------------------------------------- # Total examples size: 155027 # Counter({0: 52779, 1: 41949, 2: 31071, 3: 29228}) # Size of instances_train, instances_val, instances_test: 124021 15502 15504 # datasets are converted successfully predicted-redditjokes_lstm: precision recall f1-score support Crazy 0.3412 0.4691 0.3951 2867 High 0.2514 0.0291 0.0522 3160 Low 0.4381 0.6590 0.5263 5293 Medium 0.3176 0.2455 0.2769 4184 accuracy 0.3839 15504 macro avg 0.3371 0.3507 0.3126 15504 weighted avg 0.3496 0.3839 0.3381 15504 INFO:args:++++++++classification report++++++++ INFO:args:test-tmp/redditjokes\checkpoint-5900 INFO:args: precision recall f1-score support Low 0.4343 0.6732 0.5280 5293 Medium 0.3241 0.3389 0.3313 4184 High 0.3333 0.0013 0.0025 3160 Crazy 0.3282 0.3334 0.3308 2867 accuracy 0.3832 15504 macro avg 0.3550 0.3367 0.2982 15504 weighted avg 0.3644 0.3832 0.3314 15504