Leaderboard

Rank Model Average NKJP-NER CDSC-E CDSC-R CBD PolEmo2.0-IN PolEmo2.0-OUT DYK PSC AR
1 XLMR+NKJP 87.8 94.2 94.2 94.5 72.4 93.1 77.9 77.5 98.6 88.2
2 Polish RoBERTa (large) 87.8 94.5 93.3 94.9 71.1 92.8 82.4 73.4 98.8 88.8
3 XLM-RoBERTa (large) - FT3 87.5 94.1 94.4 94.7 70.6 92.4 81.0 72.8 98.9 88.4
4 XLM-RoBERTa (large) - FT2 86.6 94.6 94.4 94.7 67.9 90.4 79.8 71.6 98.2 87.5
5 Polish RoBERTa (base) 85.3 93.9 94.2 94.0 66.7 90.6 76.3 65.9 98.8 87.8
6 XLM-RoBERTa (large) 84.7 94.6 94.4 94.7 50.7 90.4 79.8 71.6 98.2 87.5
7 Polbert (cased) 81.7 93.6 93.4 93.8 52.7 87.4 71.1 59.1 98.6 85.2
8 XLM-RoBERTa (base) 81.5 92.1 94.1 93.3 51.0 89.5 74.7 55.8 98.2 85.2
9 Polbert (uncased) 81.4 90.1 93.9 93.5 55.0 88.1 68.8 59.4 98.8 85.4
10 HerBERT 80.5 92.7 92.5 91.9 50.3 89.2 76.3 52.1 95.3 84.5
11 XLM-17 80.2 91.9 93.7 92.0 44.8 86.3 70.6 61.8 96.3 84.5
12 XLM-100 79.9 91.6 93.7 91.8 42.5 85.6 69.8 63.0 96.8 84.2
13 Slavic BERT 79.8 93.3 93.7 93.3 43.1 87.1 67.6 57.4 98.3 84.3
14 Multilingual BERT (cased) 79.5 91.4 93.8 92.9 40.0 85.0 66.6 64.2 97.9 83.3
15 Multilingual BERT + Polish SQuAD1.1 79.4 91.4 93.5 92.8 46.1 83.1 64.0 62.3 97.9 83.2
16 Multilingual BERT + Polish SQuAD2.0 77.0 91.1 92.7 91.9 36.9 83.5 56.1 60.1 97.6 83.0
17 ELMo 76.7 93.4 89.3 91.1 47.9 87.4 70.6 30.9 93.7 86.2
18 PolBERTa 73.0 87.8 91.2 87.9 41.9 82.5 65.0 34.3 84.5 82.0
19 Sample Submission 28.5 20.3 59.2 1.4 11.2 27.4 30.2 18.9 30.4 57.2