Tasks

Name Task type Identifier Download Info Metrics Train/Val/Test size
Linguistic Diagnostic for Russian NLI & diagnostics LiDiRus More Matthews Corr 0/0/1104
Russian Commitment Bank NLI RCB More Avg. F1 / Accuracy 438/220/438
Choice of Plausible Alternatives for Russian language Common Sense PARus More Accuracy 400/100/500
Russian Multi-Sentence Reading Comprehension Machine Reading MuSeRC More F1a / EM 500/100/322
Textual Entailment Recognition for Russian NLI TERRa More Accuracy 2616/307/3198
Russian Words in Context (based on RUSSE) Common Sense RUSSE More Accuracy 19845/8508/18892
The Winograd Schema Challenge (Russian) Reasoning RWSD More Accuracy 606/204/154
Yes/no Question Answering Dataset for the Russian World Knowledge DaNetQA More Accuracy 1749/821/805
Russian Reading Comprehension with Commonsense Reasoning Machine Reading RuCoS More F1 / EM 72193/7577/7257
Download all tasks