Name | Task type | Identifier | Download | Info | Metrics | Train/Val/Test size |
---|---|---|---|---|---|---|
Linguistic Diagnostic for Russian | NLI & diagnostics | LiDiRus | More | Matthews Corr | 0/0/1104 | |
Russian Commitment Bank | NLI | RCB | More | Avg. F1 / Accuracy | 438/220/438 | |
Choice of Plausible Alternatives for Russian language | Common Sense | PARus | More | Accuracy | 400/100/500 | |
Russian Multi-Sentence Reading Comprehension | Machine Reading | MuSeRC | More | F1a / EM | 500/100/322 | |
Textual Entailment Recognition for Russian | NLI | TERRa | More | Accuracy | 2616/307/3198 | |
Russian Words in Context (based on RUSSE) | Common Sense | RUSSE | More | Accuracy | 19845/8508/18892 | |
The Winograd Schema Challenge (Russian) | Reasoning | RWSD | More | Accuracy | 606/204/154 | |
Yes/no Question Answering Dataset for the Russian | World Knowledge | DaNetQA | More | Accuracy | 1749/821/805 | |
Russian Reading Comprehension with Commonsense Reasoning | Machine Reading | RuCoS | More | F1 / EM | 72193/7577/7257 |