Table of contents
- Unlabeled text Corpora
- Semantic Textual Similarity / Paraphrasing
- Natural Language Inference
- Summarization
- Dialect and regional speech identification
- Named Entity Recognition (NER)
- Autorship Attribution
- Sentiment Analysis
- Dependency Parsing
- Diacritics Restoration / Grammar Correction
- Fake News / Clickbait / Satirical News
- Offensive Language
- Questions and Answering
- Spelling, Dictionaries and Gramatical Errors
- Automatic Speech Recognition (ASR)
Unlabeled text Corpora
The FuLG dataset is a comprehensive Romanian language corpus comprising 150 billion tokens, carefully extracted from Common Crawl.
Part of a large multilanguage corpus originated from Common Crawl. It's a raw, unannotated corpus. It has roughly 50 GB of Romanian text in 4.5 million documnets. For details check its homepage and the paper
Similar to Oscar, part of a multilanguage corpus also based on Common Crawl from 2018. Romanian text is 16GB large
Romanian language wikipedia dump.
A collection of varoius unannotated corpora collected around 2018-2019. Includes books, scraped newspapers and juridical documents
A collection of written and spoken text from various sources: Articles, Fairy tales, Fiction, History, Theatre, News
Romanian national legilation from 1881 to 2021. The corpus includes mainly: governmental decisions, ministerial orders, decisions, decrees and laws. Automatically annotated for Named Entities
Mega-COV is a billion-scale dataset from Twitter for studying COVID-19. It is available in over 100+ languages, Romanian being one of them. Tweets need to be rehydrated
A corpus of Romanian tweets related to COVID and vaccination against COVID, created and collected between January 2021 and February 2022. It contains 19319 tweets.
Minutes of the Sittings of the Chamber of Deputies of Romania (2016-2018) Unannotated corpus
contains 500k+ instances of speech from the parliament podium from 1996 to 2018. Sentence splitting and deduplication onm sentence level have been applied as processing steps Unannotated corpus
Romanian presidential discouses (1990-2020) split in 4 files one for each president. Unannotated corpus
Monolingual Romanian corpus, including content from public websites related to culture
Monolingual (ron) corpus, containing 38063991 tokens and 854096 lexical types in the law domain.
Monolingual Romanian corpus, containing 360833 sentences (9064764 words) in the public administration domain.
The New Civil Procedure Code in Romanian (monolingual) comprising 297888 words.
The Romanian updated criminal code: text with law content.
news articles dataset from romanian newssites title, summary and article
multi-language corpus from online available news sources. It contains also 43mil words in Romanian language from Twitter, Blogs and Newspapers
The Romanian novel collection for ELTeC, the European Literary Text Collection Sources: Biblioteca Metropolitana din Bucuresti, Biblioteca Universitara "Mihai Eminescu" din Iasi, Biblioteca Judeteana din Botosani, personal micro-collections uploaded on Zenodo under the following labels: "Hajduks Library"; "RomanianNovel Library"; "CityMysteries Library"; "BibliotecaDHL_Iasi"
Public dataset of 1447 manually annotated Romanian business-oriented emails. The corpus is annotated with 5 token-related labels, as well as 5 sequence-related classes
The corpus consists of texts written by Romanian authors between 19th century and present, representing stories, short-stories, fairy tales and sketches. The current version contains 19 authors, 1263 full texts and 12516 paragraphs of around 200 words each, preserving paragraphs integrity.
A dataset containing 400 Romanian texts written by 10 authors The dataset contains stories, short stories, fairy tales, novels, articles, and sketches written by Ion Creangă, Barbu Ştefănescu Delavrancea, Mihai Eminescu, Nicolae Filimon, Emil Gârleanu, Petre Ispirescu, Mihai Oltean, Emilia Plugaru, Liviu Rebreanu, Ioan Slavici.
891 Cooking Recipes in Romanian Language
Semantic Textual Similarity / Paraphrasing
Semantic Textual Similarity dataset for the Romanian language RO-STS contains 8,628 sentence pairs with their similarity scores
A paraphrase corpus created from 10 different Romanian language Bible versions. The final dataset contains 904,815 similar records and 218,977 non matching records, totaling 1,123,927
Around ~100k examples of paraphrases. No clear explanation on how the dataset was built
A multi-language paraphrase corpus for 73 languages extracted from the Tatoeba database. It has ~ 2000 romanian phrases totaling 941 paraphrase groups.
Natural Language Inference
We introduce the first Romanian NLI corpus (RoNLI) comprising 58K training sentence pairs, which are obtained via distant supervision, and 6K validation and test sentence pairs, which are manually annotated with the correct labels.
The repository seems to be just an attempt at starting to build the dataset
Summarization
Around ~72k Full texts and their summary. Source seems to be news websites. No description or explanation available
Dialect and regional speech identification
varied compilation of speech samples from five distinct regions of Romania, covering both urban and rural environments. Around 2800 records labeled with age, gender and type of dialect
MOROCO: The Moldavian and Romanian Dialectal Corpus The MOROCO data set contains Moldavian and Romanian samples of text collected from the news domain. The samples belong to one of the following six topics: culture, finance, politics, science, sports, tech totaling over 32.000 labeled records
Named Entity Recognition (NER)
The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of the 20th century (i.e., 1990). The samples belong to one of the following four historical regions of Romania, namely Bessarabia, Moldavia, Transylvania, and Wallachia.
Autorship Attribution
Sentiment Analysis
- 😊 RO_Sent 😊
- 📖 Senti_Lex 📖
- 🎭 LaROSeDa 🎭
- 🎬 SART 🎬
- ❤️ RED ❤️
- 🌐 Romanian Categorized Web Dataset 🌐
- 🎬 Romanian Sentiment Movie Reviews 🎬
Dependency Parsing
- 🌳 CoNLL 2017 & 2018 🌳
- 🔗 Deep Universal Dependencies 🔗
- 📚 Curlicat Romanian Corpus 📚
- 🌲 HamleDT 🌲
- 📖 RoWordNet 📖
- 🌳 RoRefTrees 🌳
Diacritics Restoration / Grammar Correction
Fake News / Clickbait / Satirical News
Offensive Language
manually annotated 4,052 comments on a Romanian local news website into one of the following classes: non-offensive, targeted insults, racist, homophobic, and sexist.
4455 organic generated comments from Facebook live broadcasts annotated not binary offensive language detection tasks and for fine-grained offensive language detection
4800 Romanian comments annotated with offensive text spans Offensive span detection
3860 labeled hate speech records
Dataset consists of 5000 tweets, from which 924 were labeled as offensive (18.48 %) and 4076 tweets as non-offensive.
The corpus contains 39 245 tweets, annotated by multiple annotators, following the sexist label set of a recent study.
Questions and Answers
This dataset is just the translation of the gsm8k dataset. GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. There is no information on the quality of the translation
RoCode, a competitive programming dataset, consisting of 2,642 problems written in Romanian, 11k solutions in C, C++ and Python and comprehensive testing suites for each problem. The purpose of RoCode is to provide a benchmark for evaluating the code intelligence of language models trained on Romanian / multilingual text as well as a fine-tuning set for pretrained Romanian models.
Romanian IT Dataset (RoITD) resembling SQuAD 1.1. RoITD consists of 9575 Romanian QA pairs formulated by crowd workers. QA pairs are based on 5043 articles from Romanian Wikipedia articles describing IT and household products. Of the total number of questions, 5103 are possible (i.e. the correct answer can be found within the paragraph) and 4472 are not possible (i.e. the given answer is a "plausible answer" and not correct)
The dataset comprises 102,646 high-quality QA pairs from real-world clinical records of 1,011 oncology patients (796 patients with breast cancer and 215 patients with lung cancer). The QA pairs are the results of a manual annotation process carried out by physicians specialized in oncology and radiotherapy RoMedQA includes 76,416 QA pairs about breast cancer patients and 26,230 about lung cancer patients, with questions grounded in medical case summaries (epicrises).
Romanian legal MCQA dataset, comprising 10,836 questions from three examinations. Each entry essentially consists of a body in which a theoretical question is posed regarding a legal aspect, along with three possible answer choices labeled A, B, and C, out of which at mosttwo answers are correct.
Spelling, Dictionaries and Gramatical Errors
Synthetic dataset with ~1.9M records. Altered and correct statement as columns
Romanian Archaisms Regionalisms Lexicon containing ~ 1940 Word definitions
Romanian Rules for Dialects - 1940 regionalisms, meanings and the region of provenience
The dataset was developed mainly for speech processing applications, yet its applicability extends beyond this domain. RoLEX includes over 330,000 curated entries with information regarding lemma, morphosyntactic description, syllabification, lexical stress and phonemic transcription.
Automatic Speech Recognition
Underrepresented Speech Dataset from Open Data. Duration of the dataset is 4h 18m 55s. Distribution according to platforms: 83% of the content comes from YouTube, 12% from SoundCloud, and 5% from Vimeo Dataset covers primarily under-represented speech groups (outside the 19–29 male category)
Source: https://github.com/AndyTheFactory/romanian-nlp-datasets
Posts
