Collections of Indonesian Natural Language Processing dictionaries, corpus, datasets.
Scraped content from Kaskus with 3 cendol or more.
Poems from various user on Twitter.
Scraped content from Wikipedia external links.
Scraped Kamus Besar Bahasa Indonesia Daring.
105,226 words from Kamus Besar Bahasa Indonesia.
Processed CC-News (CommonCrawl News). Contains News from 2016-2021 from various news outlets.
Extracting Javanese text from available data.
(Hopefully) clean mC4.
Twitter dump from ArchiveTeam Twitter Stream Grab. More data will be released soon!
The Multi-Genre Natural Language Inference (MultiNLI). The corpus is modeled on the SNLI corpus, but differs in that covers a range of genres of spoken and written text, and supports a distinctive cross-genre generalization evaluation.
Translated PAWS dataset from Google Research.
Various paraphrase datasets compiled by SBERT translated to Indonesian.
The Stanford Natural Language Inference (SNLI) corpus, translated to Indonesian.
Translated SQuAD from Stanford University.
Automatically generated mathematical question and answer pairs. Translated from DeepMind's Mathematics Dataset.
Automatically generated speech using Google Translate TTS (id-ID-Wavenet-A).
Translated English Gigaword dataset.
4 Million content-summary pairs translated from Webis-TLDR-17.
Replicate WikiHow: A Large Scale Text Summarization Dataset to Indonesian.
Massively translated ParaCrawl v.7.1 from OPUS using Google Translate.
I do not own any of this dataset. Do not use for Commercial Purpose!
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent