An umbrella portal for all the glossary creation workflows and datasets
Indic-Glossaries is an open source portal that is an umbrella to expose all the workflows for the creation of Indic glossaries and also the created/curated glossary datasets.
The datasets are licensed under :
(The entire collected glossary datasets are submitted to ULCA platform. Please refer https://bhashini.gov.in/ulca for further details)
| Collection Source | Glossary Corpus Count | Download link |
|---|---|---|
| IndoWordNet | 1,724,816 | download |
| Bharatavani | 866,423 | download |
| CSTT | 319,420 | download |
| OSF | 212,951 | download |
| NLPC - Univ of Moratuwa | 19,273 | download |
| Anuvaad | 1,690 | download |
| NCF-NCERT | 272 | download |
| Language Pair | Glossary Corpus Count |
|---|---|
| English-Assamese | 75,256 |
| English-Bengali | 102,855 |
| English-Bodo | 158,457 |
| English-Dogri | 8,624 |
| English-Goan Konkani | 87,300 |
| English-Gujarati | 168,343 |
| English-Hindi | 852,324 |
| English-Kannada | 156,777 |
| English-Kashmiri | 69,673 |
| English-Maithili | 8,297 |
| English-Malayalam | 98,092 |
| English-Manipuri | 7,183 |
| English-Marathi | 106,787 |
| English-Nepali | 65,795 |
| English-Odia | 130,801 |
| English-Punjabi | 152,081 |
| English-Sanskrit | 130,042 |
| English-Sindhi | 4,797 |
| English-Tamil | 316,976 |
| English-Telugu | 92,839 |
| English-Urdu | 79,253 |
| Hindi-Tamil | 113 |
| Hindi-Telugu | 13,340 |
| Hindi-Urdu | 3,133 |
| Hindi-English | 130,422 |
| Malayalam-English | 9,269 |
| Sanskrit-Hindi | 111,155 |
| Tamil-Hindi | 4,868 |
| Domain | Glossary Corpus Count |
|---|---|
| general | 2,209,449 |
| economy | 21,762 |
| technology | 26,360 |
| education | 351,387 |
| geography | 92,169 |
| legal | 46,870 |
| financial | 17,163 |
| automobile | 6,303 |
| healthcare | 278,436 |
| national-security-and-defence | 30,570 |
| agriculture | 4,807 |
| parliamentary | 22,180 |
| history | 23,955 |
| news | 7,303 |
| lifestyle | 3,506 |
| entertainment | 1,143 |
| philosophy | 1,489 |
The goal is to build high quality glossary datasets for the Indian languages across various domains (General, Legal, Education, Healthcare, Automobile, News etc).
Read more about Glossary Explorer @ https://glossary.ai4bharat.org
Any information/help/discussion required, can be taken up using the following link : https://github.com/AI4Bharat/Indic-Glossaries/discussions
This project adheres to the Contributor Covenant code of conduct. By participating, you are expected to uphold this code. Please report unacceptable behavior to [email protected].
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent