sathia27 / corpus

Corpus is a collection of words, tagged or annotated with their grammar components.

Sorkandu

Corpus is a collection of words, tagged or annotated with their grammar components.

We can use the text corpus to do the linguistic researches and projects.

There are many projects run by government and many universities to create a text corpus for Tamil Language. Unfortunately, they are not open for public usage.

We have to create a system to create a Corpus for Tamil, which is public.

So that anyone can use the corpus data.

Collecting words, assigning relevant tags, edit the tags are painful job to do manually and individually.

This web application will enable the users to login, select a word, tag it properly, move to next word.

The admin can load the words and do all the administrative tasks.

System Dependencies

• Linux / other unix / OSX
• Ruby 2.1
• Rails 4
• mysql 2

Initiate app

  git clone [email protected]:sathia27/corpus.git
  cd corpus
  bundle install
  rake db:create
  rake db:migrate
  export CORPUS_DB=corpus_development
  export CORPUS_DB_USER=<YOUR MYSQL USERNAME>
  export CORPUS_DB_PASSWORD=<YOUR MYSQL PASSWORD>

Demo

http://corpus-sathia.rhcloud.com/

Travis build

Contributing

You can contribute to this project in different ways:

Report outstanding issues and bugs by creating an Issue Suggest feature enhancements also via Issues Fork the project, create a branch and file a pull request to improve the code itself If you wish to participate contact the team on Mailing list https://lists.sourceforge.net/lists/listinfo/sorkandu-discussions/. So team will guide to move forward

License

This project is licensed under GPL V3

Please Contribute.

corpus's Issues

Save words to db by reading uploaded document

Should not allow to delete tags if words are already tagged with that tag

Roadmap for sorkadu 1.0

• Wiki page for sorkandu
• Start using internationalization
• Break up README into modular pages: Getting Started, Guides
• Authentication using devise
• Add admin interface.
• Omniauthable using devise. Facebook and twitter for now.
• Add bootstrap 3
• Create a WordDocument model, where we upload text file which contains list of words.
• Add Service Layer for Application
• Add a Service for reading uploaded text file, and save the words in Word model.
• Add a Tag model. Create Tag and Word relations
• Show random word to user with tags, so that user can tag a word, if user is logged in.
• Create News feed for users.

Admin interface

• Admin can see tagged words and not tagger words
• Admin can see all users joined and words they tagged.

Remove Facebook sandbox mode

This is quite a big task. We have already have app on facebook. But it is in sandbox mode. To make it live we need to have some stuff to be done.

• We need to be create a logo
• Screenshots of web page.

Start using I18n for project.

Start using I18n for project. Lets starts with en.yml.

Add AdminController for Admin interface

Roadmap

Need roadmap to provide clear scope of project to new contributors, especially students.

Add admin filter functionality for words

Localization for Tamil Language for Devise

Need to have localization for tamil language for devise

Tagged words are accessible even user is not logged in

Main purpose of this project is to share data of corpus data. So even user is not logged into system. He can access tagged words list via html or json or csv

Creating authentication using devise

I hope we can use devise authentication. If there is any suggestion. Please post your comments

Create a form which uploads a text document

Save the file in our system for future use. Create a model documents. We can write a seperate service which read the document and uploads word to database.

Login and register page design

Mainly we should change facebook and twitter link to image

Environment Variables

Everytime users get into development they need to setup this environment variables or it has to be part of .bashrc, need a solution to handle that with rails app itself
export CORPUS_DB=corpus_development
export CORPUS_DB_USER=
export CORPUS_DB_PASSWORD=

Pagination is not there in word list page

Add pagination gem

Create meta tags for sorkandu project

Update README file

• Contributing guidelines

Add comments widget from discuss

As we need to add comment widget to words review page. My idea is to have discuss widget. Anybody have any other suggestion ?

https://disqus.com

when you are registration, don't use your email id to register. may you can create a common account. so that others also can login.