kpsychas / word_etymologist Goto Github PK
View Code? Open in Web Editor NEWClassifier of words based on their origin
License: MIT License
Classifier of words based on their origin
License: MIT License
The output of NN is a sequence of classification labels, here True, False,
but it is unlikely if at all possible to have only a single or even just two letter in a row
classified as True/False and the rest of the letters being classified the opposite.
There is need of a function that can even be thought as an extra layer that makes
output "smoother".
A smoother output satisfies the following requirements.
n
and a classifications sequence S
,n
that contains the label and every label in the subsequence isn
, all labels in output sequenceThe project currently skips words that are invalid without printing details about the Error.
Better error handling should include:
Add an option to train the network over the whole dataset one or more times.
Currently words are picked randomly and some words may never be picked.
The name of annotated word file should be a parameter of train.py
script.
Optional extra features
The following project can be a starting point.
This can be a separate script that prompts used to input a word and optionally what its expected output is.
The model should respond with the predicted output.
Bonus:
Keep a history of training inputs and allow user to reuse them.
Currently words are offered to the network one by one. A better framework would allow multiple words to be trained at the same time. To do that we either need to pad all words in a batch to have the same size, or group words by length and sample words from one group at a time to make a batch.
Even though I have not found explicit support from libraries, such a model should be possible.
A place to start is the following publication
https://www.researchgate.net/publication/3316656_Bidirectional_recurrent_neural_networks
Minimum requirement is to be able to train and evaluate a model without extra arguments.
That means the following sequence of commands should run without errors.
python train.py --program 1
python train.py --program 2
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.