Comments (14)
Just tried running it on multiple instances, it works amazing. Thanks @thomwolf
from neuralcoref.
Hi @Nbharath all the credit goes to @thomwolf 👏
We haven't published the training workflow yet but it is coming in couple of weeks.
from neuralcoref.
As for the resolution time, I'll let Thomas pitch in!
from neuralcoref.
Hi @Nbharath,
- I am currently cleaning up the pyTorch code and taking the occasion to refine a bit the mention detection algorithm. I will publish the code as soon as possible.
- Right now the library uses numpy to compute the matrix multiplication so it can't make use of the GPU. To put it on GPU we would also have to refactor a bit the workflow to parallelize the computation of pair scores. We use it for very small files (dialog) so it is not in my top priority list but if you feel like trying, you are more than welcome ! (maybe using something like cupy would be the simplest way)
from neuralcoref.
Hello Thomas,
Is the pyTorch code published now ? Will the pyTorch code help to reduce the coreference resolution processing speed if executed on GPU ?
Regards,
Lavina
from neuralcoref.
Hello
First of all, thanks for the nice library.
The time taken is very long for an average size content. The number of mentions detected are more and we cut short some of the accepted entities and some grammar rules but still the time is too long.
Any tips on how can we reduce it? Please let know.
from neuralcoref.
from neuralcoref.
Glad to know. I will keep waiting then. :)
from neuralcoref.
Is there a new ETA for the cython rewrite?
from neuralcoref.
Yes, it should be this week, the code pretty much ready (see extension branch), I just have to finish a few edge cases and functions and write the doc (it's now integrated as a spaCy extension so the interface is a bit different). It'll be 50 to 100 times faster on a large doc.
from neuralcoref.
any way we can help out?
from neuralcoref.
@thomwolf when the Cython version will be released?
from neuralcoref.
It is released! I have updated the readme!
from neuralcoref.
from neuralcoref.
Related Issues (20)
- Wrong average embedding during inference due to a small bug in neuracoref.pyx
- Missing implementation of doc embeddings during inference
- Wrong Mention Type one-hot vectors during training due to a small bug in dataset.py
- Training Dataset Format
- Can't install neuralcoref, keep getting this error: C:\\Program Files (x86)\\Microsoft Visual Studio\\2019\\BuildTools\\VC\\Tools\\MSVC\\14.29.30133\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2 HOT 4
- Error in training without changing anything from the default instructions
- GPU support - cuda 11.1 - TypeError: Unsupported type <class 'numpy.ndarray'>
- (base) C:\Users\sk136\neuralcoref>python -m neuralcoref.train.learn --train ./data/train/ --eval ./data/dev/ facing problem while executing.. this command HOT 1
- Results completely differ from web-demo
- Compatibility with Spacy 3+ HOT 7
- Regarding finetuning neuralcoref
- dels HOT 1
- neuralcoref not supporting python 3.9 version HOT 1
- spacy.strings.StringStore size changed, may indicate binary incompatibility HOT 5
- Dependency Problem HOT 1
- I can't install neuralcoref HOT 8
- Unresolved dependencies?
- Kernel crashes when trying to run demo code HOT 1
- Process finished with exit code -1073741819 (0xC0000005)
- installation failed with HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from neuralcoref.