NeuralCoref-3.0 can't load the new spacy model about neuralcoref

[Praveenabiginfo]

Why this error??

import spacy
spacy.load('en_coref_sm')
Traceback (most recent call last):
File "", line 1, in
File "/usr/local/lib/python2.7/dist-packages/spacy/init.py", line 19, in load
return util.load_model(name, **overrides)
File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 115, in load_model
return load_model_from_package(name, **overrides)
File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 138, in load_model_from_package
return cls.load(**overrides)
File "/usr/local/lib/python2.7/dist-packages/en_coref_sm/init.py", line 15, in load
coref = NeuralCoref(nlp.vocab)
File "neuralcoref.pyx", line 529, in en_coref_sm.neuralcoref.neuralcoref.NeuralCoref.init
File "doc.pyx", line 100, in spacy.tokens.doc.Doc.set_extension
AssertionError

[Praveenabiginfo]

Hi,

The issue is not related to Ubuntu it seems. I was using Python2.7 version before. I tried with Python 3.4. Now it is working fine. Is there any options to make it run on Python2.7 itself??

[thomwolf]

hi @Praveenabiginfo, can you give me some information on your setup. Are you under windows, linux or mac and which version of python / environment manager you are using ?

[Praveenabiginfo]

I am using Ubuntu 14.10. Python version is 2.7

…

On Mon, Jun 18, 2018 at 2:44 PM, thomwolf ***@***.***> wrote: hi @Praveenabiginfo <https://github.com/Praveenabiginfo>, can you give me some information on your setup. Are you under windows, linux or mac and which version of python / environment manager you are using ? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFFDNymI4-40FtNvKR7sSG669AH6Sks5t929fgaJpZM4Unsqm> .

-- Regards, Praveena .M

[theSage21]

Under neuralcoref 3.0 is from neuralcoref import Coref still working? I was reading your traceback and from there it appears that you're importing it using that statement.
@Praveenabiginfo does

import spacy
nlp = spacy.load('en_coref_sm')

solve your problem/work as expected?

[Praveenabiginfo]

With the import statement i got the below error: Traceback (most recent call last): File "/home/extraction/CoreferenceResolver.py", line 87, in <module> nlp = spacy.load('en_coref_sm') File "/usr/local/lib/python2.7/dist-packages/spacy/__init__.py", line 15, in load return util.load_model(name, **overrides) File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 114, in load_model return load_model_from_package(name, **overrides) File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 134, in load_model_from_package cls = importlib.import_module(name) File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) File "/usr/local/lib/python2.7/dist-packages/en_coref_sm-3.0.0-py2.7-linux-x86_64.egg/en_coref_sm/__init__.py", line 6, in <module> import neuralcoref File "neuralcoref.pyx", line 101, in init neuralcoref.neuralcoref TypeError: must be char, not unicode

…

On Mon, Jun 18, 2018 at 3:58 PM, Arjoonn Sharma ***@***.***> wrote: Under neuralcoref 3.0 is from neuralcoref import Coref still working? I was reading your traceback and from there it appears that you're importing it using that statement. @Praveenabiginfo <https://github.com/Praveenabiginfo> does import spacy nlp = spacy.load('en_coref_sm') solve your problem/work as expected? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFAE1wMD1vt8hknYrMhuevGLMKBR1ks5t94DmgaJpZM4Unsqm> .

-- Regards, Praveena .M

[thomwolf]

I am uploading updated versions of the models (en_coref_sm is up, the others are still currently uploading) which should work with the original readme instructions (fixed the install scripts).

[Praveenabiginfo]

I did a pip install of the downloaded new spacy model using the below command pip install en_coref_sm-3.0.0.tar.gz The console says Successfully build en-coref-sm. But I am not seeing any folder inside /usr/local/lib/python2.7/dist-packages. Why??

…

On Mon, Jun 18, 2018 at 7:05 PM, thomwolf ***@***.***> wrote: I am uploading updated versions of the models (en_coref_sm is up, the others are still currently uploading) which should work with the original readme instructions (fixed the install scripts). — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFKUzGNX3jkP5LHwNXa2YmUsgeDp7ks5t96ydgaJpZM4Unsqm> .

-- Regards, Praveena .M

[Praveenabiginfo]

Hi, I removed all my old en-coref-sm folders from /usr/local/lib/python2.7/dist-packages/ and installed the en-coref-sm freshly using the setup.py first. It creates some en-coref-sm_egg.info kind of folder only in the above location. So I removed the created folder and tried with pip install <en-coref-sm.tar.gz> file name. This says Successfully built en_coref_sm but didn't created any folders inside the mentioned path But created some folders like en_coref_sm-3.0.0-cp27-cp27mu linux_x86_64.whl in the location /home/praveena/.cache/pip/wheels/9a/a9/2e/bb66ba2c4fcc5223108cd45cfc5a98827c907e12e149d70daa. Then I extracted that one I got two folders en_coref_sm and en_coref_sm-3.0.0.dist_info. These two folders I manually copied to the location /usr/local/lib/python2.7/dist-packages/. Then I tried loading the model using the below commands even now I got the same error. What I am doing wrong??

>> import spacy >> spacy.load('en_coref_sm')

Traceback (most recent call last): File "<stdin>", line 1, in <module> File "spacy/__init__.py", line 15, in load return util.load_model(name, **overrides) File "spacy/util.py", line 114, in load_model return load_model_from_package(name, **overrides) File "spacy/util.py", line 134, in load_model_from_package cls = importlib.import_module(name) File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) File "en_coref_sm/__init__.py", line 6, in <module> from .neuralcoref import NeuralCoref File "neuralcoref.pyx", line 101, in init neuralcoref.neuralcoref TypeError: must be char, not unicode On Tue, Jun 19, 2018 at 2:10 PM, Praveena M <[email protected]> wrote:

…

I did a pip install of the downloaded new spacy model using the below command pip install en_coref_sm-3.0.0.tar.gz The console says Successfully build en-coref-sm. But I am not seeing any folder inside /usr/local/lib/python2.7/dist-packages. Why?? On Mon, Jun 18, 2018 at 7:05 PM, thomwolf ***@***.***> wrote: > I am uploading updated versions of the models (en_coref_sm is up, the > others are still currently uploading) which should work with the original > readme instructions (fixed the install scripts). > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <#48 (comment)>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/AmZmFKUzGNX3jkP5LHwNXa2YmUsgeDp7ks5t96ydgaJpZM4Unsqm> > . > -- Regards, Praveena .M

-- Regards, Praveena .M

[thomwolf]

Hi @Praveenabiginfo, I released a set of updated models just this morning. Can you try them instead of the old ones? I tested them on Python 2.7 and 3.6. See my last post in issue #47 for details.

[Praveenabiginfo]

I tried with the new model only. en_coref_sm

…

On Tue, Jun 19, 2018 at 5:41 PM, thomwolf ***@***.***> wrote: Hi @Praveenabiginfo <https://github.com/Praveenabiginfo>, I released a set of updated models just this morning. Can you try them instead of the old ones? I tested them on Python 2.7 and 3.6. See my last post in issue #47 <#47> for details. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFN30-84QM4EOQQ3V_7sZNCbfvWi6ks5t-Op2gaJpZM4Unsqm> .

-- Regards, Praveena .M

[thomwolf]

Try to download them again please (I updated them several times this morning)

[Praveenabiginfo]

I am trying in a different machine which doesn't have neuralCoref or this coref_sm before Why the below error?? x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -I/usr/include/python2.7 -I/home/yarnuser/Coref/en_coref_sm-3.0.0/include -I/usr/include/python2.7 -c en_coref_sm/neuralcoref.cpp -o build/temp.linux-x86_64-2.7/en_coref_sm/neuralcoref.o cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ en_coref_sm/neuralcoref.cpp:4:20: fatal error: Python.h: No such file or directory compilation terminated. error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

…

On Tue, Jun 19, 2018 at 5:46 PM, thomwolf ***@***.***> wrote: Try to download them again please — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFJUDqV_pTcW2bxQVgceTASl2UGv7ks5t-OuygaJpZM4Unsqm> .

-- Regards, Praveena .M

[thomwolf]

Ok I see, thanks for trying. I have to update the instal script for Ubuntu indeed.
I need to first setup an Ubuntu machine to test it.
I will come back to you when I managed to fix that.

[Praveenabiginfo]

Today I again tried in a different machine which doesn't even have the spacy.
I installed spacy and then installed spacy model "sm" and then installed this new model of coref "sm" and installed Cython and did that steps from github specified in the document. All went well. But when I tried to load the new coref model again I got the same error.. Below is that error.

import spacy
spacy.load('en_coref_sm')
Traceback (most recent call last):
File "", line 1, in
File "/usr/local/lib/python2.7/dist-packages/spacy/init.py", line 15, in load
return util.load_model(name, **overrides)
File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 114, in load_model
return load_model_from_package(name, **overrides)
File "/usr/local/lib/python2.7/dist-packages/spacy/util.py", line 134, in load_model_from_package
cls = importlib.import_module(name)
File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module
import(name)
File "/usr/local/lib/python2.7/dist-packages/en_coref_sm/init.py", line 6, in
from en_coref_sm.neuralcoref import NeuralCoref
File "/usr/local/lib/python2.7/dist-packages/en_coref_sm/neuralcoref/init.py", line 1, in
from .neuralcoref import NeuralCoref
File "neuralcoref.pyx", line 101, in init en_coref_sm.neuralcoref.neuralcoref
TypeError: must be char, not unicode

[thomwolf]

Well it is working on my mac (OS Sierra) on Python 2.7 so I am a bit puzzled.
Can you try installing a full clean version with

pip install --upgrade --force-reinstall --no-cache-dir MODEL_URL

[Praveenabiginfo]

Okay Let me try!!

…

On Thu, Jun 28, 2018 at 12:39 PM, thomwolf ***@***.***> wrote: Well it is working on my mac (OS Sierra) on Python 2.7 so I am a bit puzzled. Can you try installing a full clean version with pip install --upgrade --force-reinstall --no-cache-dir MODEL_URL — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#48 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AmZmFGTO-hpualeZX0dsjYslJIH7Omwyks5uBIEXgaJpZM4Unsqm> .

-- Regards, Praveena .M

[Praveenabiginfo]

Same error only I got again On Thu, Jun 28, 2018 at 12:55 PM, Praveena M <[email protected]> wrote:

…

Okay Let me try!! On Thu, Jun 28, 2018 at 12:39 PM, thomwolf ***@***.***> wrote: > Well it is working on my mac (OS Sierra) on Python 2.7 so I am a bit > puzzled. > Can you try installing a full clean version with > > pip install --upgrade --force-reinstall --no-cache-dir MODEL_URL > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <#48 (comment)>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/AmZmFGTO-hpualeZX0dsjYslJIH7Omwyks5uBIEXgaJpZM4Unsqm> > . > -- Regards, Praveena .M

-- Regards, Praveena .M

[gonz]

I'm also having this issue, I'm using python 2.7.6 on a Ubuntu 14.04.

This is the full traceback:

In [1]: import spacy; spacy.load('en_coref_sm')
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-1-bd9aa5b27231> in <module>()
----> 1 import spacy; spacy.load('en_coref_sm')

/home/ubuntu/.virtualenvs/apex/local/lib/python2.7/site-packages/spacy/__init__.pyc in load(name, **overrides)
     13     if depr_path not in (True, False, None):
     14         deprecation_warning(Warnings.W001.format(path=depr_path))
---> 15     return util.load_model(name, **overrides)
     16
     17

/home/ubuntu/.virtualenvs/apex/local/lib/python2.7/site-packages/spacy/util.pyc in load_model(name, **overrides)
    112             return load_model_from_link(name, **overrides)
    113         if is_package(name):  # installed as package
--> 114             return load_model_from_package(name, **overrides)
    115         if Path(name).exists():  # path to model data directory
    116             return load_model_from_path(Path(name), **overrides)

/home/ubuntu/.virtualenvs/apex/local/lib/python2.7/site-packages/spacy/util.pyc in load_model_from_package(name, **overrides)
    132 def load_model_from_package(name, **overrides):
    133     """Load a model from an installed package."""
--> 134     cls = importlib.import_module(name)
    135     return cls.load(**overrides)
    136

/usr/lib/python2.7/importlib/__init__.pyc in import_module(name, package)
     35             level += 1
     36         name = _resolve_name(name[level:], package, level)
---> 37     __import__(name)
     38     return sys.modules[name]

/home/ubuntu/.virtualenvs/apex/local/lib/python2.7/site-packages/en_coref_sm/__init__.py in <module>()
      4 from pathlib import Path
      5 from spacy.util import load_model_from_init_py, get_model_meta
----> 6 from en_coref_sm.neuralcoref import NeuralCoref
      7
      8 __version__ = get_model_meta(Path(__file__).parent)['version']

/home/ubuntu/.virtualenvs/apex/local/lib/python2.7/site-packages/en_coref_sm/neuralcoref/__init__.py in <module>()
----> 1 from .neuralcoref import NeuralCoref

neuralcoref.pyx in init en_coref_sm.neuralcoref.neuralcoref()

TypeError: must be char, not unicode

Initially I hit the AssertionError @Praveenabiginfo mentioned on Jun 27th, I fixed that by upgrading spacy from 2.0.7 to 2.0.12. Now I'm stuck with this TypeError when loading the model from spacy.

[thomwolf]

This should be fixed in the latest release (4.0).

[saurabhhssaurabh]

Facing same iussue:
neuralcoref 4.0
spacy 2.1.0

/data/saurabh/neuralcoref/neuralcoref/init.py in ()
12 warnings.filterwarnings("ignore", message="spacy.strings.StringStore size changed")
13
---> 14 from .neuralcoref import NeuralCoref
15 from .file_utils import NEURALCOREF_MODEL_URL, NEURALCOREF_MODEL_PATH, NEURALCOREF_CACHE, cached_path
16

neuralcoref.pyx in init neuralcoref.neuralcoref()

TypeError: must be char, not unicode