Training on Windows returns error at DFfeatureselect.py step about langid.py

[jd-coderepos]

Hello,

Sharing my workaround to this problem here. The problem is related to this StackOverflow question: https://stackoverflow.com/questions/3249822/python-2-6-4-marshal-load-doesnt-accept-open-file-objects-made-with-subprocess

In the file common.py, I changed the 'unmarshal_iter' function as below:

def unmarshal_iter(path):
  tmpfolder = tempfile.mkdtemp()
  try:
      tmpfile = os.path.join(tmpfolder, "temp")
      with open(tmpfile, "wb") as binfile:
          binfile.write(gzip.open(path, 'rb').read())

      with open(tmpfile, "rb") as binfile:
          while True:
              try:
                  yield marshal.load(binfile)
              except EOFError:
                  break
  finally:
      if tmpfolder and os.path.isdir(tmpfolder):
          shutil.rmtree(tmpfolder)

Also, I'm using python version 2.7.3 to run the program.

Best.

[zq2017]

Hello, I met the same problem as you. Have you solved this problem? Can you give me some solutions? Thank you so much!

[zq2017]

@saffsd Dear Marco, can you give me some solutions? Thank you so much!

[antoniogois]

@jenlindadsouza thanks for your tip! Don't forget to also add "import shutil" to the beginning of common.py

And one more thing, in case anyone else has an error in "NBtrain.py", line 256: What I did was change line 257
except NameError:
by
except:

I think some exception that was supposed to be ignored has a different name now, so with my change all exceptions are ignored here. I'm not sure about this fix, but it seems to be working. (at first this seemed like a windows path issue [using / instead of \] but I had this problem both on windows and linux)

EDIT: forget about this exception thing, all predictions are going crazy... There's probably a real problem behind the exception being thrown, I can't find it right now