practicingman / chinese_ulmfit Goto Github PK

(.venv) ub16c9@ub16c9-gpu:/ub16_prj/chinese_ulmfit$ python3.6 pretraining.py --input_file=tmp/wiki2018-11-14.ids.npy --mapping_file=tmp/wiki2018-11-14.mapping.pkl --dir_path=tmp
Traceback (most recent call last):
File "pretraining.py", line 2, in
from fastai.text import *
File "/home/ub16c9/ub16_prj/chinese_ulmfit/.venv/lib/python3.6/site-packages/fastai/text.py", line 1, in
from .core import *
File "/home/ub16c9/ub16_prj/chinese_ulmfit/.venv/lib/python3.6/site-packages/fastai/core.py", line 1, in
from .imports import *
File "/home/ub16c9/ub16_prj/chinese_ulmfit/.venv/lib/python3.6/site-packages/fastai/imports.py", line 2, in
import PIL, os, numpy as np, math, collections, threading, json, bcolz, random, scipy, cv2
File "/home/ub16c9/ub16_prj/chinese_ulmfit/.venv/lib/python3.6/site-packages/bcolz/init.py", line 76, in
from bcolz.carray_ext import (
File "init.pxd", line 885, in init bcolz.carray_ext
ValueError: numpy.ufunc has the wrong size, try recompiling. Expected 192, got 216
(.venv) ub16c9@ub16c9-gpu:/ub16_prj/chinese_ulmfit$

想问下你的这个领域语料使用的什么

单卡预训练1.5G左右的wiki语料大约需要三天半，能不能使用多卡？

Read timed out. 如何解决

微调一步报错：
File "finetuning.py", line 4, in
from fastai.lm_rnn import *
ModuleNotFoundError: No module named 'fastai.lm_rnn'
有什么解决办法吗？

In finetuning, I met the above error, can someone help me?

ub16c9@ub16c9-gpu:/ub16_prj/chinese_ulmfit$ python3.6 pretraining.py --input_file=tmp/wiki2018-11-14.ids.npy --mapping_file=tmp/wiki2018-11-14.mapping.pkl --dir_path=tmp
Traceback (most recent call last):
File "pretraining.py", line 3, in
from helper import *
File "/home/ub16c9/ub16_prj/chinese_ulmfit/helper.py", line 1, in
from fastai.learner import *
ModuleNotFoundError: No module named 'fastai.learner'
ub16c9@ub16c9-gpu:/ub16_prj/chinese_ulmfit$

没找到情感分析的说明文档，有朋友回答下吗？非常感谢。

python3 train_classifier.py --id_file=tmp/ch_auto.ids.npy --label_file=tmp/ch_auto.labels.npy --mapping_file=tmp/ch_auto.mapping.pkl --encoder_file=ch_auto_enc
请问这一步中的--encoder_file=ch_auto_enc是哪一步输出的呢？