GithubHelp home page GithubHelp logo

abadcandy / baidubigdata19-urfc Goto Github PK

View Code? Open in Web Editor NEW
78.0 4.0 20.0 223 KB

my solution with 0.67 accuracy

Home Page: https://dianshi.baidu.com/competition/30/rule?fr=bnr

Python 100.00%
pytorch deep-learning computer-vision multimodal-learning

baidubigdata19-urfc's Issues

模型下载错误

----------------------------------------------- [START 2019-10-29 19:04:31] ---------------------------------------------------

                       |------------ Train -------|----------- Valid ---------|----------Best Results---|------------|

mode iter epoch | acc loss f1_macro | acc loss f1_macro | loss f1_macro | time |
-------------------------------------------------------------------------------------------------------------------------|
Downloading: "http://data.lip6.fr/cadene/pretrainedmodels/se_resnext101_32x4d-3b2fe3d8.pth" to /Users/didi/.cache/torch/checkpoints/se_resnext101_32x4d-3b2fe3d8.pth
5%|▍ | 9289184/196466866 [01:32<31:04, 100393.23it/s]
Traceback (most recent call last):
File "/Users/didi/Desktop/git/BaiDuBigData19-URFC/multimain.py", line 249, in
main()
File "/Users/didi/Desktop/git/BaiDuBigData19-URFC/multimain.py", line 164, in main
model=MultiModalNet("se_resnext101_32x4d","dpn26",0.5)
File "/Users/didi/Desktop/git/BaiDuBigData19-URFC/multimodal.py", line 248, in init
img_model = pretrainedmodels.dict[backbone1](num_classes=1000, pretrained='imagenet') #seresnext101
File "/anaconda3/lib/python3.7/site-packages/pretrainedmodels/models/senet.py", line 441, in se_resnext101_32x4d
initialize_pretrained_model(model, num_classes, settings)
File "/anaconda3/lib/python3.7/site-packages/pretrainedmodels/models/senet.py", line 373, in initialize_pretrained_model
model.load_state_dict(model_zoo.load_url(settings['url']))
File "/anaconda3/lib/python3.7/site-packages/torch/hub.py", line 433, in load_state_dict_from_url
_download_url_to_file(url, cached_file, hash_prefix, progress=progress)
File "/anaconda3/lib/python3.7/site-packages/torch/hub.py", line 377, in _download_url_to_file
.format(hash_prefix, digest))
RuntimeError: invalid hash value (expected "3b2fe3d8", got "200fdf586d5c96a4798edb0700a486d14fc0578cf94d91ebe44af17c89853475")

help

大神,我比较关注数据预处理部分,请问预处理(去全黑、全白等)部分在哪个代码文件里呀?

链接失效了

您好~ 这个百度云盘链接失效了。能否再附一个分享链接呢? 感谢:)

中断后继续训练

你好,想请教您训练过程中暂定后如何继续训练。
Traceback (most recent call last):
File "multimain.py", line 249, in
main()
File "multimain.py", line 178, in main
checkpoint = torch.load(r'./checkpoints/best_models/seresnext101_dpn92_defrog_multimodal_fold_0_model_best_loss.pth.tar')
File "/home/moer/anaconda3/lib/python3.7/site-packages/torch/serialization.py", line 366, in load
f = open(f, 'rb')
FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/best_models/seresnext101_dpn92_defrog_multimodal_fold_0_model_best_loss.pth.tar'

运行环境

报错的库imgaug==0.2.8,torch==1.1.0,我使用的是3.7,运行的时候,不支持。请问您的具体的运行环境?

具体报错如下:
Traceback (most recent call last):
File "multimain.py", line 249, in
main()
File "multimain.py", line 212, in main
train_metrics = train(train_loader,model,criterion,optimizer,epoch,val_metrics,best_results,start)
File "multimain.py", line 56, in train
for i,(images,visit,target) in enumerate(train_loader):
File "D:\computer_language\anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 582, in next
return self._process_next_batch(batch)
File "D:\computer_language\anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 608, in _process_next_batch
raise batch.exc_type(batch.exc_msg)
AttributeError: Traceback (most recent call last):
File "D:\computer_language\anaconda3\lib\site-packages\torch\utils\data_utils\worker.py", line 99, in _worker_loop
samples = collate_fn([dataset[i] for i in batch_indices])
File "D:\computer_language\anaconda3\lib\site-packages\torch\utils\data_utils\worker.py", line 99, in
samples = collate_fn([dataset[i] for i in batch_indices])
File "E:\大数据\2019大数据竞赛初赛数据集\BaiDuBigData19-URFC-master\multimodal.py", line 62, in getitem
X = self.augumentor(X)
File "E:\大数据\2019大数据竞赛初赛数据集\BaiDuBigData19-URFC-master\multimodal.py", line 99, in augumentor
image_aug = augment_img.augment_image(image)
File "D:\computer_language\anaconda3\lib\site-packages\imgaug\augmenters\meta.py", line 405, in augment_image
ia.do_assert(image.ndim in [2, 3],
AttributeError: 'NoneType' object has no attribute 'ndim'

My Computer went dead.

help !!!!
thinks for your kernnal, but...
My computer has a gpu GTX950m with a 4g memory, with the batchsize of 8(16+ dead in the beginning),when I finished the first epoch, it did not respond............

and the training errror was less than 0.5...
I am hungry...

运行报错

Traceback (most recent call last):
File "multimain.py", line 249, in
main()
File "multimain.py", line 212, in main
train_metrics = train(train_loader,model,criterion,optimizer,epoch,val_metrics,best_results,start)
File "multimain.py", line 62, in train
output = model(images,visit)
File "/home/csu/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in call
result = self.forward(*input, **kwargs)
File "/media/csu/新加卷/AI Competition/Competition/一带一路国际大数据竞赛/初赛赛题/方案二/multimodal.py", line 275, in forward
x_vis=self.visit_model(x_vis)
File "/home/csu/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in call
result = self.forward(*input, **kwargs)
File "/media/csu/新加卷/AI Competition/Competition/一带一路国际大数据竞赛/初赛赛题/方案二/multimodal.py", line 218, in forward
out = F.avg_pool2d(out, 4)
RuntimeError: Given input size: (2432x4x3). Calculated output size: (2432x1x0). Output size is too small at /pytorch/aten/src/THCUNN/generic/SpatialAveragePooling.cu:63
This problem has confused me for a few days,I hope you can offer me a solution to this problem,thanks a lot.

没有参数属性

AttributeError: 'collections.OrderedDict' object has no attribute 'parameters'

Main error

I get error like this when run multimain:
TypeError: new() received an invalid combination of arguments - got (float, int, int, int), but expected one of:

  • (torch.device device)
  • (torch.Storage storage)
  • (Tensor other)
  • (tuple of ints size, torch.device device)
  • (object data, torch.device device)

My pthon version is 2.7 and torch is 1.1..0. And I don't know why? Can you answer it, and thank you very much.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.