Comments (10)
shaohua0116
commented on August 29, 2024
1
This means that it cannot find the checkpoint that you are trying to load. Based on your command
python trainer.py --batch_size 4 --dataset kitti --num_input 4 --checkpoint ～/Checkpoints_KITTI/model-1
Maybe you wrongly specified the path with a wrong character ～ which should be ~.
from multiview2novelview.
shaohua0116
commented on August 29, 2024
1
If you load a checkpoint, you will be just fine-tuning a trained model. If you train it from scratch, it will take roughly two or three days if I remember it correctly.
from multiview2novelview.
shaohua0116
commented on August 29, 2024
Have you downloaded the kitti dataset and put the hdf5 file under ./datasets/kitt?
from multiview2novelview.
ehabhelmy82
commented on August 29, 2024
yes
Here is the complete path for it:
/data/ehab/datasets/kitti/data_kitti.hdf5
from multiview2novelview.
shaohua0116
commented on August 29, 2024
The path does not look right to me. It should be something like Multiview2Novelview/datasets/kitti/data_kitti.hdf5.
from multiview2novelview.
ehabhelmy82
commented on August 29, 2024
Thanks I adjusted the path and works but give me this error. Could kindly help
name: TITAN Xp
major: 6 minor: 1 memoryClockRate (GHz) 1.582
pciBusID 0000:85:00.0
Total memory: 11.91GiB
Free memory: 11.74GiB
2019-03-12 21:25:07.190476: W tensorflow/stream_executor/cuda/cuda_driver.cc:523] A non-primary context 0x21209160 exists before initializing the StreamExecutor. We haven't verified StreamExecutor works with that.
2019-03-12 21:25:07.191860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:955] Found device 6 with properties:
name: TITAN Xp
major: 6 minor: 1 memoryClockRate (GHz) 1.582
pciBusID 0000:88:00.0
Total memory: 11.91GiB
Free memory: 11.74GiB
2019-03-12 21:25:07.493851: W tensorflow/stream_executor/cuda/cuda_driver.cc:523] A non-primary context 0x252e9f40 exists before initializing the StreamExecutor. We haven't verified StreamExecutor works with that.
2019-03-12 21:25:07.495212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:955] Found device 7 with properties:
name: TITAN Xp
major: 6 minor: 1 memoryClockRate (GHz) 1.582
pciBusID 0000:89:00.0
Total memory: 11.91GiB
Free memory: 11.74GiB
2019-03-12 21:25:07.499532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 0 and 4
2019-03-12 21:25:07.499578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 0 and 5
2019-03-12 21:25:07.499605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 0 and 6
2019-03-12 21:25:07.499626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 0 and 7
2019-03-12 21:25:07.501660: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 1 and 4
2019-03-12 21:25:07.501697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 1 and 5
2019-03-12 21:25:07.501720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 1 and 6
2019-03-12 21:25:07.501741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 1 and 7
2019-03-12 21:25:07.502825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 2 and 4
2019-03-12 21:25:07.502859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 2 and 5
2019-03-12 21:25:07.502882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 2 and 6
2019-03-12 21:25:07.502904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 2 and 7
2019-03-12 21:25:07.503006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 3 and 4
2019-03-12 21:25:07.503031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 3 and 5
2019-03-12 21:25:07.503052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 3 and 6
2019-03-12 21:25:07.503073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 3 and 7
2019-03-12 21:25:07.503163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 4 and 0
2019-03-12 21:25:07.503184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 4 and 1
2019-03-12 21:25:07.503208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 4 and 2
2019-03-12 21:25:07.503228: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 4 and 3
2019-03-12 21:25:07.506197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 5 and 0
2019-03-12 21:25:07.506233: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 5 and 1
2019-03-12 21:25:07.506256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 5 and 2
2019-03-12 21:25:07.506278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 5 and 3
2019-03-12 21:25:07.508582: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 6 and 0
2019-03-12 21:25:07.508620: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 6 and 1
2019-03-12 21:25:07.508643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 6 and 2
2019-03-12 21:25:07.508665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 6 and 3
2019-03-12 21:25:07.509717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 7 and 0
2019-03-12 21:25:07.509755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 7 and 1
2019-03-12 21:25:07.509780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 7 and 2
2019-03-12 21:25:07.509812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:847] Peer access not supported between device ordinals 7 and 3
2019-03-12 21:25:07.510312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:976] DMA: 0 1 2 3 4 5 6 7
2019-03-12 21:25:07.510332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 0: Y Y Y Y N N N N
2019-03-12 21:25:07.510343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 1: Y Y Y Y N N N N
2019-03-12 21:25:07.510353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 2: Y Y Y Y N N N N
2019-03-12 21:25:07.510363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 3: Y Y Y Y N N N N
2019-03-12 21:25:07.510372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 4: N N N N Y Y Y Y
2019-03-12 21:25:07.510383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 5: N N N N Y Y Y Y
2019-03-12 21:25:07.510393: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 6: N N N N Y Y Y Y
2019-03-12 21:25:07.510402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:986] 7: N N N N Y Y Y Y
2019-03-12 21:25:07.510430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:0) -> (device: 0, name: TITAN Xp, pci bus id: 0000:04:00.0)
2019-03-12 21:25:07.510486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:1) -> (device: 1, name: TITAN Xp, pci bus id: 0000:05:00.0)
2019-03-12 21:25:07.510498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:2) -> (device: 2, name: TITAN Xp, pci bus id: 0000:08:00.0)
2019-03-12 21:25:07.510508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:3) -> (device: 3, name: TITAN Xp, pci bus id: 0000:09:00.0)
2019-03-12 21:25:07.510519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:4) -> (device: 4, name: TITAN Xp, pci bus id: 0000:84:00.0)
2019-03-12 21:25:07.510530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:5) -> (device: 5, name: TITAN Xp, pci bus id: 0000:85:00.0)
2019-03-12 21:25:07.510540: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:6) -> (device: 6, name: TITAN Xp, pci bus id: 0000:88:00.0)
2019-03-12 21:25:07.510551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1045] Creating TensorFlow device (/gpu:7) -> (device: 7, name: TITAN Xp, pci bus id: 0000:89:00.0)
[2019-03-12 21:25:30,201] Checkpoint path: ～/Checkpoints_KITTI/model-1
2019-03-12 21:25:31.450244: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450293: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450269: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450336: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450405: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450366: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450443: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450538: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450554: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450609: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450674: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450703: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450764: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450768: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450856: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450914: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.450997: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451015: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451066: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451140: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451173: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451225: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451231: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451240: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451320: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451341: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451390: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451430: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451482: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451482: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451530: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451602: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451647: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451718: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451735: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451872: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451903: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451926: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.451908: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452003: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452045: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452123: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452194: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452231: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452302: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452320: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452385: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452448: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452457: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452486: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452528: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452553: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452540: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452614: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452634: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452719: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452738: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452803: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452864: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452889: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452902: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.452975: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453042: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453069: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453115: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453151: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453131: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453193: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453226: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453272: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453307: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453356: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453366: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453324: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453433: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453469: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453517: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453555: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453596: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453610: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453688: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453761: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453852: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453919: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453991: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.453999: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454079: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454145: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454156: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454233: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454301: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454375: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454447: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454513: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454572: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454639: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454700: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
2019-03-12 21:25:31.454782: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Unsuccessful TensorSliceReader constructor: Failed to get matching files on ～/Checkpoints_KITTI/model-1: Not found: ～/Checkpoints_KITTI
Traceback (most recent call last):
File "trainer.py", line 380, in
main()
File "trainer.py", line 374, in main
trainer = Trainer(config, dataset_train, dataset_test)
File "trainer.py", line 145, in init
self.pretrain_saver.restore(self.session, self.ckpt_path, )
File "/usr/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1560, in restore
{self.saver_def.filename_tensor_name: save_path})
File "/usr/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 895, in run
run_metadata_ptr)
File "/usr/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1124, in _run
feed_dict_tensor, options, run_metadata)
File "/usr/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1321, in _do_run
options, run_metadata)
File "/usr/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1340, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError
2019-03-12 21:25:32.578456: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.579132: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.581547: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'concatenate'
2019-03-12 21:25:32.582017: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.582920: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.583937: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.584714: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.585524: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.586826: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.587402: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.588030: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.589497: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.590382: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.591985: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.593222: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.594415: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'concatenate'
2019-03-12 21:25:32.595946: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.596414: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.597443: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.597905: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.599398: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.600559: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'concatenate'
2019-03-12 21:25:32.601764: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.602350: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'expand_dims'
2019-03-12 21:25:32.603205: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.603496: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'CSET_ASCII'
2019-03-12 21:25:32.604154: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: exceptions.TypeError: bad operand type for unary -: 'NoneType'
2019-03-12 21:25:32.604682: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
2019-03-12 21:25:32.605470: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
Exception in thread Thread-2 (most likely raised during interpreter shutdown):Exception in thread Thread-25 (most likely raised during interpreter shutdown):Exception in thread Thread-15 (most likely raised during interpreter shutdown):
2019-03-12 21:25:32.651757: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'NULL'
2019-03-12 21:25:32.652504: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'Reference'
Traceback (most recent call last):
Traceback (most recent call last):
Exception in thread Thread-11 (most likely raised during interpreter shutdown):Exception in thread Thread-26 (most likely raised during interpreter shutdown): File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner
2019-03-12 21:25:32.653426: W tensorflow/core/framework/op_kernel.cc:1192] Unknown: exceptions.AttributeError: 'NoneType' object has no attribute 'NULL'
File "/usr/lib/python2.7/site-packages/tensorflow/python/training/coordinator.py", line 495, in run
File "/usr/lib64/python2.7/contextlib.py", line 50, in exit
from multiview2novelview.
ehabhelmy82
commented on August 29, 2024
Many thanks
How many hours is it expected to take for training?
from multiview2novelview.
ehabhelmy82
commented on August 29, 2024
Many Thanks
from multiview2novelview.
ehabhelmy82
commented on August 29, 2024
What is the specefication of your machine?
from multiview2novelview.
shaohua0116
commented on August 29, 2024
I used a 40 core machine with 4 Titan Xp but I only used a single GPU for each training.
from multiview2novelview.
Related Issues (20)
- Supplementary material? HOT 2
- About Flow module HOT 8
- implementation of residual block HOT 1
- trainning problem HOT 2
- Aggregate output
- Evaluate model from checkpoints HOT 3
- The poses in the KITTI dataset
- something about normalization HOT 3
- About quantitative indicators and visualization results HOT 1
- The number of source images & tensorboard images
- Performance issue in the definition of build_loss, model.py(P1) HOT 1
- Sharing the scripts to make hdf5 file for custom dataset HOT 4
- Can anyone tell me how much training time is needed after running the trainer.py script? I have a NVIDIA RTX A6000 GPU.
- load kitti checkpoint failed HOT 4
- Per-pixel confidence loss question HOT 1
- about training steps HOT 7
- About your code HOT 1
- Foreground Mask HOT 4
- Batch Normalization HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from multiview2novelview.