Comments (10)
Actually, i use it always on Windows without any issues
python 3.5.4
tensorflow_1.3.0
numpy-1.13.1+mkl
from srgan-tensorflow.
I didn't test it on Windows because the compatibility of tensorflow on windows is not good at the time when I completed the project. If you use VirtualBox, I think it will work under Ubuntu 16.04.
from srgan-tensorflow.
@ABDOELSHEMY Thank you very much, I install from the beginning, and it works!
But... It's quite slow, maybe it only uses CPU. What if I'm gonna use it with GPU (I have GTX1050 So I wanna use it). Can you tell me how to set up, install, or prepare any settings or software to make this program can run on GPU?
from srgan-tensorflow.
to use it with GPU, just uninstall (tensorflow_1.3.0) and install (tensorflow_1.3.0 -gpu) version, and it always run using you gpu.
from srgan-tensorflow.
@ABDOELSHEMY I uninstall tensorflow and install tensorflow-gpu as you said. I also check if there's CUDA toolkit 8.0 and CuDNN v6.0 DLL present. This is its output.
Traceback (most recent call last):
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 18, in swig_import_helper
return importlib.import_module(mname)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 985, in _gcd_import
File "<frozen importlib._bootstrap>", line 968, in _find_and_load
File "<frozen importlib._bootstrap>", line 957, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
File "<frozen importlib._bootstrap>", line 577, in module_from_spec
File "<frozen importlib._bootstrap_external>", line 938, in create_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
ImportError: DLL load failed: The specified module could not be found.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 41, in <module>
from tensorflow.python.pywrap_tensorflow_internal import *
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 21, in <module>
_pywrap_tensorflow_internal = swig_import_helper()
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 20, in swig_import_helper
return importlib.import_module('_pywrap_tensorflow_internal')
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ImportError: No module named '_pywrap_tensorflow_internal'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "main.py", line 5, in <module>
import tensorflow as tf
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\__init__.py", line 24, in <module>
from tensorflow.python import *
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\__init__.py", line 49, in <module>
from tensorflow.python import pywrap_tensorflow
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 52, in <module>
raise ImportError(msg)
ImportError: Traceback (most recent call last):
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 18, in swig_import_helper
return importlib.import_module(mname)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 985, in _gcd_import
File "<frozen importlib._bootstrap>", line 968, in _find_and_load
File "<frozen importlib._bootstrap>", line 957, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
File "<frozen importlib._bootstrap>", line 577, in module_from_spec
File "<frozen importlib._bootstrap_external>", line 938, in create_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
ImportError: DLL load failed: The specified module could not be found.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 41, in <module>
from tensorflow.python.pywrap_tensorflow_internal import *
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 21, in <module>
_pywrap_tensorflow_internal = swig_import_helper()
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 20, in swig_import_helper
return importlib.import_module('_pywrap_tensorflow_internal')
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ImportError: No module named '_pywrap_tensorflow_internal'
Failed to load the native TensorFlow runtime.
See https://www.tensorflow.org/install/install_sources#common_installation_problems
for some common reasons and solutions. Include the entire stack trace
above this error message when asking for help.
from srgan-tensorflow.
seem like you don not add path for CuDNN on environment variables, make sure to add path for CuDNN to the system path first.
then make sure that Microsoft Visual C++ 2015 Redistributable Update 3 installed
https://www.microsoft.com/en-us/download/details.aspx?id=53587
from srgan-tensorflow.
Yes, it works. I can process small images now.
But here comes the next problem, If I want to enlarge a bigger picture, It cannot. Even the picture is just 320x240 pixels. This is its output, too long because I don't know where are the important parts.
[Configurations]:
summary_dir: ./result/log/
stair: False
mode: inference
random_crop: True
max_epoch: None
name_queue_capacity: 2048
ratio: 0.001000
perceptual_mode: VGG54
decay_rate: 0.100000
decay_step: 500000
pre_trained_model_type: SRResnet
is_training: False
vgg_ckpt: ./vgg19/vgg_19.ckpt
flip: True
summary_freq: 100
pre_trained_model: True
output_dir: ./result/
num_resblock: 16
task: SRGAN
input_dir_HR: None
queue_thread: 10
learning_rate: 0.000100
input_dir_LR: ./data/test_LR/
checkpoint: ./SRGAN_pre-trained/model-200000
beta: 0.900000
batch_size: 16
EPS: 0.000000
max_iter: 1000000
crop_size: 24
image_queue_capacity: 2048
display_freq: 20
save_freq: 10000
vgg_scaling: 0.006100
End of configuration
Finish building the network
2017-12-08 21:21:19.940101: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\platform\cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
2017-12-08 21:21:19.940182: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\platform\cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these are available on your machine and could speed up CPU computations.
2017-12-08 21:21:20.256435: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\gpu\gpu_device.cc:955] Found device 0 with properties:
name: GeForce GTX 1050
major: 6 minor: 1 memoryClockRate (GHz) 1.468
pciBusID 0000:01:00.0
Total memory: 2.00GiB
Free memory: 1.62GiB
2017-12-08 21:21:20.256539: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\gpu\gpu_device.cc:976] DMA: 0
2017-12-08 21:21:20.258208: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\gpu\gpu_device.cc:986] 0: Y
2017-12-08 21:21:20.258628: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\gpu\gpu_device.cc:1045] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX 1050, pci bus id: 0000:01:00.0)
Loading weights from the pre-trained model
Evaluation starts!!
2017-12-08 21:21:24.175293: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:217] Allocator (GPU_0_bfc) ran out of memory trying to allocate 675.00MiB. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory is available.
2017-12-08 21:21:25.236154: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:217] Allocator (GPU_0_bfc) ran out of memory trying to allocate 675.00MiB. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory is available.
2017-12-08 21:21:38.110621: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:273] Allocator (GPU_0_bfc) ran out of memory trying to allocate 300.00MiB. Current allocation summary follows.
2017-12-08 21:21:38.111394: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (256): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.113156: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (512): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.113580: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (1024): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.114034: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (2048): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.114790: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (4096): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.114988: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (8192): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.115291: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (16384): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.115878: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (32768): Total Chunks: 1, Chunks in use: 0 54.5KiB allocated for chunks. 512B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.116038: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (65536): Total Chunks: 1, Chunks in use: 0 83.0KiB allocated for chunks. 60.8KiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.116329: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (131072): Total Chunks: 1, Chunks in use: 0 144.0KiB allocated for chunks. 144.0KiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.116628: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (262144): Total Chunks: 1, Chunks in use: 0 288.0KiB allocated for chunks. 256.0KiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.116890: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (524288): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.117146: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (1048576): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.117429: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (2097152): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.117704: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (4194304): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.117974: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (8388608): Total Chunks: 1, Chunks in use: 0 8.00MiB allocated for chunks. 4.69MiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.118215: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (16777216): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.118489: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (33554432): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.118736: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (67108864): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.119040: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (134217728): Total Chunks: 3, Chunks in use: 0 391.43MiB allocated for chunks. 14.06MiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.119333: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:643] Bin (268435456): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin.
2017-12-08 21:21:38.119582: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:660] Bin for 300.00MiB was 256.00MiB, Chunk State:
2017-12-08 21:21:38.119807: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502200000 of size 1280
2017-12-08 21:21:38.120196: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502200500 of size 256
2017-12-08 21:21:38.124584: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502200600 of size 256
2017-12-08 21:21:38.125103: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502200700 of size 256
2017-12-08 21:21:38.125612: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502200800 of size 147456
2017-12-08 21:21:38.125808: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224800 of size 256
2017-12-08 21:21:38.126100: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224900 of size 256
2017-12-08 21:21:38.126360: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224A00 of size 256
2017-12-08 21:21:38.126627: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224B00 of size 256
2017-12-08 21:21:38.126885: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224C00 of size 256
2017-12-08 21:21:38.127144: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224D00 of size 256
2017-12-08 21:21:38.127553: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224E00 of size 256
2017-12-08 21:21:38.127793: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502224F00 of size 256
2017-12-08 21:21:38.127992: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225000 of size 256
2017-12-08 21:21:38.128240: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225100 of size 256
2017-12-08 21:21:38.128501: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225200 of size 256
2017-12-08 21:21:38.128859: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225300 of size 256
2017-12-08 21:21:38.129036: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225400 of size 256
2017-12-08 21:21:38.129324: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225500 of size 256
2017-12-08 21:21:38.129588: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225600 of size 256
2017-12-08 21:21:38.129860: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225700 of size 256
2017-12-08 21:21:38.130159: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225800 of size 256
2017-12-08 21:21:38.130909: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225900 of size 256
2017-12-08 21:21:38.131079: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225A00 of size 256
2017-12-08 21:21:38.131793: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225B00 of size 256
2017-12-08 21:21:38.131985: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225C00 of size 256
2017-12-08 21:21:38.132165: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225D00 of size 256
2017-12-08 21:21:38.132379: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225E00 of size 256
2017-12-08 21:21:38.132617: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502225F00 of size 256
2017-12-08 21:21:38.132884: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226000 of size 256
2017-12-08 21:21:38.133196: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226100 of size 256
2017-12-08 21:21:38.136489: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226200 of size 256
2017-12-08 21:21:38.138203: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226300 of size 256
2017-12-08 21:21:38.138946: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226400 of size 256
2017-12-08 21:21:38.139167: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226500 of size 256
2017-12-08 21:21:38.140109: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226600 of size 256
2017-12-08 21:21:38.140823: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226700 of size 256
2017-12-08 21:21:38.140896: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226800 of size 256
2017-12-08 21:21:38.141196: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226900 of size 256
2017-12-08 21:21:38.141585: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226A00 of size 256
2017-12-08 21:21:38.141772: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226B00 of size 256
2017-12-08 21:21:38.142048: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226C00 of size 256
2017-12-08 21:21:38.142336: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226D00 of size 256
2017-12-08 21:21:38.142695: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226E00 of size 256
2017-12-08 21:21:38.142897: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502226F00 of size 256
2017-12-08 21:21:38.143364: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227000 of size 256
2017-12-08 21:21:38.143533: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227100 of size 256
2017-12-08 21:21:38.143847: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227200 of size 256
2017-12-08 21:21:38.144004: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227300 of size 256
2017-12-08 21:21:38.144233: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227400 of size 256
2017-12-08 21:21:38.144462: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227500 of size 256
2017-12-08 21:21:38.144689: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227600 of size 256
2017-12-08 21:21:38.148143: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227700 of size 256
2017-12-08 21:21:38.148417: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227800 of size 256
2017-12-08 21:21:38.148698: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227900 of size 256
2017-12-08 21:21:38.148943: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227A00 of size 256
2017-12-08 21:21:38.149160: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227B00 of size 256
2017-12-08 21:21:38.149426: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227C00 of size 256
2017-12-08 21:21:38.149638: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227D00 of size 256
2017-12-08 21:21:38.149868: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227E00 of size 256
2017-12-08 21:21:38.150086: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502227F00 of size 1024
2017-12-08 21:21:38.150307: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228300 of size 256
2017-12-08 21:21:38.150525: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228400 of size 1024
2017-12-08 21:21:38.150745: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228800 of size 256
2017-12-08 21:21:38.150962: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228900 of size 256
2017-12-08 21:21:38.151173: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228A00 of size 256
2017-12-08 21:21:38.151393: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228B00 of size 256
2017-12-08 21:21:38.151636: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228C00 of size 256
2017-12-08 21:21:38.151845: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228D00 of size 256
2017-12-08 21:21:38.152074: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228E00 of size 256
2017-12-08 21:21:38.152291: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502228F00 of size 256
2017-12-08 21:21:38.152522: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229000 of size 256
2017-12-08 21:21:38.152746: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229100 of size 256
2017-12-08 21:21:38.153053: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229200 of size 256
2017-12-08 21:21:38.153235: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229300 of size 256
2017-12-08 21:21:38.153665: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229400 of size 256
2017-12-08 21:21:38.154571: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229500 of size 256
2017-12-08 21:21:38.155423: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229600 of size 256
2017-12-08 21:21:38.155874: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229700 of size 256
2017-12-08 21:21:38.156735: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229800 of size 256
2017-12-08 21:21:38.159613: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229900 of size 256
2017-12-08 21:21:38.159968: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229A00 of size 256
2017-12-08 21:21:38.160215: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229B00 of size 256
2017-12-08 21:21:38.160461: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229C00 of size 256
2017-12-08 21:21:38.160764: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229D00 of size 256
2017-12-08 21:21:38.161123: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229E00 of size 256
2017-12-08 21:21:38.161379: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502229F00 of size 256
2017-12-08 21:21:38.161603: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050222A000 of size 256
2017-12-08 21:21:38.162003: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502237B00 of size 69888
2017-12-08 21:21:38.162185: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502248C00 of size 256
2017-12-08 21:21:38.162614: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502248D00 of size 147456
2017-12-08 21:21:38.162865: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050226CD00 of size 256
2017-12-08 21:21:38.163388: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050226CE00 of size 256
2017-12-08 21:21:38.163578: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050226CF00 of size 147456
2017-12-08 21:21:38.163877: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502290F00 of size 147456
2017-12-08 21:21:38.164112: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B4F00 of size 256
2017-12-08 21:21:38.164411: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5000 of size 256
2017-12-08 21:21:38.164564: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5100 of size 256
2017-12-08 21:21:38.164814: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5200 of size 256
2017-12-08 21:21:38.165034: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5300 of size 256
2017-12-08 21:21:38.165274: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5400 of size 256
2017-12-08 21:21:38.165547: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5500 of size 256
2017-12-08 21:21:38.165817: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022B5600 of size 147456
2017-12-08 21:21:38.166059: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005022D9600 of size 158208
2017-12-08 21:21:38.166294: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 000000050222A100 of size 55808
2017-12-08 21:21:38.166546: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600000 of size 256
2017-12-08 21:21:38.166883: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600100 of size 256
2017-12-08 21:21:38.167067: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600200 of size 256
2017-12-08 21:21:38.167340: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600300 of size 256
2017-12-08 21:21:38.167610: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600400 of size 256
2017-12-08 21:21:38.167916: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600500 of size 256
2017-12-08 21:21:38.172277: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600600 of size 256
2017-12-08 21:21:38.172348: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502600700 of size 147456
2017-12-08 21:21:38.172786: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502624700 of size 147712
2017-12-08 21:21:38.173513: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648800 of size 256
2017-12-08 21:21:38.173777: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648900 of size 256
2017-12-08 21:21:38.174032: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648A00 of size 256
2017-12-08 21:21:38.174301: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648B00 of size 256
2017-12-08 21:21:38.174648: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648C00 of size 256
2017-12-08 21:21:38.174932: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648D00 of size 256
2017-12-08 21:21:38.175195: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502648E00 of size 147456
2017-12-08 21:21:38.175476: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050266CE00 of size 147456
2017-12-08 21:21:38.175738: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502690E00 of size 256
2017-12-08 21:21:38.176003: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502690F00 of size 256
2017-12-08 21:21:38.176304: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691000 of size 256
2017-12-08 21:21:38.176492: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691100 of size 256
2017-12-08 21:21:38.176775: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691200 of size 256
2017-12-08 21:21:38.177021: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691300 of size 256
2017-12-08 21:21:38.177255: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691400 of size 256
2017-12-08 21:21:38.177478: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502691500 of size 147456
2017-12-08 21:21:38.177755: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026B5500 of size 147456
2017-12-08 21:21:38.178009: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9500 of size 256
2017-12-08 21:21:38.178235: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9600 of size 256
2017-12-08 21:21:38.178457: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9700 of size 256
2017-12-08 21:21:38.178669: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9800 of size 256
2017-12-08 21:21:38.178990: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9900 of size 256
2017-12-08 21:21:38.181931: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9A00 of size 256
2017-12-08 21:21:38.182338: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026D9B00 of size 147712
2017-12-08 21:21:38.182646: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005026FDC00 of size 147968
2017-12-08 21:21:38.183128: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502721E00 of size 256
2017-12-08 21:21:38.183350: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502721F00 of size 256
2017-12-08 21:21:38.183663: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502722000 of size 256
2017-12-08 21:21:38.183920: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502722100 of size 256
2017-12-08 21:21:38.184167: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502722200 of size 147712
2017-12-08 21:21:38.184409: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502746300 of size 147456
2017-12-08 21:21:38.184639: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050276A300 of size 256
2017-12-08 21:21:38.184912: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050276A400 of size 256
2017-12-08 21:21:38.185150: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050276A500 of size 147456
2017-12-08 21:21:38.185405: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050278E500 of size 147456
2017-12-08 21:21:38.185645: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005027B2500 of size 147456
2017-12-08 21:21:38.185886: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005027D6500 of size 170752
2017-12-08 21:21:38.186126: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502800000 of size 147456
2017-12-08 21:21:38.186375: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502824000 of size 147456
2017-12-08 21:21:38.187085: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502848000 of size 147456
2017-12-08 21:21:38.188048: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 000000050286C000 of size 147456
2017-12-08 21:21:38.188438: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502890000 of size 147456
2017-12-08 21:21:38.188718: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005028B4000 of size 147456
2017-12-08 21:21:38.188991: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005028D8000 of size 147456
2017-12-08 21:21:38.189216: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005028FC000 of size 256
2017-12-08 21:21:38.189507: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005028FC100 of size 62208
2017-12-08 21:21:38.189796: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502920000 of size 147456
2017-12-08 21:21:38.190068: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502944000 of size 147456
2017-12-08 21:21:38.190359: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502968000 of size 147456
2017-12-08 21:21:38.190598: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005029B0000 of size 147456
2017-12-08 21:21:38.190875: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 00000005029D4000 of size 589824
2017-12-08 21:21:38.194404: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502A64000 of size 147456
2017-12-08 21:21:38.194902: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502A88000 of size 147456
2017-12-08 21:21:38.195136: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000502AF4000 of size 1097728
2017-12-08 21:21:38.195467: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 000000050290B400 of size 84992
2017-12-08 21:21:38.195886: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 000000050298C000 of size 147456
2017-12-08 21:21:38.196227: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 0000000502AAC000 of size 294912
2017-12-08 21:21:38.196453: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 0000000502C00000 of size 8388608
2017-12-08 21:21:38.196763: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 0000000503400000 of size 134217728
2017-12-08 21:21:38.197012: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 000000050B400000 of size 134217728
2017-12-08 21:21:38.197248: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000513800000 of size 536870912
2017-12-08 21:21:38.197484: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:678] Chunk at 0000000533800000 of size 536870912
2017-12-08 21:21:38.197720: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:687] Free at 0000000553800000 of size 142006528
2017-12-08 21:21:38.198002: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:693] Summary of in-use Chunks by size:
2017-12-08 21:21:38.198236: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 127 Chunks of size 256 totalling 31.8KiB
2017-12-08 21:21:38.198464: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 2 Chunks of size 1024 totalling 2.0KiB
2017-12-08 21:21:38.198697: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 1280 totalling 1.3KiB
2017-12-08 21:21:38.198932: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 62208 totalling 60.8KiB
2017-12-08 21:21:38.199163: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 69888 totalling 68.3KiB
2017-12-08 21:21:38.199422: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 27 Chunks of size 147456 totalling 3.80MiB
2017-12-08 21:21:38.199662: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 3 Chunks of size 147712 totalling 432.8KiB
2017-12-08 21:21:38.199901: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 147968 totalling 144.5KiB
2017-12-08 21:21:38.200133: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 158208 totalling 154.5KiB
2017-12-08 21:21:38.200371: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 170752 totalling 166.8KiB
2017-12-08 21:21:38.200602: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 589824 totalling 576.0KiB
2017-12-08 21:21:38.200838: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 1 Chunks of size 1097728 totalling 1.05MiB
2017-12-08 21:21:38.201107: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:696] 2 Chunks of size 536870912 totalling 1.00GiB
2017-12-08 21:21:38.201342: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:700] Sum Total of in-use chunks: 1.01GiB
2017-12-08 21:21:38.201578: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:702] Stats:
Limit: 1499912601
InUse: 1080498688
MaxInUse: 1491530496
NumAllocs: 911
MaxAllocSize: 536870912
2017-12-08 21:21:38.201808: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\common_runtime\bfc_allocator.cc:277] *_________________**********************xxxxxxxxxxxxxx**********************xxxxxxxxxxxxxxx_________
2017-12-08 21:21:38.202031: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\35\tensorflow\core\framework\op_kernel.cc:1192] Resource exhausted: OOM when allocating tensor with shape[1,960,1280,64]
Traceback (most recent call last):
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1327, in _do_call
return fn(*args)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1306, in _run_fn
status, run_metadata)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\contextlib.py", line 66, in __exit__
next(self.gen)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\framework\errors_impl.py", line 466, in raise_exception_on_not_ok_status
pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[1,960,1280,64]
[[Node: generator/generator_unit/subpixelconv_stage1/Abs = Abs[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/gpu:0"](generator/generator_unit/subpixelconv_stage1/concat)]]
[[Node: encode_image/output_pngs/while/LoopCond/_383 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/cpu:0", send_device="/job:localhost/replica:0/task:0/gpu:0", send_device_incarnation=1, tensor_name="edge_3659_encode_image/output_pngs/while/LoopCond", tensor_type=DT_BOOL, _device="/job:localhost/replica:0/task:0/cpu:0"](^_cloopencode_image/output_pngs/while/TensorArrayReadV3/_329)]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "main.py", line 216, in <module>
results = sess.run(save_fetch, feed_dict={inputs_raw: input_im, path_LR: path_lr})
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 895, in run
run_metadata_ptr)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1124, in _run
feed_dict_tensor, options, run_metadata)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1321, in _do_run
options, run_metadata)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\client\session.py", line 1340, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[1,960,1280,64]
[[Node: generator/generator_unit/subpixelconv_stage1/Abs = Abs[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/gpu:0"](generator/generator_unit/subpixelconv_stage1/concat)]]
[[Node: encode_image/output_pngs/while/LoopCond/_383 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/cpu:0", send_device="/job:localhost/replica:0/task:0/gpu:0", send_device_incarnation=1, tensor_name="edge_3659_encode_image/output_pngs/while/LoopCond", tensor_type=DT_BOOL, _device="/job:localhost/replica:0/task:0/cpu:0"](^_cloopencode_image/output_pngs/while/TensorArrayReadV3/_329)]]
Caused by op 'generator/generator_unit/subpixelconv_stage1/Abs', defined at:
File "main.py", line 175, in <module>
gen_output = generator(inputs_raw, 3, reuse=False, FLAGS=FLAGS)
File "C:\Users\SMPTHEHEDGEHOG\Desktop\SRGAN-tensorflow\lib\model.py", line 262, in generator
net = prelu_tf(net)
File "C:\Users\SMPTHEHEDGEHOG\Desktop\SRGAN-tensorflow\lib\ops.py", line 64, in prelu_tf
neg = alphas * (inputs - abs(inputs)) * 0.5
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\ops\math_ops.py", line 266, in abs
return gen_math_ops._abs(x, name=name)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\ops\gen_math_ops.py", line 31, in _abs
result = _op_def_lib.apply_op("Abs", x=x, name=name)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 767, in apply_op
op_def=op_def)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\framework\ops.py", line 2630, in create_op
original_op=self._default_original_op, op_def=op_def)
File "C:\Users\SMPTHE~1\AppData\Local\Programs\Python\Python35\lib\site-packages\tensorflow\python\framework\ops.py", line 1204, in __init__
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access
ResourceExhaustedError (see above for traceback): OOM when allocating tensor with shape[1,960,1280,64]
[[Node: generator/generator_unit/subpixelconv_stage1/Abs = Abs[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/gpu:0"](generator/generator_unit/subpixelconv_stage1/concat)]]
[[Node: encode_image/output_pngs/while/LoopCond/_383 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/cpu:0", send_device="/job:localhost/replica:0/task:0/gpu:0", send_device_incarnation=1, tensor_name="edge_3659_encode_image/output_pngs/while/LoopCond", tensor_type=DT_BOOL, _device="/job:localhost/replica:0/task:0/cpu:0"](^_cloopencode_image/output_pngs/while/TensorArrayReadV3/_329)]]
I think it's because of RAM, I have only 4GB of RAM and 2GB of VRAM. But I don't know.
from srgan-tensorflow.
yes, you are right, OOM error refer to out of ram, Unfortunately that this great progect Require alot of ram, and to Avoid out of ram erro, i forced to splite my photos to many slice with photoshop, then upscall it with srgan, finally Merge it again, seem alot of work, but the reuslt is excellent.
from srgan-tensorflow.
Thank you very much. So I have no choice but to split images into little pieces.
from srgan-tensorflow.
Unfortunately yes for now, hopefully we can get rid form that in some point in the future.
from srgan-tensorflow.
Related Issues (20)
- Issue with perceptual loss HOT 1
- Successfully ran test mode in MacOS, where to put Instructions? HOT 2
- License HOT 1
- Max input resolution? HOT 2
- can't find varibles in checkpoint
- 2x resolution instead of 4x HOT 1
- ParametricRelU after pixelshuffler HOT 2
- The graph couldn't be sorted in topological order
- i had some headache,for help -_- HOT 3
- Did you use the pretrained VGG model in getting percetual loss?
- Training
- VGG input
- When I want to input by using GRAY SCALE data...
- Black images HOT 3
- Keep getting a tensorflow.python.framework.errors_impl.InvalidArgumentError
- scale generator network output to [-1, 1] HOT 1
- Missing requirements HOT 1
- Set the upscaling factor
- why the content_loss and adversarial_loss keep increasing with the training? HOT 2
- run error HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from srgan-tensorflow.