Request Failed: Request Failed! Exception caught while generating caption.

wjy3326

when I upload some video files, I occured this issue.  the logs are here: backend_1 | 172.14.0.3 - - [31/Dec/2020 10:32:11] "POST / HTTP/1.1" 200 - frontend_1 | : frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file frontend_1 | output = json.loads(predict_fnames([filename])) frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames frontend_1 | return proxy.predict_fnames(fnames) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in __call__ frontend_1 | return self.__send(self.__name, args) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request frontend_1 | verbose=self.__verbose frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request frontend_1 | return self.single_request(host, handler, request_body, verbose) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1308, in single_request frontend_1 | self.send_request(h, handler, request_body) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1411, in send_request frontend_1 | connection.putrequest("POST", handler, skip_accept_encoding=True) frontend_1 | File "/usr/local/lib/python2.7/httplib.py", line 936, in putrequest frontend_1 | raise CannotSendRequest() frontend_1 | CannotSendRequest frontend_1 | frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/448043.mp4 frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/456732.mp4 frontend_1 | Traceback (most recent call last): frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file frontend_1 | output = json.loads(predict_fnames([filename])) frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames frontend_1 | return proxy.predict_fnames(fnames) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in __call__ frontend_1 | return self.__send(self.__name, args) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request frontend_1 | verbose=self.__verbose frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request frontend_1 | return self.single_request(host, handler, request_body, verbose) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1308, in single_request frontend_1 | self.send_request(h, handler, request_body) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1411, in send_request frontend_1 | connection.putrequest("POST", handler, skip_accept_encoding=True) frontend_1 | File "/usr/local/lib/python2.7/httplib.py", line 936, in putrequest frontend_1 | raise CannotSendRequest() frontend_1 | CannotSendRequest frontend_1 | frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/33366.mp4 frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video1.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/833364.mp4 frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video5.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/563627.mp4 frontend_1 | Traceback (most recent call last): frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file frontend_1 | output = json.loads(predict_fnames([filename])) frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames frontend_1 | return proxy.predict_fnames(fnames) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in __call__ frontend_1 | return self.__send(self.__name, args) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request frontend_1 | verbose=self.__verbose frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request frontend_1 | return self.single_request(host, handler, request_body, verbose) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1316, in single_request frontend_1 | return self.parse_response(response) frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1493, in parse_response frontend_1 | return u.close() frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 800, in close frontend_1 | raise Fault(**self._stack[0]) frontend_1 | Fault: <Fault 1: "<class 'audioread.exceptions.NoBackendError'>:"> frontend_1 | frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video1.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/278568.mp4 frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video5.mp4' ('video/mp4')>)]) frontend_1 | File uploaded: /home/si/v2d/uploads/753145.mp4 frontend_1 | Traceback (most recent call last): frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file frontend_1 | output = json.loads(predict_fnames([filename])) frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames backend_1 | 172.14.0.3 - - [31/Dec/2020 10:42:39] "POST / HTTP/1.1" 200 - backend_1 | [framework.py:242 - predict_fnames() ] Trying to predict for ['/home/si/v2d/uploads/838295.mp4']

scopeInfinity

Thanks for filing the issue. The `audioread.exceptions.NoBackendError` exception seems to be raised on the video processing side. Will it be possible for you to provide a bit more details related to the following? - Host OS? - Was the application running inside docker? Or build from scratch? - Is the error reproducible? Or was it one time? - Will it is possible to rerun the service again using docker-compose and give extra time before uploading the video? Do we still see the same error? - Is the error visible only on a set of videos? or all? - Will it is possible to share a sample video where the captioning is not working for testing, only if it's ok.

wjy3326

I run the service use docker-compose in my linux server. It is normal when I use postman to access the service. The above problem occurs when I use the webpage to visit, basically all videos can't get results. When I execute without Docker and download the pretrained model and turn up the backend to deploy the service on my server, another error occurred, as follows, how can I fix it? Thanks. Total params: 62,387,240 Trainable params: 62,384,808 Non-trainable params: 2,432 _________________________________________________________________ [model.py:132 - build_mcnn() ] Model Created ResNet_D512L512_G128G64_D1024D0.25BN_BDGRU1024_D0.2L1024DVS 2021-01-02 19:34:48.450666: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA 2021-01-02 19:34:49.018159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1105] Found device 0 with properties: name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.582 pciBusID: 0000:05:00.0 totalMemory: 10.92GiB freeMemory: 10.57GiB 2021-01-02 19:34:49.018262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1195] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:05:00.0, compute capability: 6.1) [model.py:41 - build_cutoffmodel() ] Building Cutoff Model ____________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ==================================================================================================== input_1 (InputLayer) (None, None, None, 3) 0 ____________________________________________________________________________________________________ conv1 (Conv2D) (None, None, None, 64 9472 input_1[0][0] ____________________________________________________________________________________________________ bn_conv1 (BatchNormalization) (None, None, None, 64 256 conv1[0][0] ____________________________________________________________________________________________________ activation_3 (Activation) (None, None, None, 64 0 bn_conv1[0][0] ____________________________________________________________________________________________________ max_pooling2d_1 (MaxPooling2D) (None, None, None, 64 0 activation_3[0][0] ____________________________________________________________________________________________________ res2a_branch2a (Conv2D) (None, None, None, 64 4160 max_pooling2d_1[0][0] ____________________________________________________________________________________________________ bn2a_branch2a (BatchNormalizatio (None, None, None, 64 256 res2a_branch2a[0][0] ____________________________________________________________________________________________________ activation_4 (Activation) (None, None, None, 64 0 bn2a_branch2a[0][0] ____________________________________________________________________________________________________ res2a_branch2b (Conv2D) (None, None, None, 64 36928 activation_4[0][0] ____________________________________________________________________________________________________ bn2a_branch2b (BatchNormalizatio (None, None, None, 64 256 res2a_branch2b[0][0] ____________________________________________________________________________________________________ activation_5 (Activation) (None, None, None, 64 0 bn2a_branch2b[0][0] ____________________________________________________________________________________________________ res2a_branch2c (Conv2D) (None, None, None, 25 16640 activation_5[0][0] ____________________________________________________________________________________________________ res2a_branch1 (Conv2D) (None, None, None, 25 16640 max_pooling2d_1[0][0] ____________________________________________________________________________________________________ bn2a_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2a_branch2c[0][0] ____________________________________________________________________________________________________ bn2a_branch1 (BatchNormalization (None, None, None, 25 1024 res2a_branch1[0][0] ____________________________________________________________________________________________________ add_1 (Add) (None, None, None, 25 0 bn2a_branch2c[0][0] bn2a_branch1[0][0] ____________________________________________________________________________________________________ activation_6 (Activation) (None, None, None, 25 0 add_1[0][0] ____________________________________________________________________________________________________ res2b_branch2a (Conv2D) (None, None, None, 64 16448 activation_6[0][0] ____________________________________________________________________________________________________ bn2b_branch2a (BatchNormalizatio (None, None, None, 64 256 res2b_branch2a[0][0] ____________________________________________________________________________________________________ activation_7 (Activation) (None, None, None, 64 0 bn2b_branch2a[0][0] ____________________________________________________________________________________________________ res2b_branch2b (Conv2D) (None, None, None, 64 36928 activation_7[0][0] ____________________________________________________________________________________________________ bn2b_branch2b (BatchNormalizatio (None, None, None, 64 256 res2b_branch2b[0][0] ____________________________________________________________________________________________________ activation_8 (Activation) (None, None, None, 64 0 bn2b_branch2b[0][0] ____________________________________________________________________________________________________ res2b_branch2c (Conv2D) (None, None, None, 25 16640 activation_8[0][0] ____________________________________________________________________________________________________ bn2b_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2b_branch2c[0][0] ____________________________________________________________________________________________________ add_2 (Add) (None, None, None, 25 0 bn2b_branch2c[0][0] activation_6[0][0] ____________________________________________________________________________________________________ activation_9 (Activation) (None, None, None, 25 0 add_2[0][0] ____________________________________________________________________________________________________ res2c_branch2a (Conv2D) (None, None, None, 64 16448 activation_9[0][0] ____________________________________________________________________________________________________ bn2c_branch2a (BatchNormalizatio (None, None, None, 64 256 res2c_branch2a[0][0] ____________________________________________________________________________________________________ activation_10 (Activation) (None, None, None, 64 0 bn2c_branch2a[0][0] ____________________________________________________________________________________________________ res2c_branch2b (Conv2D) (None, None, None, 64 36928 activation_10[0][0] ____________________________________________________________________________________________________ bn2c_branch2b (BatchNormalizatio (None, None, None, 64 256 res2c_branch2b[0][0] ____________________________________________________________________________________________________ activation_11 (Activation) (None, None, None, 64 0 bn2c_branch2b[0][0] ____________________________________________________________________________________________________ res2c_branch2c (Conv2D) (None, None, None, 25 16640 activation_11[0][0] ____________________________________________________________________________________________________ bn2c_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2c_branch2c[0][0] ____________________________________________________________________________________________________ add_3 (Add) (None, None, None, 25 0 bn2c_branch2c[0][0] activation_9[0][0] ____________________________________________________________________________________________________ activation_12 (Activation) (None, None, None, 25 0 add_3[0][0] ____________________________________________________________________________________________________ res3a_branch2a (Conv2D) (None, None, None, 12 32896 activation_12[0][0] ____________________________________________________________________________________________________ bn3a_branch2a (BatchNormalizatio (None, None, None, 12 512 res3a_branch2a[0][0] ____________________________________________________________________________________________________ activation_13 (Activation) (None, None, None, 12 0 bn3a_branch2a[0][0] ____________________________________________________________________________________________________ res3a_branch2b (Conv2D) (None, None, None, 12 147584 activation_13[0][0] ____________________________________________________________________________________________________ bn3a_branch2b (BatchNormalizatio (None, None, None, 12 512 res3a_branch2b[0][0] ____________________________________________________________________________________________________ activation_14 (Activation) (None, None, None, 12 0 bn3a_branch2b[0][0] ____________________________________________________________________________________________________ res3a_branch2c (Conv2D) (None, None, None, 51 66048 activation_14[0][0] ____________________________________________________________________________________________________ res3a_branch1 (Conv2D) (None, None, None, 51 131584 activation_12[0][0] ____________________________________________________________________________________________________ bn3a_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3a_branch2c[0][0] ____________________________________________________________________________________________________ bn3a_branch1 (BatchNormalization (None, None, None, 51 2048 res3a_branch1[0][0] ____________________________________________________________________________________________________ add_4 (Add) (None, None, None, 51 0 bn3a_branch2c[0][0] bn3a_branch1[0][0] ____________________________________________________________________________________________________ activation_15 (Activation) (None, None, None, 51 0 add_4[0][0] ____________________________________________________________________________________________________ res3b_branch2a (Conv2D) (None, None, None, 12 65664 activation_15[0][0] ____________________________________________________________________________________________________ bn3b_branch2a (BatchNormalizatio (None, None, None, 12 512 res3b_branch2a[0][0] ____________________________________________________________________________________________________ activation_16 (Activation) (None, None, None, 12 0 bn3b_branch2a[0][0] ____________________________________________________________________________________________________ res3b_branch2b (Conv2D) (None, None, None, 12 147584 activation_16[0][0] ____________________________________________________________________________________________________ bn3b_branch2b (BatchNormalizatio (None, None, None, 12 512 res3b_branch2b[0][0] ____________________________________________________________________________________________________ activation_17 (Activation) (None, None, None, 12 0 bn3b_branch2b[0][0] ____________________________________________________________________________________________________ res3b_branch2c (Conv2D) (None, None, None, 51 66048 activation_17[0][0] ____________________________________________________________________________________________________ bn3b_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3b_branch2c[0][0] ____________________________________________________________________________________________________ add_5 (Add) (None, None, None, 51 0 bn3b_branch2c[0][0] activation_15[0][0] ____________________________________________________________________________________________________ activation_18 (Activation) (None, None, None, 51 0 add_5[0][0] ____________________________________________________________________________________________________ res3c_branch2a (Conv2D) (None, None, None, 12 65664 activation_18[0][0] ____________________________________________________________________________________________________ bn3c_branch2a (BatchNormalizatio (None, None, None, 12 512 res3c_branch2a[0][0] ____________________________________________________________________________________________________ activation_19 (Activation) (None, None, None, 12 0 bn3c_branch2a[0][0] ____________________________________________________________________________________________________ res3c_branch2b (Conv2D) (None, None, None, 12 147584 activation_19[0][0] ____________________________________________________________________________________________________ bn3c_branch2b (BatchNormalizatio (None, None, None, 12 512 res3c_branch2b[0][0] ____________________________________________________________________________________________________ activation_20 (Activation) (None, None, None, 12 0 bn3c_branch2b[0][0] ____________________________________________________________________________________________________ res3c_branch2c (Conv2D) (None, None, None, 51 66048 activation_20[0][0] ____________________________________________________________________________________________________ bn3c_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3c_branch2c[0][0] ____________________________________________________________________________________________________ add_6 (Add) (None, None, None, 51 0 bn3c_branch2c[0][0] activation_18[0][0] ____________________________________________________________________________________________________ activation_21 (Activation) (None, None, None, 51 0 add_6[0][0] ____________________________________________________________________________________________________ res3d_branch2a (Conv2D) (None, None, None, 12 65664 activation_21[0][0] ____________________________________________________________________________________________________ bn3d_branch2a (BatchNormalizatio (None, None, None, 12 512 res3d_branch2a[0][0] ____________________________________________________________________________________________________ activation_22 (Activation) (None, None, None, 12 0 bn3d_branch2a[0][0] ____________________________________________________________________________________________________ res3d_branch2b (Conv2D) (None, None, None, 12 147584 activation_22[0][0] ____________________________________________________________________________________________________ bn3d_branch2b (BatchNormalizatio (None, None, None, 12 512 res3d_branch2b[0][0] ____________________________________________________________________________________________________ activation_23 (Activation) (None, None, None, 12 0 bn3d_branch2b[0][0] ____________________________________________________________________________________________________ res3d_branch2c (Conv2D) (None, None, None, 51 66048 activation_23[0][0] ____________________________________________________________________________________________________ bn3d_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3d_branch2c[0][0] ____________________________________________________________________________________________________ add_7 (Add) (None, None, None, 51 0 bn3d_branch2c[0][0] activation_21[0][0] ____________________________________________________________________________________________________ activation_24 (Activation) (None, None, None, 51 0 add_7[0][0] ____________________________________________________________________________________________________ res4a_branch2a (Conv2D) (None, None, None, 25 131328 activation_24[0][0] ____________________________________________________________________________________________________ bn4a_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4a_branch2a[0][0] ____________________________________________________________________________________________________ activation_25 (Activation) (None, None, None, 25 0 bn4a_branch2a[0][0] ____________________________________________________________________________________________________ res4a_branch2b (Conv2D) (None, None, None, 25 590080 activation_25[0][0] ____________________________________________________________________________________________________ bn4a_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4a_branch2b[0][0] ____________________________________________________________________________________________________ activation_26 (Activation) (None, None, None, 25 0 bn4a_branch2b[0][0] ____________________________________________________________________________________________________ res4a_branch2c (Conv2D) (None, None, None, 10 263168 activation_26[0][0] ____________________________________________________________________________________________________ res4a_branch1 (Conv2D) (None, None, None, 10 525312 activation_24[0][0] ____________________________________________________________________________________________________ bn4a_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4a_branch2c[0][0] ____________________________________________________________________________________________________ bn4a_branch1 (BatchNormalization (None, None, None, 10 4096 res4a_branch1[0][0] ____________________________________________________________________________________________________ add_8 (Add) (None, None, None, 10 0 bn4a_branch2c[0][0] bn4a_branch1[0][0] ____________________________________________________________________________________________________ activation_27 (Activation) (None, None, None, 10 0 add_8[0][0] ____________________________________________________________________________________________________ res4b_branch2a (Conv2D) (None, None, None, 25 262400 activation_27[0][0] ____________________________________________________________________________________________________ bn4b_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4b_branch2a[0][0] ____________________________________________________________________________________________________ activation_28 (Activation) (None, None, None, 25 0 bn4b_branch2a[0][0] ____________________________________________________________________________________________________ res4b_branch2b (Conv2D) (None, None, None, 25 590080 activation_28[0][0] ____________________________________________________________________________________________________ bn4b_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4b_branch2b[0][0] ____________________________________________________________________________________________________ activation_29 (Activation) (None, None, None, 25 0 bn4b_branch2b[0][0] ____________________________________________________________________________________________________ res4b_branch2c (Conv2D) (None, None, None, 10 263168 activation_29[0][0] ____________________________________________________________________________________________________ bn4b_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4b_branch2c[0][0] ____________________________________________________________________________________________________ add_9 (Add) (None, None, None, 10 0 bn4b_branch2c[0][0] activation_27[0][0] ____________________________________________________________________________________________________ activation_30 (Activation) (None, None, None, 10 0 add_9[0][0] ____________________________________________________________________________________________________ res4c_branch2a (Conv2D) (None, None, None, 25 262400 activation_30[0][0] ____________________________________________________________________________________________________ bn4c_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4c_branch2a[0][0] ____________________________________________________________________________________________________ activation_31 (Activation) (None, None, None, 25 0 bn4c_branch2a[0][0] ____________________________________________________________________________________________________ res4c_branch2b (Conv2D) (None, None, None, 25 590080 activation_31[0][0] ____________________________________________________________________________________________________ bn4c_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4c_branch2b[0][0] ____________________________________________________________________________________________________ activation_32 (Activation) (None, None, None, 25 0 bn4c_branch2b[0][0] ____________________________________________________________________________________________________ res4c_branch2c (Conv2D) (None, None, None, 10 263168 activation_32[0][0] ____________________________________________________________________________________________________ bn4c_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4c_branch2c[0][0] ____________________________________________________________________________________________________ add_10 (Add) (None, None, None, 10 0 bn4c_branch2c[0][0] activation_30[0][0] ____________________________________________________________________________________________________ activation_33 (Activation) (None, None, None, 10 0 add_10[0][0] ____________________________________________________________________________________________________ res4d_branch2a (Conv2D) (None, None, None, 25 262400 activation_33[0][0] ____________________________________________________________________________________________________ bn4d_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4d_branch2a[0][0] ____________________________________________________________________________________________________ activation_34 (Activation) (None, None, None, 25 0 bn4d_branch2a[0][0] ____________________________________________________________________________________________________ res4d_branch2b (Conv2D) (None, None, None, 25 590080 activation_34[0][0] ____________________________________________________________________________________________________ bn4d_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4d_branch2b[0][0] ____________________________________________________________________________________________________ activation_35 (Activation) (None, None, None, 25 0 bn4d_branch2b[0][0] ____________________________________________________________________________________________________ res4d_branch2c (Conv2D) (None, None, None, 10 263168 activation_35[0][0] ____________________________________________________________________________________________________ bn4d_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4d_branch2c[0][0] ____________________________________________________________________________________________________ add_11 (Add) (None, None, None, 10 0 bn4d_branch2c[0][0] activation_33[0][0] ____________________________________________________________________________________________________ activation_36 (Activation) (None, None, None, 10 0 add_11[0][0] ____________________________________________________________________________________________________ res4e_branch2a (Conv2D) (None, None, None, 25 262400 activation_36[0][0] ____________________________________________________________________________________________________ bn4e_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4e_branch2a[0][0] ____________________________________________________________________________________________________ activation_37 (Activation) (None, None, None, 25 0 bn4e_branch2a[0][0] ____________________________________________________________________________________________________ res4e_branch2b (Conv2D) (None, None, None, 25 590080 activation_37[0][0] ____________________________________________________________________________________________________ bn4e_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4e_branch2b[0][0] ____________________________________________________________________________________________________ activation_38 (Activation) (None, None, None, 25 0 bn4e_branch2b[0][0] ____________________________________________________________________________________________________ res4e_branch2c (Conv2D) (None, None, None, 10 263168 activation_38[0][0] ____________________________________________________________________________________________________ bn4e_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4e_branch2c[0][0] ____________________________________________________________________________________________________ add_12 (Add) (None, None, None, 10 0 bn4e_branch2c[0][0] activation_36[0][0] ____________________________________________________________________________________________________ activation_39 (Activation) (None, None, None, 10 0 add_12[0][0] ____________________________________________________________________________________________________ res4f_branch2a (Conv2D) (None, None, None, 25 262400 activation_39[0][0] ____________________________________________________________________________________________________ bn4f_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4f_branch2a[0][0] ____________________________________________________________________________________________________ activation_40 (Activation) (None, None, None, 25 0 bn4f_branch2a[0][0] ____________________________________________________________________________________________________ res4f_branch2b (Conv2D) (None, None, None, 25 590080 activation_40[0][0] ____________________________________________________________________________________________________ bn4f_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4f_branch2b[0][0] ____________________________________________________________________________________________________ activation_41 (Activation) (None, None, None, 25 0 bn4f_branch2b[0][0] ____________________________________________________________________________________________________ res4f_branch2c (Conv2D) (None, None, None, 10 263168 activation_41[0][0] ____________________________________________________________________________________________________ bn4f_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4f_branch2c[0][0] ____________________________________________________________________________________________________ add_13 (Add) (None, None, None, 10 0 bn4f_branch2c[0][0] activation_39[0][0] ____________________________________________________________________________________________________ activation_42 (Activation) (None, None, None, 10 0 add_13[0][0] ____________________________________________________________________________________________________ res5a_branch2a (Conv2D) (None, None, None, 51 524800 activation_42[0][0] ____________________________________________________________________________________________________ bn5a_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5a_branch2a[0][0] ____________________________________________________________________________________________________ activation_43 (Activation) (None, None, None, 51 0 bn5a_branch2a[0][0] ____________________________________________________________________________________________________ res5a_branch2b (Conv2D) (None, None, None, 51 2359808 activation_43[0][0] ____________________________________________________________________________________________________ bn5a_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5a_branch2b[0][0] ____________________________________________________________________________________________________ activation_44 (Activation) (None, None, None, 51 0 bn5a_branch2b[0][0] ____________________________________________________________________________________________________ res5a_branch2c (Conv2D) (None, None, None, 20 1050624 activation_44[0][0] ____________________________________________________________________________________________________ res5a_branch1 (Conv2D) (None, None, None, 20 2099200 activation_42[0][0] ____________________________________________________________________________________________________ bn5a_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5a_branch2c[0][0] ____________________________________________________________________________________________________ bn5a_branch1 (BatchNormalization (None, None, None, 20 8192 res5a_branch1[0][0] ____________________________________________________________________________________________________ add_14 (Add) (None, None, None, 20 0 bn5a_branch2c[0][0] bn5a_branch1[0][0] ____________________________________________________________________________________________________ activation_45 (Activation) (None, None, None, 20 0 add_14[0][0] ____________________________________________________________________________________________________ res5b_branch2a (Conv2D) (None, None, None, 51 1049088 activation_45[0][0] ____________________________________________________________________________________________________ bn5b_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5b_branch2a[0][0] ____________________________________________________________________________________________________ activation_46 (Activation) (None, None, None, 51 0 bn5b_branch2a[0][0] ____________________________________________________________________________________________________ res5b_branch2b (Conv2D) (None, None, None, 51 2359808 activation_46[0][0] ____________________________________________________________________________________________________ bn5b_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5b_branch2b[0][0] ____________________________________________________________________________________________________ activation_47 (Activation) (None, None, None, 51 0 bn5b_branch2b[0][0] ____________________________________________________________________________________________________ res5b_branch2c (Conv2D) (None, None, None, 20 1050624 activation_47[0][0] ____________________________________________________________________________________________________ bn5b_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5b_branch2c[0][0] ____________________________________________________________________________________________________ add_15 (Add) (None, None, None, 20 0 bn5b_branch2c[0][0] activation_45[0][0] ____________________________________________________________________________________________________ activation_48 (Activation) (None, None, None, 20 0 add_15[0][0] ____________________________________________________________________________________________________ res5c_branch2a (Conv2D) (None, None, None, 51 1049088 activation_48[0][0] ____________________________________________________________________________________________________ bn5c_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5c_branch2a[0][0] ____________________________________________________________________________________________________ activation_49 (Activation) (None, None, None, 51 0 bn5c_branch2a[0][0] ____________________________________________________________________________________________________ res5c_branch2b (Conv2D) (None, None, None, 51 2359808 activation_49[0][0] ____________________________________________________________________________________________________ bn5c_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5c_branch2b[0][0] ____________________________________________________________________________________________________ activation_50 (Activation) (None, None, None, 51 0 bn5c_branch2b[0][0] ____________________________________________________________________________________________________ res5c_branch2c (Conv2D) (None, None, None, 20 1050624 activation_50[0][0] ____________________________________________________________________________________________________ bn5c_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5c_branch2c[0][0] ____________________________________________________________________________________________________ add_16 (Add) (None, None, None, 20 0 bn5c_branch2c[0][0] activation_48[0][0] ____________________________________________________________________________________________________ activation_51 (Activation) (None, None, None, 20 0 add_16[0][0] ____________________________________________________________________________________________________ avg_pool (AveragePooling2D) (None, None, None, 20 0 activation_51[0][0] ==================================================================================================== Total params: 23,587,712 Trainable params: 23,534,592 Non-trainable params: 53,120 ____________________________________________________________________________________________________ [model.py:47 - build_cutoffmodel() ] Building Cutoff Model : Completed [framework.py:137 - load() ] Model Path: models/ResNet_D512L512_G128G64_D1024D0.20BN_BDGRU1024_D0.2L1024DVS_model.dat_4981_loss_2.471_Cider0.355_Blue0.337_Rouge0.568_Meteor0.249 [framework.py:141 - load() ] Weights Loaded [framework.py:127 - __init__() ] __init__ framework complete * Serving Flask app "parser" (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: off [_internal.py:113 - _log() ] * Running on http://0.0.0.0:4888/ (Press CTRL+C to quit) ImmutableMultiDict([('file', <FileStorage: 'video1.mp4' ('video/mp4')>)]) File uploaded: uploads/786489.mp4 [parser.py:50 - predict_fnames() ] Trying to predict for ['uploads/786489.mp4'] /u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/librosa/core/audio.py:162: UserWarning: PySoundFile failed. Trying audioread instead. warnings.warn("PySoundFile failed. Trying audioread instead.") [framework.py:206 - predict_model_direct() ] Predicting for Videos :- ['uploads/786489.mp4'] [framework.py:213 - predict_model_direct() ] Shape of Caption : (1, 16, 300) Traceback (most recent call last): File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/parser.py", line 86, in upload_file output = json.loads(predict_fnames(framework, [filename])) File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/parser.py", line 51, in predict_fnames result = framework.predict_model(fnames=fnames) File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/framework.py", line 266, in predict_model pred,out = self.predict_model_direct(fnames[i*batch_size:(i+1)*batch_size], cache_ids = cids) File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/framework.py", line 218, in predict_model_direct newOneHotCap = self.model.predict([embeddedCap, audioVecs, videoVecs]) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/models.py", line 913, in predict return self.model.predict(x, batch_size=batch_size, verbose=verbose) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/engine/training.py", line 1710, in predict self._make_predict_function() File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/engine/training.py", line 999, in _make_predict_function **kwargs) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2297, in function return Function(inputs, outputs, updates=updates, **kwargs) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2246, in __init__ with tf.control_dependencies(self.outputs): File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4604, in control_dependencies return get_default_graph().control_dependencies(control_inputs) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4310, in control_dependencies c = self.as_graph_element(c) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3323, in as_graph_element return self._as_graph_element_locked(obj, allow_tensor, allow_operation) File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3402, in _as_graph_element_locked raise ValueError("Tensor %s is not an element of this graph." % obj) ValueError: Tensor Tensor("activation_2/truediv:0", shape=(?, 16, 9448), dtype=float32) is not an element of this graph. [_internal.py:113 - _log() ] 192.168.10.250 - - [02/Jan/2021 19:35:04] "POST /upload HTTP/1.1" 200 -

github-actions[bot]

Is follow-up required?