siqueira-hc / efficient-facial-feature-learning-with-wide-ensemble-based-convolutional-neural-networks Goto Github PK

i pretented to use ur method and fine-tunein on other dataset，could u provide ur trainning script？

Hi,
When I run "python main_esr9.py video -i ./media/big_bang.mp4 -d -f 5 -s 2", it gives this error: Unable to open ./model/utils/templates/dlib/cnn-face-detector.dat for reading.

How can I solve this??

Hi,
Your work is awesome. I have a query:
Did you align the images based landmarks coordinates provided and then used the cropped faces? I have been trying to train my model without alignment but accuracy is 41% or so.
Thanks.

hi，i run the video from AFF-Wild trainning set（216.mp4 133.avi）, but ended with no signal,my os is Ubuntu18.04.

Could you please share the pre-trained model?

Hi,
Thanks for the reply. I have used your model using code provided on cropped dataset with data augumentation as mentioned by you. I have used 5000 images per class as well as only 8 emotions. I did not use automatically annotated data. Below is the log. I am not able to get same performance.
Could you please have a look and suggest?

python mymain_affectnet_discrete.py
Processing...
Starting: ESR_9-AffectNet_Discrete
Running on cuda

[Branch 1, Epochs 1--50] Loss: 2.0843 Acc: [0.14715203]
Validation - [Branch 1, Epochs 1--50] Loss: 2.0767 Acc: [0.16154039 0.16154039]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 2--50] Loss: 2.0369 Acc: [0.18504514]
[Branch 1, Epochs 3--50] Loss: 1.9416 Acc: [0.24256384]
Validation - [Branch 1, Epochs 3--50] Loss: 1.8283 Acc: [0.30257564 0.30257564]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 4--50] Loss: 1.7862 Acc: [0.31986792]
[Branch 1, Epochs 5--50] Loss: 1.6777 Acc: [0.36638884]
Validation - [Branch 1, Epochs 5--50] Loss: 1.5865 Acc: [0.40235059 0.40235059]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 6--50] Loss: 1.5984 Acc: [0.398823]
[Branch 1, Epochs 7--50] Loss: 1.5499 Acc: [0.41860837]
Validation - [Branch 1, Epochs 7--50] Loss: 1.5098 Acc: [0.4156039 0.4156039]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 8--50] Loss: 1.5158 Acc: [0.43429287]
[Branch 1, Epochs 9--50] Loss: 1.4847 Acc: [0.44252124]
Validation - [Branch 1, Epochs 9--50] Loss: 1.4875 Acc: [0.43210803 0.43210803]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 10--50] Loss: 1.4507 Acc: [0.45724709]
[Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943]
Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184]
[Branch 1, Epochs 11--50] Loss: 1.3985 Acc: [0.47681943] [376/1905]
Validation - [Branch 1, Epochs 11--50] Loss: 1.4046 Acc: [0.4736184 0.4736184]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 12--50] Loss: 1.3768 Acc: [0.48664554]
[Branch 1, Epochs 13--50] Loss: 1.3670 Acc: [0.48912204]
Validation - [Branch 1, Epochs 13--50] Loss: 1.3871 Acc: [0.47911978 0.47911978]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 14--50] Loss: 1.3567 Acc: [0.49298325]
[Branch 1, Epochs 15--50] Loss: 1.3478 Acc: [0.49511357]
Validation - [Branch 1, Epochs 15--50] Loss: 1.3665 Acc: [0.48712178 0.48712178]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 16--50] Loss: 1.3354 Acc: [0.49897478]
[Branch 1, Epochs 17--50] Loss: 1.3307 Acc: [0.50139802]
Validation - [Branch 1, Epochs 17--50] Loss: 1.3565 Acc: [0.48937234 0.48937234]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 18--50] Loss: 1.3174 Acc: [0.50696349]
[Branch 1, Epochs 19--50] Loss: 1.3133 Acc: [0.50880089]
Validation - [Branch 1, Epochs 19--50] Loss: 1.3385 Acc: [0.50212553 0.50212553]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 20--50] Loss: 1.3048 Acc: [0.51375389]
[Branch 1, Epochs 21--50] Loss: 1.2644 Acc: [0.53079647]
Validation - [Branch 1, Epochs 21--50] Loss: 1.3290 Acc: [0.50587647 0.50587647]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 22--50] Loss: 1.2547 Acc: [0.53202141]
[Branch 1, Epochs 23--50] Loss: 1.2461 Acc: [0.53423162]
Validation - [Branch 1, Epochs 23--50] Loss: 1.3102 Acc: [0.51987997 0.51987997]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 24--50] Loss: 1.2389 Acc: [0.53423162]
[Branch 1, Epochs 25--50] Loss: 1.2345 Acc: [0.53630868]
Validation - [Branch 1, Epochs 25--50] Loss: 1.3159 Acc: [0.51237809 0.51237809]
[Branch 1, Epochs 26--50] Loss: 1.2314 Acc: [0.5420073]
[Branch 1, Epochs 27--50] Loss: 1.2234 Acc: [0.54554896]
Validation - [Branch 1, Epochs 27--50] Loss: 1.3205 Acc: [0.51112778 0.51112778]
[Branch 1, Epochs 28--50] Loss: 1.2144 Acc: [0.54775917]
[Branch 1, Epochs 29--50] Loss: 1.2127 Acc: [0.54805209]
Validation - [Branch 1, Epochs 29--50] Loss: 1.3223 Acc: [0.51012753 0.51012753]
[Branch 1, Epochs 30--50] Loss: 1.2092 Acc: [0.54941017]
[Branch 1, Epochs 31--50] Loss: 1.1804 Acc: [0.56014167]
Validation - [Branch 1, Epochs 31--50] Loss: 1.3035 Acc: [0.52288072 0.52288072]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702]
[Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962]
[Branch 1, Epochs 32--50] Loss: 1.1699 Acc: [0.56578702] [336/1905]
[Branch 1, Epochs 33--50] Loss: 1.1673 Acc: [0.56394962]
Validation - [Branch 1, Epochs 33--50] Loss: 1.3089 Acc: [0.51862966 0.51862966]
[Branch 1, Epochs 34--50] Loss: 1.1631 Acc: [0.56844992]
[Branch 1, Epochs 35--50] Loss: 1.1580 Acc: [0.57169867]
Validation - [Branch 1, Epochs 35--50] Loss: 1.3021 Acc: [0.52388097 0.52388097]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/1
[Branch 1, Epochs 36--50] Loss: 1.1573 Acc: [0.56999441]
[Branch 1, Epochs 37--50] Loss: 1.1505 Acc: [0.5722845]
Validation - [Branch 1, Epochs 37--50] Loss: 1.3056 Acc: [0.52313078 0.52313078]
[Branch 1, Epochs 38--50] Loss: 1.1440 Acc: [0.57295023]
[Branch 1, Epochs 39--50] Loss: 1.1456 Acc: [0.57215136]
Validation - [Branch 1, Epochs 39--50] Loss: 1.3046 Acc: [0.51712928 0.51712928]
[Branch 1, Epochs 40--50] Loss: 1.1369 Acc: [0.5755865]
[Branch 1, Epochs 41--50] Loss: 1.1149 Acc: [0.58442734]
Validation - [Branch 1, Epochs 41--50] Loss: 1.3026 Acc: [0.52063016 0.52063016]
[Branch 1, Epochs 42--50] Loss: 1.1087 Acc: [0.58980641]
[Branch 1, Epochs 43--50] Loss: 1.1016 Acc: [0.59084494]
Validation - [Branch 1, Epochs 43--50] Loss: 1.3011 Acc: [0.52163041 0.52163041]
[Branch 1, Epochs 44--50] Loss: 1.0988 Acc: [0.59220302]
[Branch 1, Epochs 45--50] Loss: 1.0945 Acc: [0.59278886]
Validation - [Branch 1, Epochs 45--50] Loss: 1.3202 Acc: [0.52138035 0.52138035]
[Branch 1, Epochs 46--50] Loss: 1.0870 Acc: [0.59611749]
[Branch 1, Epochs 47--50] Loss: 1.0898 Acc: [0.59654355]
Validation - [Branch 1, Epochs 47--50] Loss: 1.3171 Acc: [0.52263066 0.52263066]
[Branch 1, Epochs 48--50] Loss: 1.0858 Acc: [0.59390728]
[Branch 1, Epochs 49--50] Loss: 1.0787 Acc: [0.59936623]
Validation - [Branch 1, Epochs 49--50] Loss: 1.3089 Acc: [0.52013003 0.52013003]
[Branch 1, Epochs 50--50] Loss: 1.0772 Acc: [0.59798152]
Validation - [Branch 1, Epochs 50--50] Loss: 1.3153 Acc: [0.52213053 0.52213053]

[Branch 2, Epochs 1--20] Loss: 2.8556 Acc: [0.57417517 0.34820121]
Validation - [Branch 2, Epochs 1--20] Loss: 1.5449 Acc: [0.52313078 0.41260315 0.49087272]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 2--20] Loss: 2.6831 Acc: [0.57284371 0.42233643]
[Branch 2, Epochs 3--20] Loss: 2.6027 Acc: [0.57505392 0.44806008]
Validation - [Branch 2, Epochs 3--20] Loss: 1.4284 Acc: [0.52088022 0.46786697 0.48162041]
[Branch 2, Epochs 4--20] Loss: 2.5601 Acc: [0.57697121 0.46220009]
[Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032]
Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241]
[Branch 2, Epochs 5--20] Loss: 2.5298 Acc: [0.58256331 0.47855032] [296/1905]
Validation - [Branch 2, Epochs 5--20] Loss: 1.3916 Acc: [0.52363091 0.47036759 0.48962241]
[Branch 2, Epochs 6--20] Loss: 2.4971 Acc: [0.58421431 0.48579341]
[Branch 2, Epochs 7--20] Loss: 2.4818 Acc: [0.58043299 0.49282348]
Validation - [Branch 2, Epochs 7--20] Loss: 1.3955 Acc: [0.52213053 0.47786947 0.48787197]
[Branch 2, Epochs 8--20] Loss: 2.4578 Acc: [0.58128512 0.49817591]
[Branch 2, Epochs 9--20] Loss: 2.4418 Acc: [0.58424094 0.50637765]
Validation - [Branch 2, Epochs 9--20] Loss: 1.3681 Acc: [0.51787947 0.48287072 0.49762441]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 10--20] Loss: 2.4272 Acc: [0.58626475 0.51058504]
[Branch 2, Epochs 11--20] Loss: 2.3619 Acc: [0.59515884 0.52456528]
Validation - [Branch 2, Epochs 11--20] Loss: 1.3298 Acc: [0.52538135 0.50512628 0.50387597]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 12--20] Loss: 2.3347 Acc: [0.59856736 0.53076985]
[Branch 2, Epochs 13--20] Loss: 2.3250 Acc: [0.59963252 0.5332996 ]
Validation - [Branch 2, Epochs 13--20] Loss: 1.3215 Acc: [0.52538135 0.50612653 0.50837709]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 14--20] Loss: 2.3155 Acc: [0.60248183 0.54040955]
[Branch 2, Epochs 15--20] Loss: 2.3073 Acc: [0.60298778 0.54030304]
Validation - [Branch 2, Epochs 15--20] Loss: 1.3224 Acc: [0.52738185 0.51037759 0.50912728]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 16--20] Loss: 2.2925 Acc: [0.60360024 0.54296594]
[Branch 2, Epochs 17--20] Loss: 2.2781 Acc: [0.60700876 0.54853141]
Validation - [Branch 2, Epochs 17--20] Loss: 1.3141 Acc: [0.52738185 0.51337834 0.51262816]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 18--20] Loss: 2.2750 Acc: [0.6034671 0.54637446]
[Branch 2, Epochs 19--20] Loss: 2.2736 Acc: [0.60442574 0.55100791]
Validation - [Branch 2, Epochs 19--20] Loss: 1.3040 Acc: [0.52188047 0.51562891 0.51387847]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 2, Epochs 20--20] Loss: 2.2551 Acc: [0.60746145 0.55500226]
Validation - [Branch 2, Epochs 20--20] Loss: 1.3045 Acc: [0.52338085 0.52063016 0.51787947]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/2
[Branch 3, Epochs 1--20] Loss: 3.9443 Acc: [0.59483929 0.56679892 0.34974569]
Validation - [Branch 3, Epochs 1--20] Loss: 1.5626 Acc: [0.51637909 0.51837959 0.40460115 0.51112778]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 2--20] Loss: 3.7673 Acc: [0.59683647 0.5679706 0.42880729]
[Branch 3, Epochs 3--20] Loss: 3.6904 Acc: [0.59718265 0.57263068 0.45479722]
Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
Validation - [Branch 3, Epochs 3--20] Loss: 1.4270 Acc: [0.51762941 0.52263066 0.46236559 0.51962991] [256/1905]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 4--20] Loss: 3.6386 Acc: [0.60005858 0.57492078 0.46486299]
[Branch 3, Epochs 5--20] Loss: 3.5984 Acc: [0.60133678 0.57771683 0.48076053]
Validation - [Branch 3, Epochs 5--20] Loss: 1.4172 Acc: [0.51512878 0.52538135 0.47136784 0.51937984]
[Branch 3, Epochs 6--20] Loss: 3.5676 Acc: [0.60397305 0.5787021 0.48749767]
[Branch 3, Epochs 7--20] Loss: 3.5401 Acc: [0.60101723 0.57683807 0.4951402 ]
Validation - [Branch 3, Epochs 7--20] Loss: 1.3566 Acc: [0.51912978 0.52388097 0.49112278 0.52513128]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 8--20] Loss: 3.5394 Acc: [0.6026416 0.58037973 0.49748356]
[Branch 3, Epochs 9--20] Loss: 3.4995 Acc: [0.60461215 0.58176444 0.50749607]
Validation - [Branch 3, Epochs 9--20] Loss: 1.3423 Acc: [0.5243811 0.52713178 0.50012503 0.52563141]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 10--20] Loss: 3.4847 Acc: [0.60879291 0.5828296 0.51202301]
[Branch 3, Epochs 11--20] Loss: 3.3727 Acc: [0.62032328 0.59169707 0.53047693]
Validation - [Branch 3, Epochs 11--20] Loss: 1.3051 Acc: [0.52488122 0.52813203 0.50862716 0.53063266]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 12--20] Loss: 3.3554 Acc: [0.62354539 0.59361436 0.53279365]
[Branch 3, Epochs 13--20] Loss: 3.3369 Acc: [0.62711368 0.59382739 0.53726733]
Validation - [Branch 3, Epochs 13--20] Loss: 1.3160 Acc: [0.52663166 0.5223806 0.51612903 0.52538135]
[Branch 3, Epochs 14--20] Loss: 3.3301 Acc: [0.62671424 0.59281549 0.54147472]
[Branch 3, Epochs 15--20] Loss: 3.3026 Acc: [0.63062871 0.60061779 0.54799883]
Validation - [Branch 3, Epochs 15--20] Loss: 1.3099 Acc: [0.52388097 0.5283821 0.51537884 0.53288322]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/3
[Branch 3, Epochs 16--20] Loss: 3.2814 Acc: [0.63211994 0.59803478 0.54602828]
[Branch 3, Epochs 17--20] Loss: 3.2807 Acc: [0.63241286 0.59917983 0.54496312]
Validation - [Branch 3, Epochs 17--20] Loss: 1.3079 Acc: [0.51162791 0.52388097 0.51037759 0.52563141]
[Branch 3, Epochs 18--20] Loss: 3.2613 Acc: [0.63422363 0.60013847 0.55047533]
[Branch 3, Epochs 19--20] Loss: 3.2556 Acc: [0.63417037 0.60389316 0.5506351 ]
Validation - [Branch 3, Epochs 19--20] Loss: 1.2951 Acc: [0.5223806 0.52463116 0.51412853 0.52613153]
[Branch 3, Epochs 20--20] Loss: 3.2297 Acc: [0.6354752 0.60261497 0.55561473]
Validation - [Branch 3, Epochs 20--20] Loss: 1.3062 Acc: [0.51512878 0.52888222 0.51987997 0.53113278]
[Branch 4, Epochs 1--20] Loss: 5.0308 Acc: [0.61233457 0.58786249 0.55348441 0.36183527]
Validation - [Branch 4, Epochs 1--20] Loss: 1.5703 Acc: [0.51837959 0.52313078 0.51962991 0.40135034 0.52463116]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
[Branch 4, Epochs 2--20] Loss: 4.8597 Acc: [0.61257423 0.58935371 0.55904988 0.42744921]
[Branch 4, Epochs 3--20] Loss: 4.7687 Acc: [0.61499747 0.59137752 0.56040796 0.45085612]
Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
Validation - [Branch 4, Epochs 3--20] Loss: 1.4133 Acc: [0.52663166 0.51962991 0.52813203 0.46811703 0.53138285] [216/1905]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
[Branch 4, Epochs 4--20] Loss: 4.7225 Acc: [0.61558331 0.59212313 0.56070088 0.46893724]
[Branch 4, Epochs 5--20] Loss: 4.6684 Acc: [0.62032328 0.59332144 0.56331052 0.48126648]
Validation - [Branch 4, Epochs 5--20] Loss: 1.3839 Acc: [0.51912978 0.52313078 0.52013003 0.48587147 0.52538135]
[Branch 4, Epochs 6--20] Loss: 4.6497 Acc: [0.62069608 0.59260246 0.56488163 0.48635262]
[Branch 4, Epochs 7--20] Loss: 4.5978 Acc: [0.62250686 0.59723591 0.56834341 0.50006657]
Validation - [Branch 4, Epochs 7--20] Loss: 1.3538 Acc: [0.51262816 0.51987997 0.52588147 0.49387347 0.5223806 ]
[Branch 4, Epochs 8--20] Loss: 4.5726 Acc: [0.62101563 0.59819455 0.56722499 0.50608473]
[Branch 4, Epochs 9--20] Loss: 4.5632 Acc: [0.62133518 0.59510558 0.56895588 0.50624451]
Validation - [Branch 4, Epochs 9--20] Loss: 1.3453 Acc: [0.51637909 0.52588147 0.52613153 0.50487622 0.52863216]
[Branch 4, Epochs 10--20] Loss: 4.5453 Acc: [0.62378505 0.59862062 0.56930205 0.51069156]
[Branch 4, Epochs 11--20] Loss: 4.3955 Acc: [0.6430911 0.60911245 0.5772375 0.53132905]
Validation - [Branch 4, Epochs 11--20] Loss: 1.2991 Acc: [0.52313078 0.53388347 0.52863216 0.52113028 0.53313328]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
[Branch 4, Epochs 12--20] Loss: 4.3437 Acc: [0.6505206 0.61539691 0.58213725 0.54080899]
[Branch 4, Epochs 13--20] Loss: 4.3351 Acc: [0.64918915 0.61161558 0.58248342 0.54206055]
Validation - [Branch 4, Epochs 13--20] Loss: 1.2922 Acc: [0.5263816 0.52938235 0.5403851 0.52213053 0.53463366]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
[Branch 4, Epochs 14--20] Loss: 4.3096 Acc: [0.65054723 0.61723431 0.58328229 0.54421751]
[Branch 4, Epochs 15--20] Loss: 4.2922 Acc: [0.65286395 0.61824621 0.5836551 0.54765265]
Validation - [Branch 4, Epochs 15--20] Loss: 1.2925 Acc: [0.52563141 0.53588397 0.53538385 0.52888222 0.54338585]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/4
[Branch 4, Epochs 16--20] Loss: 4.2899 Acc: [0.65297047 0.61752723 0.58477352 0.55119431]
[Branch 4, Epochs 17--20] Loss: 4.2592 Acc: [0.65685831 0.61912497 0.58445397 0.54999601]
Validation - [Branch 4, Epochs 17--20] Loss: 1.3040 Acc: [0.51387847 0.5323831 0.52688172 0.52213053 0.53513378]
[Branch 4, Epochs 18--20] Loss: 4.2520 Acc: [0.65225148 0.617687 0.58567891 0.55478923]
[Branch 4, Epochs 19--20] Loss: 4.2215 Acc: [0.65747077 0.62112215 0.58629137 0.55766517]
Validation - [Branch 4, Epochs 19--20] Loss: 1.2809 Acc: [0.52938235 0.5343836 0.53113278 0.53263316 0.53863466]
[Branch 4, Epochs 20--20] Loss: 4.2053 Acc: [0.66269006 0.62298618 0.5910846 0.5595292 ]
Validation - [Branch 4, Epochs 20--20] Loss: 1.2914 Acc: [0.52113028 0.53313328 0.53188297 0.52463116 0.53713428]
[Branch 5, Epochs 1--20] Loss: 6.0309 Acc: [0.63555508 0.60921897 0.57630549 0.55966234 0.35499161]
Validation - [Branch 5, Epochs 1--20] Loss: 1.5767 Acc: [0.51787947 0.5223806 0.53188297 0.52263066 0.4016004 0.53263316]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5
[Branch 5, Epochs 2--20] Loss: 5.8757 Acc: [0.63305195 0.6049317 0.57784997 0.5611802 0.42811493]
[Branch 5, Epochs 3--20] Loss: 5.7799 Acc: [0.63395734 0.60751471 0.58059276 0.56464197 0.45839214]
Validation - [Branch 5, Epochs 3--20] Loss: 1.4232 Acc: [0.51612903 0.52938235 0.52938235 0.5243811 0.46636659 0.53938485]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5
[Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5 [176/1905]
[Branch 5, Epochs 4--20] Loss: 5.7299 Acc: [0.63558171 0.60730168 0.58027321 0.56552073 0.47213272]
[Branch 5, Epochs 5--20] Loss: 5.6929 Acc: [0.63600778 0.6051181 0.57982052 0.56837004 0.48251804]
Validation - [Branch 5, Epochs 5--20] Loss: 1.3597 Acc: [0.51862966 0.52713178 0.5243811 0.52813203 0.48712178 0.53463366]
[Branch 5, Epochs 6--20] Loss: 5.6363 Acc: [0.64178628 0.61201502 0.58109871 0.57015418 0.4916518 ]
[Branch 5, Epochs 7--20] Loss: 5.6173 Acc: [0.64210582 0.61294703 0.58213725 0.57183181 0.49921444]
Validation - [Branch 5, Epochs 7--20] Loss: 1.3467 Acc: [0.52088022 0.5263816 0.52363091 0.52688172 0.48787197 0.53113278]
[Branch 5, Epochs 8--20] Loss: 5.5779 Acc: [0.64128032 0.61555668 0.58485341 0.57268394 0.50533912]
[Branch 5, Epochs 9--20] Loss: 5.5449 Acc: [0.64282481 0.6141986 0.58578542 0.57369584 0.51223604]
Validation - [Branch 5, Epochs 9--20] Loss: 1.3328 Acc: [0.51412853 0.52213053 0.52538135 0.52613153 0.49887472 0.52863216]
[Branch 5, Epochs 10--20] Loss: 5.5140 Acc: [0.64660613 0.61955103 0.58751631 0.57784997 0.51841397]
[Branch 5, Epochs 11--20] Loss: 5.3430 Acc: [0.66407477 0.62852502 0.596224 0.58456049 0.53561633]
Validation - [Branch 5, Epochs 11--20] Loss: 1.3023 Acc: [0.51987997 0.52913228 0.52663166 0.53213303 0.51262816 0.53888472]
[Branch 5, Epochs 12--20] Loss: 5.2921 Acc: [0.67232977 0.634197 0.59995207 0.58554576 0.54256651]
[Branch 5, Epochs 13--20] Loss: 5.2358 Acc: [0.678774 0.63787181 0.60184273 0.58687721 0.54600165]
Validation - [Branch 5, Epochs 13--20] Loss: 1.2879 Acc: [0.51637909 0.52663166 0.5303826 0.54113528 0.53338335 0.54788697]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/5
[Branch 5, Epochs 14--20] Loss: 5.2167 Acc: [0.67675019 0.63880382 0.60170958 0.59143078 0.55023567]
[Branch 5, Epochs 15--20] Loss: 5.2310 Acc: [0.67901366 0.63757889 0.60189599 0.58815541 0.5498096 ]
Validation - [Branch 5, Epochs 15--20] Loss: 1.2831 Acc: [0.51212803 0.52863216 0.53063266 0.53938485 0.52813203 0.53963491]
[Branch 5, Epochs 16--20] Loss: 5.1916 Acc: [0.67997231 0.63928315 0.60495833 0.58972652 0.55377733]
[Branch 5, Epochs 17--20] Loss: 5.1638 Acc: [0.68021197 0.64026842 0.60477192 0.59459963 0.55886347]
Validation - [Branch 5, Epochs 17--20] Loss: 1.3018 Acc: [0.51912978 0.52813203 0.52763191 0.53413353 0.52488122 0.53913478]
[Branch 5, Epochs 18--20] Loss: 5.1331 Acc: [0.68311453 0.64476873 0.60836684 0.59342796 0.55998189]
[Branch 5, Epochs 19--20] Loss: 5.1474 Acc: [0.68047826 0.6434639 0.60581045 0.5925492 0.55785157]
Validation - [Branch 5, Epochs 19--20] Loss: 1.2865 Acc: [0.51887972 0.52613153 0.53013253 0.53688422 0.52663166 0.54188547]
[Branch 5, Epochs 20--20] Loss: 5.0974 Acc: [0.68497856 0.64567411 0.61001784 0.59198999 0.56141986]
Validation - [Branch 5, Epochs 20--20] Loss: 1.2754 Acc: [0.51962991 0.5283821 0.52863216 0.5403851 0.53713428 0.54613653]
[Branch 6, Epochs 1--20] Loss: 7.0396 Acc: [0.65475461 0.62170799 0.59177696 0.58072591 0.55577451 0.35587037]
Validation - [Branch 6, Epochs 1--20] Loss: 1.5182 Acc: [0.51437859 0.52513128 0.53088272 0.5323831 0.53513378 0.42635659
0.53763441]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6
[Branch 6, Epochs 2--20] Loss: 6.8991 Acc: [0.64945544 0.61606263 0.58956675 0.57667829 0.55838415 0.4295529 ]
[Branch 6, Epochs 3--20] Loss: 6.7781 Acc: [0.65137273 0.62303944 0.59294863 0.58195084 0.56179267 0.45897798]
Validation - [Branch 6, Epochs 3--20] Loss: 1.4170 Acc: [0.51312828 0.51987997 0.52738185 0.53313328 0.52813203 0.46186547
0.53113278]
[Branch 6, Epochs 4--20] Loss: 6.6972 Acc: [0.6579501 0.62586211 0.59712939 0.58381487 0.56389636 0.47809762]
[Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285]
Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097
[Branch 6, Epochs 5--20] Loss: 6.6734 Acc: [0.65374271 0.62322584 0.59353447 0.58341544 0.56432242 0.48619285] [136/1905]
Validation - [Branch 6, Epochs 5--20] Loss: 1.3944 Acc: [0.51312828 0.51962991 0.52463116 0.52563141 0.52488122 0.48387097
0.53088272]
[Branch 6, Epochs 6--20] Loss: 6.6213 Acc: [0.65653876 0.62599526 0.59569142 0.58669081 0.56658589 0.49732378]
[Branch 6, Epochs 7--20] Loss: 6.5620 Acc: [0.66588555 0.62828536 0.59806141 0.5875962 0.56935531 0.50406093]
Validation - [Branch 6, Epochs 7--20] Loss: 1.3493 Acc: [0.51612903 0.52463116 0.52888222 0.53013253 0.53213303 0.50412603
0.53713428]
[Branch 6, Epochs 8--20] Loss: 6.5500 Acc: [0.66178468 0.63140095 0.59891354 0.5892472 0.57058025 0.51173009]
[Branch 6, Epochs 9--20] Loss: 6.5129 Acc: [0.66282321 0.63097489 0.59917983 0.58855484 0.5694352 0.51199638]
Validation - [Branch 6, Epochs 9--20] Loss: 1.3136 Acc: [0.51887972 0.52313078 0.53338335 0.53738435 0.5363841 0.50787697
0.54063516]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6
[Branch 6, Epochs 10--20] Loss: 6.4833 Acc: [0.663915 0.63150747 0.6018161 0.587969 0.57121934 0.52131654]
[Branch 6, Epochs 11--20] Loss: 6.2488 Acc: [0.68836045 0.65139936 0.61654195 0.60056454 0.58144489 0.54043618]
Validation - [Branch 6, Epochs 11--20] Loss: 1.3046 Acc: [0.51887972 0.53163291 0.53263316 0.53688422 0.5343836 0.51662916
0.5403851 ]
[Branch 6, Epochs 12--20] Loss: 6.1712 Acc: [0.69560355 0.65941469 0.61819295 0.60605012 0.58288286 0.54701355]
[Branch 6, Epochs 13--20] Loss: 6.1441 Acc: [0.70037014 0.6591484 0.6197907 0.60607674 0.58298938 0.55031555]
Validation - [Branch 6, Epochs 13--20] Loss: 1.2922 Acc: [0.52188047 0.53163291 0.52713178 0.53613403 0.53113278 0.52188047
0.53888472]
[Branch 6, Epochs 14--20] Loss: 6.0805 Acc: [0.70337922 0.66287647 0.62426437 0.61049716 0.58362847 0.55470934]
[Branch 6, Epochs 15--20] Loss: 6.0863 Acc: [0.70052992 0.66098581 0.62202753 0.60762123 0.58730328 0.55588102]
Validation - [Branch 6, Epochs 15--20] Loss: 1.2885 Acc: [0.51787947 0.51987997 0.52413103 0.53338335 0.53113278 0.52163041
0.54013503]
[Branch 6, Epochs 16--20] Loss: 6.0771 Acc: [0.70258035 0.66271669 0.62711368 0.60791415 0.5854925 0.55420339]
[Branch 6, Epochs 17--20] Loss: 6.0211 Acc: [0.70660134 0.6624504 0.62479695 0.61302692 0.58586531 0.56381647]
Validation - [Branch 6, Epochs 17--20] Loss: 1.3007 Acc: [0.51512878 0.51912978 0.52213053 0.53013253 0.53988497 0.52188047
0.54213553]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6
[Branch 6, Epochs 18--20] Loss: 6.0235 Acc: [0.70516337 0.66513994 0.62540942 0.60980481 0.58975315 0.56317738]
[Branch 6, Epochs 19--20] Loss: 5.9821 Acc: [0.70753335 0.66463398 0.62935052 0.61555668 0.59175033 0.56818363]
Validation - [Branch 6, Epochs 19--20] Loss: 1.2859 Acc: [0.51237809 0.52538135 0.53863466 0.53588397 0.53888472 0.52538135
0.5483871 ]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/6
[Branch 6, Epochs 20--20] Loss: 5.9601 Acc: [0.70628179 0.66865497 0.63132107 0.61451815 0.58956675 0.56685218]
Validation - [Branch 6, Epochs 20--20] Loss: 1.2731 Acc: [0.51912978 0.53063266 0.52513128 0.53138285 0.53063266 0.52888222
0.53988497]
[Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086
[Branch 7, Epochs 1--20] Loss: 7.8431 Acc: [0.67925332 0.64743163 0.61012436 0.59806141 0.58243017 0.57958086 [96/1905]
0.36071685]
Validation - [Branch 7, Epochs 1--20] Loss: 1.5718 Acc: [0.51262816 0.52063016 0.52088022 0.53538385 0.53538385 0.52913228
0.4136034 0.53538385]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7
[Branch 7, Epochs 2--20] Loss: 7.6890 Acc: [0.67352808 0.64538119 0.61145581 0.60072431 0.5828296 0.58109871
0.43474556]
[Branch 7, Epochs 3--20] Loss: 7.5777 Acc: [0.67571166 0.65038745 0.61390568 0.60381328 0.58501318 0.58533273
0.46496951]
Validation - [Branch 7, Epochs 3--20] Loss: 1.4135 Acc: [0.52488122 0.52113028 0.52513128 0.5403851 0.53413353 0.53113278
0.4656164 0.54488622]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7
[Branch 7, Epochs 4--20] Loss: 7.5092 Acc: [0.68015871 0.64977498 0.6166751 0.60266823 0.58780923 0.58682396
0.47815088]
[Branch 7, Epochs 5--20] Loss: 7.4739 Acc: [0.68031848 0.64679253 0.61286715 0.60296115 0.58474689 0.58432083
0.48970788]
Validation - [Branch 7, Epochs 5--20] Loss: 1.3716 Acc: [0.51812953 0.51787947 0.52488122 0.53113278 0.53338335 0.53063266
0.48412103 0.5423856 ]
[Branch 7, Epochs 6--20] Loss: 7.3876 Acc: [0.68415306 0.65283732 0.62082923 0.60655607 0.58884776 0.58807552
0.50225015]
[Branch 7, Epochs 7--20] Loss: 7.3576 Acc: [0.68433947 0.65358294 0.61656858 0.60810055 0.58826192 0.58935371
0.50667057]
Validation - [Branch 7, Epochs 7--20] Loss: 1.3330 Acc: [0.51312828 0.52338085 0.5303826 0.53213303 0.53413353 0.52788197
0.50012503 0.54088522]
[Branch 7, Epochs 8--20] Loss: 7.2918 Acc: [0.69176897 0.65528719 0.62317258 0.60983144 0.59105797 0.5927356
0.51362075]
[Branch 7, Epochs 9--20] Loss: 7.2797 Acc: [0.68809416 0.65435518 0.62330573 0.61156233 0.59230954 0.59558491
0.52179586]
Validation - [Branch 7, Epochs 9--20] Loss: 1.3294 Acc: [0.50262566 0.51787947 0.52863216 0.53338335 0.53538385 0.5383846
0.50162541 0.54488622]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7
[Branch 7, Epochs 10--20] Loss: 7.2314 Acc: [0.6934466 0.66130536 0.62551594 0.61467792 0.59324155 0.59715602
0.52523101]
[Branch 7, Epochs 11--20] Loss: 6.9503 Acc: [0.71493622 0.67616435 0.64128032 0.62703379 0.6042926 0.60527787
0.54738636]
Validation - [Branch 7, Epochs 11--20] Loss: 1.2938 Acc: [0.51212803 0.51787947 0.52813203 0.52788197 0.53513378 0.53463366
0.52263066 0.5423856 ]
[Branch 7, Epochs 12--20] Loss: 6.8322 Acc: [0.72659974 0.68844034 0.65020105 0.62908423 0.6069555 0.60913908
0.55122094]
[Branch 7, Epochs 13--20] Loss: 6.8261 Acc: [0.72540143 0.6839134 0.64809736 0.6323596 0.60650281 0.60852662
0.55281868]
Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397
Validation - [Branch 7, Epochs 13--20] Loss: 1.2952 Acc: [0.51887972 0.52488122 0.52488122 0.53163291 0.54488622 0.53588397
0.51962991 0.55288822]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/7
[Branch 7, Epochs 14--20] Loss: 6.7826 Acc: [0.72992837 0.6880409 0.64958858 0.63185365 0.60748808 0.61134929
0.55707933]
[Branch 7, Epochs 15--20] Loss: 6.7051 Acc: [0.7344553 0.69203526 0.65563337 0.63803158 0.61148244 0.61134929
0.56235188]
Validation - [Branch 7, Epochs 15--20] Loss: 1.2900 Acc: [0.51112778 0.52588147 0.52288072 0.52713178 0.5363841 0.5343836
0.52013003 0.54463616]
[Branch 7, Epochs 16--20] Loss: 6.7301 Acc: [0.73067398 0.69203526 0.65230474 0.63606103 0.61166884 0.60977818
0.56349692]
[Branch 7, Epochs 17--20] Loss: 6.6841 Acc: [0.73536069 0.69408569 0.65326339 0.64221234 0.61465129 0.61126941
0.56642612]
Validation - [Branch 7, Epochs 17--20] Loss: 1.3045 Acc: [0.51062766 0.51462866 0.52988247 0.53688422 0.53463366 0.52913228
0.51737934 0.54363591]
[Branch 7, Epochs 18--20] Loss: 6.6579 Acc: [0.7385828 0.69563018 0.65470136 0.63859079 0.61222805 0.61555668
0.56685218]
[Branch 7, Epochs 19--20] Loss: 6.5918 Acc: [0.74031369 0.69797353 0.66117221 0.64141347 0.61387905 0.61640881
0.57207147]
Validation - [Branch 7, Epochs 19--20] Loss: 1.2908 Acc: [0.51537884 0.51437859 0.52788197 0.54288572 0.53013253 0.53713428
0.52938235 0.54913728]
[Branch 7, Epochs 20--20] Loss: 6.5987 Acc: [0.73914201 0.70055655 0.66103906 0.64362368 0.61912497 0.61797992
0.5737491 ]
Validation - [Branch 7, Epochs 20--20] Loss: 1.2965 Acc: [0.50787697 0.51537884 0.52513128 0.5343836 0.53488372 0.53613403
0.52588147 0.54538635]
[Branch 8, Epochs 1--20] Loss: 8.7097 Acc: [0.70132879 0.66625835 0.63422363 0.61917823 0.59949937 0.60019173
0.56576039 0.35927889]
Validation - [Branch 8, Epochs 1--20] Loss: 1.5464 Acc: [0.51237809 0.51937984 0.52513128 0.52588147 0.52863216 0.52963241
0.52613153 0.40985246 0.53863466]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8
[Branch 8, Epochs 2--20] Loss: 8.5017 Acc: [0.69741432 0.66798924 0.63347802 0.61917823 0.59617075 0.59963252
0.56927542 0.43740846]
[Branch 8, Epochs 3--20] Loss: 8.4253 Acc: [0.70015711 0.6653796 0.63094826 0.61939126 0.59835433 0.60045802
0.56999441 0.46739275]
Validation - [Branch 8, Epochs 3--20] Loss: 1.4408 Acc: [0.50862716 0.51687922 0.5223806 0.52988247 0.52988247 0.52713178
0.52788197 0.46261565 0.54013503]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8
[Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8 [16/1905]
[Branch 8, Epochs 4--20] Loss: 8.3522 Acc: [0.6997843 0.66737677 0.63526216 0.62189439 0.60184273 0.60173621
0.57350944 0.48033446]
[Branch 8, Epochs 5--20] Loss: 8.3245 Acc: [0.69999734 0.66490027 0.63369105 0.62042979 0.60146992 0.60434586
0.57137912 0.49564615]
Validation - [Branch 8, Epochs 5--20] Loss: 1.3778 Acc: [0.51387847 0.51112778 0.52613153 0.52763191 0.53263316 0.53788447
0.52588147 0.48362091 0.54463616]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8
[Branch 8, Epochs 6--20] Loss: 8.2452 Acc: [0.70385855 0.67059889 0.63571486 0.6224536 0.60277475 0.60690224
0.57502729 0.50411419]
[Branch 8, Epochs 7--20] Loss: 8.2005 Acc: [0.70479056 0.67174394 0.6385109 0.62620829 0.60426597 0.60607674
0.57617234 0.50928022]
Validation - [Branch 8, Epochs 7--20] Loss: 1.3490 Acc: [0.50712678 0.51762941 0.5283821 0.52663166 0.5323831 0.52588147
0.52513128 0.49737434 0.54188547]
[Branch 8, Epochs 8--20] Loss: 8.1161 Acc: [0.70811919 0.67544537 0.64269166 0.62495673 0.60770112 0.6084201
0.58021996 0.51415333]
[Branch 8, Epochs 9--20] Loss: 8.0926 Acc: [0.70870503 0.67778873 0.64165313 0.62743323 0.60884616 0.60921897
0.57713099 0.52435225]
Validation - [Branch 8, Epochs 9--20] Loss: 1.3282 Acc: [0.51487872 0.51762941 0.52613153 0.52738185 0.52788197 0.53188297
0.53563391 0.51162791 0.5403851 ]
[Branch 8, Epochs 10--20] Loss: 8.0606 Acc: [0.71131468 0.67741592 0.64514153 0.6302559 0.60876628 0.60983144
0.58413442 0.53047693]
[Branch 8, Epochs 11--20] Loss: 7.7395 Acc: [0.73658563 0.70279339 0.66018694 0.64572737 0.62120203 0.62192102
0.58682396 0.54554896]
Validation - [Branch 8, Epochs 11--20] Loss: 1.3089 Acc: [0.52388097 0.52188047 0.53313328 0.52488122 0.53938485 0.52713178
0.52613153 0.51587897 0.54713678]
Network has been saved at: ./experiments/myAffectNet_Discrete/ESR_9-AffectNet_Discrete/Saved Networks/8
[Branch 8, Epochs 12--20] Loss: 7.5885 Acc: [0.74702421 0.70822571 0.67201023 0.65139936 0.62748649 0.62620829

Hi, I need to get emotions from a video with a participant doing a task.

Your work seems really interesting and for the majority, it works. However, there are moments during the video where this error happens:
Error raised during video mode.
Traceback (most recent call last):
File "main_esr9.py", line 253, in
main()
File "main_esr9.py", line 239, in main
args.size, args.cuda, args.frames, args.branch, args.no_plot, args.face_detection)
File "main_esr9.py", line 172, in video
raise e
File "main_esr9.py", line 159, in video
gradcam)
File "/Desktop/Efficient-Facial-Feature-Learning-with-Wide-Ensemble-based-Convolutional-Neural-Networks-master/controller/cvision.py", line 118, in recognize_facial_expression
input_face = _pre_process_input_image(face)
File "/Desktop/Efficient-Facial-Feature-Learning-with-Wide-Ensemble-based-Convolutional-Neural-Networks-master/controller/cvision.py", line 205, in _pre_process_input_image
image = uimage.resize(image, ESR.INPUT_IMAGE_SIZE)
File "/Desktop/Efficient-Facial-Feature-Learning-with-Wide-Ensemble-based-Convolutional-Neural-Networks-master/model/utils/uimage.py", line 268, in resize
return cv2.resize(image, output_size)
cv2.error: OpenCV(4.5.1) /tmp/pip-req-build-n_alixql/opencv/modules/imgproc/src/resize.cpp:4051: error: (-215:Assertion failed) !ssize.empty() in function 'resize'

The program is able to ignore moments where the face is not present which is great, but there are situations where the participant looks around and this error happens.

Can you help me?

hi, where could I find the trained model? could you please upload it to share. thank you a lot!

Processing...
qt.qpa.xcb: could not connect to display
qt.qpa.plugin: Could not load the Qt platform plugin "xcb" in "/home/bcz/bcz/anaconda3/envs/faster-rcnn-envi/lib/python3.7/site-packages/cv2/qt/plugins" even though it was found.
This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.

Available platform plugins are: xcb.

Aborted (core dumped)

I am a beginner of facial expression recognition. I really need your help! What should I do？

Dear author, thanks for sharing so wonderful work. I have a question to ask you. In my case, I only focus on smile expression. Can I train a binary problem based on your work? Can you give some help or advice? Thanks!

Dear author. Thanks for replying me. I want to use the second way you told to train a binary task. That is only re-train the last layer. How to do with it? I'm new in FER. Can you tell more details?

Dear author
I have a question to ask. The model runs much slower on cloud server with nvidia p40 than on my own laptop with nvidia mx250. I'm so confused. Are there too many picture operations in your infer code? How to improve the execute speed? Can you provide some advice? Thanks!

Save predictions in a CSV file.

-o (--output):
[On development]
Saves ESR-9's outputs in a CSV file in the specified location.

Hi,

Thank you for providing the codes and the pre-trained models.

Is the pre-trained model supplied in the repo fine tuned on FER+ dataset or just trained on AffectNet? You have mentioned in paper that a good performance is achieved on FER+ after its fine tuning.

It would be great if you could provide the performance of the trained model supplied in the repo on the datasets you tested with.

Thanks,

Dear author，thanks for your sharing.
A problem on Line210 in esr_9.py confused me. When loading the branch models, the parameters of the BN layers did not seem to be frozen, which caused output of self.bn1(self.conv1(x_shared_representations)) (Line 108 in esr_9,py) and the prediction results to be changed when the photos were tested in batch. Would this problem affect the performance of the model? Look forward to your favourable reply.

when I use "pre_process_affect_net" to process the images, I only got the Validation File， Training_Labeled File and Training_Unlabeled File are not available. Is my base_path_to_images, base_path_to_annotations setting wrong? How can I handle this? Looking forward to your reply!

Hi author, thanks for your great work and contribution!
Could you please give me the evaluation code that you evaluate the performance of ESRs?
Looking forward to your reply!

Dear author, I test your model on subset of fer2013. But I have a question. Since you used fer+ label in your work, how can I validation the model? I use origin label of fer2013, it seems not good. Thanks!