Why do I keep getting this error on the picture when I run Evaluate.py? How should I solve it? about stm32ai-modelzoo

[MCHSTM]

Hello,

Can you please share the yaml file you used?

[znby6]

你好，

您能分享一下您使用的yaml文件吗？

Hello, this is a screenshot of my evaluate_user_config.yaml file, how can I solve this error, thank you very much.

[MCHSTM]

Your Yaml file configuration seems good.
Can you share the quantized model + the test set in order to check if I can regenerate your issue?

[znby6]

您的 Yaml 文件配置看起来不错。 您能否分享量化模型+测试集，以检查我是否可以重新生成您的问题？

2023_07_20_17_47_31.zip
test.zip
Here is the zipped file of my quantized model and test set, any help is greatly appreciated, hope this solves my problem

[MCHSTM]

I run the evaluation script using the provided quantized model and test set and I got the following results:

[INFO] Evaluating the quantized model ...
[INFO] Starting calculating map
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
100%|███████████████████████████████████████████████████24/24[06:31<00:00, 16.30s/it]

[RESULTS] AP for class crack = 0.00 %

[RESULTS] AP for class pot = 0.00 %

[RESULTS]` AP for class crackle = 0.00 %

[RESULTS] AP for class Fabrics = 0.00 %

[RESULTS] AP for class road = 0.00 %

[RESULTS] AP for class tile = 0.00 %

[RESULTS] Quantized model mAP = 0.00 %

[INFO] Evaluation took 6.556 minutes

Please make sure that you are using the latest version of the project by cloning it again.

[znby6]

I run the evaluation script using the provided quantized model and test set and I got the following results:

[INFO] Evaluating the quantized model ...
[INFO] Starting calculating map
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
100%|███████████████████████████████████████████████████24/24[06:31<00:00, 16.30s/it]

[RESULTS] AP for class crack = 0.00 %

[RESULTS] AP for class pot = 0.00 %

[RESULTS]` AP for class crackle = 0.00 %

[RESULTS] AP for class Fabrics = 0.00 %

[RESULTS] AP for class road = 0.00 %

[RESULTS] AP for class tile = 0.00 %

[RESULTS] Quantized model mAP = 0.00 %

[INFO] Evaluation took 6.556 minutes

Please make sure that you are using the latest version of the project by cloning it again.

Hello, I re-downloaded the latest project on github and re-configured, but the error of the previous evaluate.py still appeared. How did you run it to get the mAP calculation result? Thank you for your help！

[MCHSTM]

Hi,
I provided the same configuration as yours in the yaml file.
Could you please precise which version of python, numpy and tensorflow you have in your environment?

[znby6]

Hi, I provided the same configuration as yours in the yaml file. Could you please precise which version of python, numpy and tensorflow you have in your environment?
Hello, I am using python version 3.8.17, numpy version 1.23.4, tensorflow-gpu 2.8.3

[MCHSTM]

Hi,

We recommend using Python v3.9 or v3.10. as mentioned here

I hope this solve your issue, let me know.

[znby6]

你好，

我们建议使用 Python v3.9 或 v3.10。正如这里提到的

我希望这能解决您的问题，请告诉我。

Hello, I tried to change the python version, but this error still occurred: TypeError: '<' not supported between instances of 'NoneType' and 'NoneType', May I ask how you solved this problem, I am very distressed about this problem, I have tried many methods and still can't solve it.

[MCHSTM]

Hi,

can you please run the following commands and share with us the output:

pip list

python --version

Also which OS you are using?

[znby6]

你好，

您能否运行以下命令并与我们分享输出：

pip list

python --version

另外您正在使用哪个操作系统？

Package Version

---

absl-py 1.4.0
alembic 1.11.1
antlr4-python3-runtime 4.9.3
appdirs 1.4.4
astunparse 1.6.3
audioread 3.0.0
blinker 1.6.2
cachetools 5.3.1
certifi 2023.7.22
cffi 1.15.1
charset-normalizer 3.2.0
click 8.1.6
cloudpickle 2.2.1
cmaes 0.10.0
coloredlogs 15.0.1
colorlog 6.7.0
contourpy 1.1.0
cycler 0.11.0
databricks-cli 0.17.7
decorator 5.1.1
docker 6.1.3
entrypoints 0.4
Flask 2.3.2
flatbuffers 23.5.26
fonttools 4.41.1
gast 0.5.4
gitdb 4.0.10
GitPython 3.1.32
google-auth 2.22.0
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
greenlet 2.0.2
grpcio 1.56.2
gunicorn 20.1.0
h5py 3.9.0
humanfriendly 10.0
hydra-core 1.3.2
idna 3.4
imageio 2.31.1
imgaug 0.4.0
importlib-metadata 6.8.0
itsdangerous 2.1.2
Jinja2 3.1.2
joblib 1.2.0
keras 2.8.0
Keras-Preprocessing 1.1.2
kiwisolver 1.4.4
lazy_loader 0.3
libclang 16.0.6
librosa 0.10.0.post2
llvmlite 0.40.1
Mako 1.2.4
Markdown 3.4.4
MarkupSafe 2.1.3
matplotlib 3.6.2
mlflow 2.3.0
mpmath 1.3.0
msgpack 1.0.5
munch 2.5.0
networkx 3.1
numba 0.57.1
numpy 1.23.4
oauthlib 3.2.2
omegaconf 2.3.0
onnx 1.12.0
onnxconverter-common 1.13.0
onnxruntime 1.14.1
opencv-python 4.6.0.66
opt-einsum 3.3.0
optuna 3.1.1
packaging 23.1
pandas 1.5.3
Pillow 10.0.0
pip 23.2.1
pooch 1.6.0
protobuf 3.19.6
pyarrow 11.0.0
pyasn1 0.5.0
pyasn1-modules 0.3.0
pycparser 2.21
PyJWT 2.8.0
pyparsing 3.1.0
pyserial 3.5
python-dateutil 2.8.2
pytz 2023.3
PyWavelets 1.4.1
PyYAML 6.0.1
querystring-parser 1.2.4
requests 2.31.0
requests-oauthlib 1.3.1
rsa 4.9
scikit-image 0.21.0
scikit-learn 1.2.2
scipy 1.11.1
seaborn 0.12.2
setuptools 68.0.0
shapely 2.0.1
six 1.16.0
skl2onnx 1.14.0
smmap 5.0.0
soundfile 0.12.1
soxr 0.3.5
SQLAlchemy 2.0.19
sqlparse 0.4.4
sympy 1.12
tabulate 0.9.0
tensorboard 2.8.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorflow 2.8.3
tensorflow-estimator 2.8.0
tensorflow-io-gcs-filesystem 0.32.0
termcolor 2.3.0
threadpoolctl 3.2.0
tifffile 2023.7.18
tqdm 4.65.0
typing_extensions 4.7.1
urllib3 1.26.16
websocket-client 1.6.1
Werkzeug 2.3.6
wget 3.2
wheel 0.38.4
wrapt 1.15.0
zipp 3.16.2
python --version
Python 3.10.12
Unix

[MCHSTM]

Couldn't regenerate the issue using the same environment.
Closing the issue for now.