Update optimization pipelines to work with CARLA en bird-eye-view about deeplearningstudio

[sergiopaniego]

To install TensorRT for inference: tensorflow/tensorflow#57679

[sergiopaniego]

User guide for TensorRT: https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html

[sergiopaniego]

Compatibility table of Docker images and TensorRT versions: https://docs.nvidia.com/deeplearning/tensorrt/container-release-notes/index.html under NVIDIA TensorRT Container Versions

[sergiopaniego]

TensorRT version used: 7.2.2.1
Docker image used: nvcr.io/nvidia/tensorflow: 20.12-tf2-py3

[sergiopaniego]

Command user for conversion:

python3 tensorrt_optimize.py --data_dir /docker-tensorrt/carla_dataset_previous_v/ --preprocess crop --preprocess extreme --data_augs 2 --img_shape "150,50,3" --batch_size 16 --model_path /docker-tensorrt/20230125-120238_pilotnet_CARLA_14_12_dataset_bird_eye_300_epochs_no_flip_3_output_both_directions_all_towns_adam_AFFINE_PAPER.h5 --model_name pilotnet --eval_base True --precision int8

[sergiopaniego]

• Update READE with instructions
• Use tf.Dataset

[sergiopaniego]

tensorflow/tensorflow#57679

[sergiopaniego]

Problems with TensorRT INT8 https://forums.developer.nvidia.com/t/tensorrt-int8-calibration-issue/168422/6