Running it on Orange Pi 5B Python 3.11 tflite_runtime 2.14.0 Installation

Hello Federico, I tried this model - it's big! Very big! <p dir=

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-ho

arm-software,armnn

Comments (22)

Colm-in-Arm commented on July 22, 2024 1

Hello Federico,

I tried this model - it's big! Very big!

I started with the changes I'd made for #762 , https://review.mlplatform.org/c/ml/armnn/+/11379

For CpuRef one additional change was required to get the model to execute:

diff --git a/src/backends/reference/RefLayerSupport.cpp b/src/backends/reference/RefLayerSupport.cpp
index 3e04a19df..b1fa83e83 100644
--- a/src/backends/reference/RefLayerSupport.cpp
+++ b/src/backends/reference/RefLayerSupport.cpp
@@ -862,8 +862,7 @@ bool RefLayerSupport::IsCastSupported(const TensorInfo& input,
DataType::QAsymmS8,
DataType::QAsymmU8,
DataType::QSymmS16,
           DataType::Signed32,
           DataType::Signed64
           DataType::Signed32
   };
bool supported = true;

I'll have to see if this an appropriate change. We could instead fully implement the Signed64 Cast operation.

As the model file is so large I couldn't easily get it onto an Android device but I did try it on an aarch64 Ubuntu device. It failed in a StridedSlice layer. I'll investigate that next.

Colm.

from armnn.

federicoparra commented on July 22, 2024

Anyone please?

from armnn.

tracyn-arm commented on July 22, 2024

Hi. I am not able to access the link to your model file. A suggestion though is to see if the model loads another way such as:
build-x86_64/debug/armnn/tests/ExecuteNetwork -c CpuAcc -m $model -T delegate # Fix path for your config
Also, it looks like you are on a recent version of Arm NN but not the associated Tensorflow. We have updated to Tensorflow 2.15 so something else to check. Thanks.

from armnn.

federicoparra commented on July 22, 2024

Hi. I am not able to access the link to your model file. A suggestion though is to see if the model loads another way such as: build-x86_64/debug/armnn/tests/ExecuteNetwork -c CpuAcc -m $model -T delegate # Fix path for your config Also, it looks like you are on a recent version of Arm NN but not the associated Tensorflow. We have updated to Tensorflow 2.15 so something else to check. Thanks.

sorry file was deleted by mistake, I'll upload again but in the meantime this one https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=drive_link is the same the only difference is it has dynamic inputs which will throw a warning but the crash is the same above (so the crash is not because of the dynamic inputs, I have tried it with fixed inputs and get the same crash).

I have not been able to obtain anything newer than 2.14 for tflite_runtime module using pip, I'll check by using their repo or by compiling it on my own (they might not have 2.15 in arch64).

I'll also check using execute network and report back.

from armnn.

federicoparra commented on July 22, 2024

Hi @tracyn-arm I've tried with Tensorflow 2.15 and with the new (last week) version of ARMNN.
I don't have ExecuteNetwork compiled so I could not try that (I don't know how to compile it).
Could you please try the network yourself? https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=drive_link

from armnn.

catcor01 commented on July 22, 2024

Hi @federicoparra,

ExecuteNetwork is available to run in the following prebuilt binaries for the 24.02 release: https://github.com/ARM-software/armnn/releases/tag/v24.02. You can download and unzip the binary that is required for your specific architecture and run the model with ExecuteNetwork (see comment from @tracyn-arm above for command) . I will pick this up during the week to investigate further the above error. If possible could you open access to the google drive link provided as I am getting permission denied error.

Regards, Cathal.

from armnn.

catcor01 commented on July 22, 2024

Hi again,

Unfortunately, we have a restriction on not being able to download privately supplied models to us. Would the model you have supplied be available publically somewhere which would allow us to download and use it?

Regards, Cathal.

from armnn.

federicoparra commented on July 22, 2024

Hi @federicoparra,

ExecuteNetwork is available to run in the following prebuilt binaries for the 24.02 release: https://github.com/ARM-software/armnn/releases/tag/v24.02. You can download and unzip the binary that is required for your specific architecture and run the model with ExecuteNetwork (see comment from @tracyn-arm above for command) . I will pick this up during the week to investigate further the above error. If possible could you open access to the google drive link provided as I am getting permission denied error.

Regards, Cathal.

I compiled ARMNN myself using the scripts provided - is there a script to compile execute network? My understanding is that your releases for LINUX do not support the Delegate (just the parser), and I want to use the Delegate in Linux (my compiled version works well with most TFlite networks, just not with the one I'm talking about in this bug repport).

About the link, I apoligize once more, I realize it wasn't shared publically, here's the link it works now: https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=sharing

from armnn.

federicoparra commented on July 22, 2024

Hi again,

Unfortunately, we have a restriction on not being able to download privately supplied models to us. Would the model you have supplied be available publically somewhere which would allow us to download and use it?

Regards, Cathal.

The network is publically available here https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b but it's a pytorch network.
Transforming it to tensorflow lite is not trivial. I can assure you that the tflite version I shared above (https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=sharing) works perfectly fine when using it without the ARMNN delegate, and produces the exact same results as the pytorch original one.

from armnn.

catcor01 commented on July 22, 2024

All release prebuilt binaries should have ExecuteNetwork included: for example, linux-aarch64 here: https://github.com/ARM-software/armnn/releases/download/v24.02/ArmNN-linux-aarch64.tar.gz

To manually build ArmNN, you can use the build tool (documentation here). Please use main as there were some recent changes to the build tool. I have just realized that the build-armnn.sh script does not include ExecuteNetwork in the output tar file. I am going to create a patch to fix this. In the meantime you should be able get ExecuteNetwork in the output source/ directory.

Regards, Cathal.

from armnn.

catcor01 commented on July 22, 2024

Hello, I have created a patch that is currently in review to build ExecuteNetwork using the build-tool. Please feel free to use.

11282: Enable build of execute network in build tool. | https://review.mlplatform.org/c/ml/armnn/+/11282

from armnn.

federicoparra commented on July 22, 2024

Hi! I was finally able to run the model with ExecuteNetwork, this is the output:

$ LD_LIBRARY_PATH=. ./ExecuteNetwork -c CpuAcc GpuAcc -m ../models/stablelm16fixed.tflite -T delegate > output_file.txt
INFO: TfLiteArmnnDelegate: Added backend CpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: ADD: not supported by armnn: in validate_arguments src/cpu/kernels/CpuAddKernel.cpp:114: ITensor data type S64 not supported by this kernel
ERROR: ADD: not supported by any specified backend
WARNING: COMPARISON: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:488: ITensor data type S64 not supported by this kernel
ERROR: COMPARISON: not supported by any specified backend
WARNING: MINIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
ERROR: MINIMUM: not supported by any specified backend
WARNING: MAXIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
ERROR: MAXIMUM: not supported by any specified backend
WARNING: BROADCAST_TO: not supported by armnn
ERROR: BROADCAST_TO: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
ERROR: Operator ADD [0] is not supported by armnn_delegate.
ERROR: Operator GATHER [36] is not supported by armnn_delegate.
ERROR: Operator MAXIMUM [55] is not supported by armnn_delegate.
ERROR: Operator MINIMUM [57] is not supported by armnn_delegate.
ERROR: Operator LESS [58] is not supported by armnn_delegate.
ERROR: Operator SELECT [64] is not supported by armnn_delegate.
ERROR: Operator SELECT_V2 [123] is not supported by armnn_delegate.
ERROR: Operator BROADCAST_TO [130] is not supported by armnn_delegate.
Warning: No input files provided, input tensors will be filled with 0s.
Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 19.51 ms.
Info: ArmnnSubgraph creation
Info: Parse nodes to ArmNN time: 1751.37 ms
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: Optimize ArmnnSubgraph time: 8591.94 ms
Error: An error occurred when preparing the network workloads: ReshapeQueueDescriptor: Tensor type is not supported.
Fatal: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded: An error occurred when preparing the network workloads: ReshapeQueueDescriptor: Tensor type is not supported.) caught from LoadNetwork.
Info: Shutdown time: 0.57 ms.

from armnn.

federicoparra commented on July 22, 2024

changing the order of the backends (putting gpu first):

$ LD_LIBRARY_PATH=. ./ExecuteNetwork -c GpuAcc CpuAcc -m ../models/stablelm16fixed.tflite -T delegate
Warning: No input files provided, input tensors will be filled with 0s.
Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 17.03 ms.
INFO: TfLiteArmnnDelegate: Added backend GpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: ADD: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: ADD: not supported by any specified backend
WARNING: MINIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: MINIMUM: not supported by any specified backend
WARNING: MAXIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: MAXIMUM: not supported by any specified backend
WARNING: BROADCAST_TO: not supported by armnn
ERROR: BROADCAST_TO: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
ERROR: Operator ADD [0] is not supported by armnn_delegate.
ERROR: Operator GATHER [36] is not supported by armnn_delegate.
ERROR: Operator MAXIMUM [55] is not supported by armnn_delegate.
ERROR: Operator MINIMUM [57] is not supported by armnn_delegate.
ERROR: Operator SELECT [64] is not supported by armnn_delegate.
ERROR: Operator SELECT_V2 [123] is not supported by armnn_delegate.
ERROR: Operator BROADCAST_TO [130] is not supported by armnn_delegate.
Info: ArmnnSubgraph creation
WARNING: CONSTANT: not supported by armnn: Unsupported DataType
ERROR: CONSTANT: not supported by any specified backend
Fatal:
Info: Shutdown time: 0.56 ms.

from armnn.

federicoparra commented on July 22, 2024

@catcor01 @tracyn-arm Could it be simply that ARMNN delegate doesn't support constant inputs tensors?
This network is an LLM, as such it needs as inputs INT32 tensors (the tokens) and also outputs INT32 tensors.
Does ARMNN delegate support this?

from armnn.

catcor01 commented on July 22, 2024

For GpuAcc: It looks constant is not supported (in ArmNN or the delegate) due to datatype but INT32 is one of the supported datatypes. I can see there are some INT64 operators in your model. I am wondering if any of your constant/inputs are INT64. I can see INT64 input is not supported here in ExecuteNetwork: https://github.com/ARM-software/armnn/blob/branches/armnn_24_02/tests/ExecuteNetwork/TfliteExecutor.cpp#L180. I am going to follow up with the team and check if it is on our radar to add INT64 in ExecuteNetwork.

Although the above statement seems to be conflicting because I would expect the same failure to happen in the first test but in that test the model seem to get parsed fine through the delegate. Running on only 1 backend might isolate the problem more. It may be that fallback from one backend to another is somehow allowing operators to get supported in the first case and not in the second.

from armnn.

federicoparra commented on July 22, 2024

I went back and made sure that the model did not include any int64 input or operator; indeed there were, and I went ahead and modified it to make sure it exclusively uses int32, never int64.

This is the modified model: https://drive.google.com/file/d/1lLtmUjoTvvllNw6fR5Af0pct-agCJ3s5/view?usp=sharing

unfortunately this changed nothing:

Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 19.57 ms.
Info: ArmnnSubgraph creation
INFO: TfLiteArmnnDelegate: Added backend GpuAcc
INFO: TfLiteArmnnDelegate: Added backend CpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: CAST: not supported by armnn: in validate_arguments src/gpu/cl/kernels/ClCastKernel.cpp:59: ITensor data type S64 not supported by this kernel
WARNING: ADD: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: ADD: not supported by armnn: in validate_arguments src/cpu/kernels/CpuAddKernel.cpp:114: ITensor data type S64 not supported by this kernel
WARNING: MINIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MINIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
WARNING: MAXIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MAXIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
WARNING: CONSTANT: not supported by armnn: Unsupported DataType
WARNING: CONSTANT: not supported by armnn: Unsupported DataType

So it is still saying CONSTANT not supported for INT32.

The same is true when using just one delegate (gpu or cpu) and the same is true when using ExecuteNetwork:

ExecuteNetwork -c GpuAcc -m ../wallE/stablelm16fixed.tflite -T delegate

Error: An error occurred when preparing the network workloads: StridedSliceQueueDescriptor: Tensor type is not supported.
Fatal: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded: An error occurred when preparing the network workloads: StridedSliceQueueDescriptor: Tensor type is not supported.) caught from LoadNetwork.
Info: Shutdown time: 2.09 ms.

from armnn.

federicoparra commented on July 22, 2024

I also don't undertand all these warnings: isn't ARMNN supposed to be compatible with ALL ops, falling back to standard tensorflow lite implementation (i.e., CPU) when an op is not optimized ?

Please, do test the model and help me

from armnn.

federicoparra commented on July 22, 2024

As requested on #762 by @Colm-in-Arm here is the license statement for my TFLITE conversion of StableLm-2:

I want to assert here that the converted tflite model which is causing the bug described in this bug report and that can be downloaded from the following link https://drive.google.com/file/d/1lLtmUjoTvvllNw6fR5Af0pct-agCJ3s5/view?usp=sharing, which is based on https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b, was shared here under license CC BY-NC-SA 4.0

I hope this allows you to experiment with the model and hopefully find out why it doesn't load up using the ARMNN delegate (but does when using the interpreter without the delegate).

from armnn.

federicoparra commented on July 22, 2024

Amazing @Colm-in-Arm ! keep us posted if you get it to work past the StridedSlice layer error - I'll be using it in Ubuntu so I'm happy that's how you are testing it!

from armnn.

Colm-in-Arm commented on July 22, 2024

Hello Federico,

It only required one additional change to get past the StridedSlice error. However, as model loading continued it started consuming massive amounts of memory exceeding the 16Gb available on the device I was using resulting in a SIGKILL. This happened with both CpuAcc and CpuRef. I don't have access to a device with more memory. Do you?

The patch required to get it this is attached.
GitHub_758.txt

from armnn.

federicoparra commented on July 22, 2024

Hello Federico,

It only required one additional change to get past the StridedSlice error. However, as model loading continued it started consuming massive amounts of memory exceeding the 16Gb available on the device I was using resulting in a SIGKILL. This happened with both CpuAcc and CpuRef. I don't have access to a device with more memory. Do you?

The patch required to get it this is attached. GitHub_758.txt

@Colm-in-Arm

Hey! here you have the 8bit version https://drive.google.com/file/d/1uuuLCO_cD9cd2B06BnfAo0eq5KcJ0q_a/view?usp=sharing

I don't know why the 16 bit version takes up so much ram (in my own attempt just right now loading it in Google collab it took 13gb).

The 8bit version takes very little RAM.

As you posted on the other bug report, I'm assuming the 8bit versions of tflite models get accelerated by ARMNN correct? I wonder if the models run faster, or slower, compared to their 32bit counterparts?

Thank you!

from armnn.

federicoparra commented on July 22, 2024

Update @Colm-in-Arm : the 8-bit version I just shared with you above, with the changes in your patch, does load ! I will be testing it in the next few days to see if inference work as expected but at least the model does load :)

from armnn.

BUG: using delegate with transformer | AttributeError: 'NoneType' object has no attribute 'c_void_p' about armnn HOT 22 OPEN

Comments (22)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

Jobs