QAT LSTM with hidden state (h0, c0) will get error about tinyneuralnetwork

[peterjc123]

FYI, we only support dynamic quantization for the LSTM op. So, with your code, LSTM will still be evaluated with floating type numeric. If you want to mix QAT and dynamic quantization, then you may take a look at #81.

As for the model given in your example, dynamic quantization should be preferred. Please take a look at https://github.com/alibaba/TinyNeuralNetwork/blob/main/examples/quantization/dynamic.py .

[peterjc123]

Please refer to the FAQ for exporting LSTM to TFLite. https://github.com/alibaba/TinyNeuralNetwork/blob/main/docs/FAQ.md#how-to-convert-a-model-with-lstm
As a requirement, you must remove the state inputs and outputs from your model.

[juyenshun]

Thanks for your information, I will try it!

[peterjc123]

This issue will be closed due to inactivity. If you still have problems, please feel free to reopen it. Thanks for your support.