nndam / vietocr-tensorrt

Create TensorRT-runtime for vietocr

Hi 👋, I'm Dam Nguyen Ngoc

A passionate AI/ML engineer

• 👀 I’m interested in Machine Learning & Artificial Intelligence
  
• 🌱 I’m currently working as AI/ML Engineer
• 😎 A big fan of NVIDIA

Connect with me:

 

vietocr-tensorrt's Issues

Cài đặt trên Windows

Anh ơi cho em hỏi cài đặt cái này trên Window thế nào ạ? Em là newbie, xin anh chỉ giúp. Cám ơn anh.

Seq2seq TensorRT

Anh đã convert phần seq2seq sang TensorRT chưa ạ

[10/25/2021-15:32:01] [E] [TRT] ../rtExt/cuda/cudaPointWiseRunner.cpp (140) - Assertion Error in execute: 0 (x.d[i] == 1 || x.d[i] == z.d[i]) [10/25/2021-15:32:01] [E] Engine creation failed [10/25/2021-15:32:01] [E] Engine set up failed &&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --explicitBatch --onnx=transformer_decoder.onnx --saveEngine=transformer_decoder.trt --minShapes=tgt_inp:1x1,memory:64x1x256 --optShapes=tgt_inp:64x32,memory:256x32x256 --maxShapes=tgt_inp:128x32,memory:384x32x256 --verbose --fp16

Environment

TensorRT Version: 7.1.3.0
Python Version: 3.6
PyTorch Version: 1.8.0
ONNX Opset: 11
ONNX version: 1.6.0