Comments (2)
What happens when you run it?
Do you have the log and the script for repro?
It depends on the model.
We have used larger batch sizes for some models.
from tensorrt.
Closing. Please feel free to reopen if the problems persists.
from tensorrt.
Related Issues (20)
- Is it possible to use tensorrt to speed up original tensorflow t5 exported saved_model? HOT 4
- how to convert Transformer model with tensorRT ops
- Converting a Vision Transformer model with pre-built engines
- Converting on jetson nano
- blacklisting certain parts of the model to be not converter to TRT
- example-cpp/mnist_demo build tf-trt example fails HOT 2
- Failed convert Huggingface Model to Tensorrt HOT 2
- "ValueError: Failed to import metagraph, check error log for more info." Error HOT 1
- [Jetson] No OpKernel was registered to support Op 'TRTEngineOp' HOT 6
- Unable to save gradient functions when exporting a _DefinedFunction when using converter.save('model') HOT 1
- No improvement in GPU memory consumption during inference HOT 3
- No speed improvements after TF-TRT optimizing on a tensorflow BERT model
- inceptionv3 c++ example inference build trt engine failed; HOT 1
- Serve tf-trt converted model return error: NodeDef mentions attr 'max_batch_size' not in Op: name=TRTEngineOp
- "Incompatible shapes" error during inference
- Tensorflow TensorRT mismatch
- InvalidArgumentError: Graph execution error: Input to reshape is a tensor with 1204224 values, but the requested shape has 4816896
- Local rendezvous is aborting with status: NOT_FOUND: TRTEngineCacheResource not yet created while converting a saved model to trt engine
- about TF-TRT C++ Image Recognition Demo
- Error in TensorRT conversion of e5-large model HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tensorrt.