Comments (9)
Which demo are you referring to? Is it the SSD one?
In addition, please also specify which version of JetPack and TensorFlow you are using.
from tensorrt_demos.
i am referring to the SSD one. i am using tensorflow 1.14 and and jetpack 4.2 with tensorrt 5.
i have tried the trt_ssd_async.py for inference and managed to get 25 fps, but i think this is slow for an optimized model on jetson tx2.
from tensorrt_demos.
It indeed seems too slow. Unfortunately, I don't have a TX2 to verify that currently.
Did you notice any suspicious warnings or errors when you built the TensorRT engine and ran inferencing?
from tensorrt_demos.
it seems like the conversion went smoothly and it does improve performance by almost 50%.
i have tested the model without optimizing it with tensorrt and it ran on 12-14 fps.
i am really disappointed with the mobilenetv2 model. i thought it would do better than yolov3-tiny.
i am currently achieving 30 fps on yolov-tiny(416*416) which is better than an optimized mobilenetv2(300 * 300) model.
do you have any idea why the mobilenetv2 model would not perform similarly to the numbers published by tensorflow?
i have also tested mobilenetv3 and it performs similar to mobilenetv2 (14 fps)
from tensorrt_demos.
Please check out this discussion on StackOverflow: https://stackoverflow.com/questions/50385735/why-the-mobilenetv2-is-faster-than-mobilenetv1-only-at-mobile-device
from tensorrt_demos.
thank you, this is very informative. then maybe in my case i am better off using the ssd inception model. what do you think?
from tensorrt_demos.
I think it's worth digging out why FPS on your TX2 is not better than my test result on the Nano.
-
Have you tested both USB webcam input and image/video file input? Do you observe big difference of FPS in these 2 cases?
-
If it doesn't trouble you too much, could you profile the code on TX2 and provide the log to me? I might be able to spot problems by looking at the profiler output. Reference: https://jkjung-avt.github.io/optimize-mtcnn/
For example, run trt_ssd.py with the following command for say 60 seconds. Then copy and paste the profiler output.
$ python3 -m cProfile -s cumtime trt_trt_ssd.py --model ssd_mobilenet_v1_coco \ --image \ --filename test.jpg
from tensorrt_demos.
I am off until monday, ill get back to you then
from tensorrt_demos.
Any update? Otherwise, I'll close this issue due to inactivity.
from tensorrt_demos.
Related Issues (20)
- Calib.table not created Deepstream
- Error when install install_pycuda.sh file HOT 2
- Any plan about SwinIR? HOT 1
- Batch Processed Image Inference HOT 2
- Failure to Build ONNX from Custom Yolo HOT 2
- Error when running on separate thread HOT 2
- wrong many bounding box and wrong predict untrained class id HOT 2
- error happening when sh ./install_pycuda.sh HOT 3
- Integration With AGX Orin HOT 4
- yolov3 onnx format with low opset, suitable for tensorrt 6.5 HOT 1
- Trouble with linker on yolo plugin x86 HOT 2
- Xavier onnx to TensorRT error HOT 1
- How to prevent tensorrt from fusing the final layers when trying to convert tiny yolov3 to int8? HOT 2
- No output when running my own yolov4
- Failed to build the TensorRT engine --int8
- How do I free up memory when I want to switch models
- Cudnn initialization error: I already installed Cudnn but Why?
- Is there any way to avoid using the reshape operation after inference?
- DRIVE AGX Orin
- Facing Issue with yolo to onnx conversion with pre-trained yolov3-tiny model.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tensorrt_demos.