Comments (7)
@BarryGUN hello!
Thank you for reaching out with your questions about TensorRT acceleration with YOLOv8.
Yes, we export the model to the TensorRT .engine
format for testing. These tests are typically conducted using Python, but the results should be comparable when using C++ as both utilize the TensorRT runtime.
Regarding latency, the reported inference times include all processing steps, including Non-Maximum Suppression (NMS), unless explicitly stated otherwise. This ensures that the latency figures we provide reflect the total time required to process input and produce final detections.
If you have any more specific scenarios or configurations in mind, feel free to share, and I'll be happy to provide more detailed insights!
from ultralytics.
Thank you for answer my question, i got it.
from ultralytics.
@BarryGUN You're welcome! If you have any more questions or need further assistance in the future, feel free to reach out. Happy coding! 😊
from ultralytics.
I also want to know that in speed test, whether batch-size=32 depends on the image count of the coco2017 test datasets because 32 is divisible by 20288.
from ultralytics.
@BarryGUN Great question!
The batch size of 32 used in our speed tests does not directly depend on the total number of images in the COCO2017 dataset. Instead, it's chosen based on what we've found to provide a good balance between memory usage and computational efficiency on the GPU. This batch size is generally a common choice for performance testing as it can fully utilize the GPU capabilities without exceeding memory limits for most modern GPUs.
If you have specific hardware or constraints, you might consider adjusting the batch size to better fit your setup. Let me know if you need tips on how to choose the optimal batch size for your tests! 😊
from ultralytics.
I got it ,thank you!
from ultralytics.
@BarryGUN You're welcome! If you have any more questions in the future, don't hesitate to ask. Happy coding! 😊
from ultralytics.
Related Issues (20)
- Using YOLOv8(seg) with SHAP HOT 5
- yolov8 object_counting in and out doesn't differentiate for defined line HOT 4
- how to set `verbose:false` so that model can predict the batches without printing anything in the terminal HOT 1
- Questions about incremental training HOT 3
- How can I use the segmentation models of previous versions? HOT 3
- yolov8-obb plot train labels maybe error HOT 2
- Error Code 2: Internal Error (Assertion cublasStatus == CUBLAS_STATUS_SUCCESS failed. ) HOT 4
- Yolov10 Can't get attribute 'SCDown' on <module 'ultralytics.nn.modules.block' from 'C:\\Users\\ZHANG\\miniconda3\\lib\\site-packages\\ultralytics\\nn\\modules\\block.py'> HOT 20
- yolov8 -- After the cache is turned on, the memory occupied by reading val data is too large HOT 5
- YOLOv10 Performance Issue: Version 3.12 Fast, But 3.11 and Below Very Slow HOT 8
- yolo8 onnx in opencv HOT 2
- Is OBB available for yolov9 and v10 ? HOT 1
- Clamping in bbox2dist HOT 1
- Question about code of position embedding in rt-detr HOT 5
- Process group init fails when training YOLOv8 after successful tunning [Databricks] [single node GPU] HOT 4
- Train with single gpu HOT 3
- Yolo8-OnnxRuntime-CPP-Inference awful output HOT 6
- confusion matrix single HOT 3
- How to add the bounding box values to the labels text files during prediction with a trained YOLO-V8 instance segmentation model? HOT 4
- Class imabalance dataloader HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ultralytics.