[Windows] infer time increaseingly, how to deal? Thanks! about tensorrt-alpha

[ycxia]

auto steady_infer1 = std::chrono::steady_clock::now();
utils::DeviceTimer d_t2; yolo.infer(); float t2 = d_t2.getUsedTime();
auto steady_infer2 = std::chrono::steady_clock::now();
std::cout << "yolo.infer time: " << std::chrono::duration<double, std::milli>(steady_infer2 - steady_infer1).count() << " ms\n";

[FeiYull]

@ycxia As shown in the figure below, the program continues to run for 5 minutes, and the time of doing inference is still nearly 4.4ms.

Some suggestions:

• Turn off visualization
• Do not save images by OpenCV
• The code should be run on the GPU as much as possible