guschmue / mlperf-cpp Goto Github PK

Hello,

I was wondering, is it possible to disable the logging mechanism? That is, just let the benchmark load images to the model and have the model run inference on them without logging values?

Right now I tried commenting out GlobalLogger().StartIOThread() and a few other things in the StartTest function in loadgen.cc but the code seems to get stuck here: GlobalLogger().GetLatenciesBlocking(expected_latencies)); in the IssueQueries function in RunPerformanceMode for SingleStream

My end goal is to parallelize/multithread the inference engine, and I want to start by profiling the benchmarks, but the IO is too dominant so I want to remove it.

I'm not sure if this something that's easy to fix, but wanted to ask.

Any help would be appreciated,
Thanks!

P.S Hope this was the right place to put this question, if not please let me know.