Can't profile with different resolution about aws-neuron-sdk

[awsrjh]

Hi and thanks for the data - it will help us to debug .

we will come back to you on this.

[micwade-aws]

Hi, mbuckler.

At the moment the maximum input size supported by the Neuron Compiler for CNN models is 480x480 (see “Known issues and limitations” here: https://github.com/aws/aws-neuron-sdk/blob/master/release-notes/neuron-cc.md#known-issues-and-limitations-3). In this particular issue, the input size is 640x480 which exceeds our current limit. When exceeding the limit, the compiler will place all the operations on the instance CPUs instead on the Inferentias. In addition the Neuron profiler does not yet support profiling of CPU operations. The result is a lack of trace output from profiling.

In a future release we plan to increase the 480x480 input limit, as well as, add support for CPU operation profiling. Please keep an eye out for those updates.

Thanks,
Mike