Error: The state/task 'UpdateMembers' returned a result with a size exceeding the maximum number of bytes service limit. about aws-securityhub-multiaccount-scripts

[scottbward]

Thanks for reporting this. I am looking into this and will get back as soon as I can regarding what can be done to address this error.

[scottbward]

The error that you are reporting is from the AWS Step Functions service. Quotas for Step functions are outlined here: https://docs.aws.amazon.com/step-functions/latest/dg/limits-overview.html, specifically it would be the "Maximum input or output size for a task, state, or execution" quota. From a few searches it looks like the solve is to alter the way that information is being passed around for the tasks in your step function. I suspect that due to the large number of accounts you are accruing a large amount of responses from AWS API calls and that is accounting for the max size exceeded.

Here are a few resources that might help:
https://ncoughlin.com/posts/aws-step-functions-notes/#statesdatalimitexceeded. - This seems like it may align well to your situation.

https://stackoverflow.com/questions/55702571/step-function-exceeding-the-maximum-number-of-characters-service-limit
https://stackoverflow.com/questions/71833184/aws-step-functions-size-exceeding-the-maximum-number-of-bytes-service-limit?noredirect=1&lq=1

Let me know if this helps or if you have additional questions. I'll do my best to help you along on this.