Missing Capabilities [CAPABILITY_NAMED_IAM] option about taskcat

[santiagocardenas]

We are evaluating the pros and cons of making that change.

I'm fairly certain that if we changed that line, your test run would still fail across regions because of resource name collisions on global services like IAM or S3, for example.

Are you only testing in a single region?

[jorgebonilla]

If there were a way to run one test at the time, or even one region at the time then it wouldn't fail. Perhaps an option to "sequential test" instead of current "parallel" behavior if you will.

To answer the initial question, yes, we will be indeed testing in many regions.

[santiagocardenas]

So that is the issue, because well-architected deployments can be multi-region (or even deployed in multiple regions). Your templates would not work.

Instead, we recommend to avoid naming (or giving custom names) to resources and allow CloudFormation to do that work for you.

[jorgebonilla]

Agreed, and understood. However, this issue can also be solved by having an install phase before the testing phase, where we could install the IAM roles required AND other CFT that are not being tested, before we run the actual templates that we want to test.
And the IAM role CFT could be previously tested separately in a single region.
Just a thought.

[tonynv]

Fixed in d7805f9