[Bug]: Prowler killed by OOM killer when run in AWS CloudShell about prowler

[AlexGidarakos]

Hi again @jfagoagas. I can confirm that using the code from said branch allows the scan to complete without issues. Please let me know if any further information would be useful.

Thanks.

P.S.: Just FYI the limited storage that AWS CloudShell provides for the user's home directory causes issues when installing the poetry dependencies to run Prowler from GitHub. For posterity, here's a workaround:

git clone https://github.com/Fennerr/prowler.git
cd prowler
git checkout issue-2516
pip install poetry
mkdir /tmp/pypoetry
poetry config cache-dir /tmp/pypoetry
poetry shell
...

[jfagoagas]

Hi again @jfagoagas. I can confirm that using the code from said branch allows the scan to complete without issues. Please let me know if any further information would be useful.

Thanks.

P.S.: Just FYI the limited storage that AWS CloudShell provides for the user's home directory causes issues when installing the poetry dependencies to run Prowler from GitHub. For posterity, here's a workaround:

git clone https://github.com/Fennerr/prowler.git
cd prowler
git checkout issue-2516
pip install poetry
mkdir /tmp/pypoetry
poetry config cache-dir /tmp/pypoetry
poetry shell
...

That's a great catch @AlexGidarakos, I'm going to include in our docs. Btw, we've merged the fix PR!

[jfagoagas]

Included in the docs @AlexGidarakos --> #3190 Thanks!

[jfagoagas]

Hi @AlexGidarakos currently we are working to improve the Prowler's memory management. The AWS CloudShell is a supported environment to execute Prowler but due to the restricted memory on that environment you can experience some issues if you are auditing a big AWS account.

Can you estimate the number of resources in the account?

Do you know if some services have a large number of resources, I mean way more than the rest of the services?

Thanks for using Prowler 🚀

[AlexGidarakos]

Hi @jfagoagas. Checking in AWS Tag Editor there are around 400 resources in this account, with the most important ones being:

15 CloudFormation stacks
235 Config rules
2 DynamoDB tables
1 IGW
1 NACL
20 ENIs
9 RTBs
8 SGs
8 Subnets
1 VPC
1 ECS Cluster with 3 Fargate Services running 2 tasks each
1 ElastiCache cluster with 2 nodes
1 ALB with 3 Target Groups
5 KMSs
16 Lambdas
1 Aurora Cluster with PSQL-compatible engine with 2 instances
13 DB Cluster Snapshots
17 S3 buckets
5 SSM Parameters
32 Secrets Manager secrets

Thanks for looking into this bug report.

[jfagoagas]

@AlexGidarakos thanks for the quick response. Could you please execute Prowler using the branch Fennerr:issue-2516 from this PR? #3167?

Thanks!