Impact of Maxmind R2 presigned URLs about ingress-nginx

[ufou]

Maxmind have also recently introduced a download limit of 30 times per 24 hours (for the free editions), this means if you are running several ingresses + nginx instances requiring the database you can hit this limit quite quickly, I tried to work around this by setting an extra arg to the ingress controller for maxmind mirror, but this does not seem to work, I have uploaded the databases to a custom location and they are in tar.gz format, which is what the code in maxmind.go suggests, but I then get:

I0325 12:55:13.424947       7 flags.go:387] "downloading maxmind GeoIP2 databases"
E0325 12:55:13.770916       7 maxmind.go:74] GeoLite2-City.mmdb not found
E0325 12:55:13.794877       7 maxmind.go:74] GeoLite2-City.mmdb not found

[k8s-ci-robot]

This issue is currently awaiting triage.

If Ingress contributors determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[strongjz]

Looks like it does download the db in the flag processing, like your logs say

https://github.com/kubernetes/ingress-nginx/blob/main/pkg/flags/flags.go#L400

It should error out @ufou if there is an issue with the download.

Can you exec into the container and see if the file does exist?

[NeckBeardPrince]

Maxmind have also recently introduced a download limit of 30 times per 24 hours (for the free editions), this means if you are running several ingresses + nginx instances requiring the database you can hit this limit quite quickly, I tried to work around this by setting an extra arg to the ingress controller for maxmind mirror, but this does not seem to work, I have uploaded the databases to a custom location and they are in tar.gz format, which is what the code in maxmind.go suggests, but I then get:

I0325 12:55:13.424947       7 flags.go:387] "downloading maxmind GeoIP2 databases"
E0325 12:55:13.770916       7 maxmind.go:74] GeoLite2-City.mmdb not found
E0325 12:55:13.794877       7 maxmind.go:74] GeoLite2-City.mmdb not found

Can you post a snippet of your deployment manifest?

[NeckBeardPrince]

Looks like it does download the db in the flag processing, like your logs say

https://github.com/kubernetes/ingress-nginx/blob/main/pkg/flags/flags.go#L400

It should error out @ufou if there is an issue with the download.

Can you exec into the container and see if the file does exist?

What is the expected format for --maxmind-mirror?
Is it a URL pointing to the database in a .tar.gz format?
Or do you have to use https://www.npmjs.com/package/maxmind-geolite-mirror?

[ufou]

I set a plain URL for the maxmind mirror parameter and had both required databases named like GeoLite2-City.tar.gz GeoLite2-ASN.tar.gz but perhaps the requirement was to have both databases in a single tar.gz file named in a similar convention to the real maxmind download servers instead? I don't think I tried that, we have worked around this anyway by signing up for a 2nd maxmind account, if I get round to testing this I will report back

[github-actions]

This is stale, but we won't close it automatically, just bare in mind the maintainers may be busy with other tasks and will reach your issue ASAP. If you have any question or request to prioritize this, please reach #ingress-nginx-dev on Kubernetes Slack.