Impact of Maxmind R2 presigned URLs about ingress-nginx

[ufou]

Maxmind have also recently introduced a download limit of 30 times per 24 hours (for the free editions), this means if you are running several ingresses + nginx instances requiring the database you can hit this limit quite quickly, I tried to work around this by setting an extra arg to the ingress controller for maxmind mirror, but this does not seem to work, I have uploaded the databases to a custom location and they are in tar.gz format, which is what the code in maxmind.go suggests, but I then get:

I0325 12:55:13.424947       7 flags.go:387] "downloading maxmind GeoIP2 databases"
E0325 12:55:13.770916       7 maxmind.go:74] GeoLite2-City.mmdb not found
E0325 12:55:13.794877       7 maxmind.go:74] GeoLite2-City.mmdb not found

[k8s-ci-robot]

This issue is currently awaiting triage.

If Ingress contributors determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[strongjz]

Looks like it does download the db in the flag processing, like your logs say

https://github.com/kubernetes/ingress-nginx/blob/main/pkg/flags/flags.go#L400

It should error out @ufou if there is an issue with the download.

Can you exec into the container and see if the file does exist?

[NeckBeardPrince]

Maxmind have also recently introduced a download limit of 30 times per 24 hours (for the free editions), this means if you are running several ingresses + nginx instances requiring the database you can hit this limit quite quickly, I tried to work around this by setting an extra arg to the ingress controller for maxmind mirror, but this does not seem to work, I have uploaded the databases to a custom location and they are in tar.gz format, which is what the code in maxmind.go suggests, but I then get:

I0325 12:55:13.424947       7 flags.go:387] "downloading maxmind GeoIP2 databases"
E0325 12:55:13.770916       7 maxmind.go:74] GeoLite2-City.mmdb not found
E0325 12:55:13.794877       7 maxmind.go:74] GeoLite2-City.mmdb not found

Can you post a snippet of your deployment manifest?

[NeckBeardPrince]

Looks like it does download the db in the flag processing, like your logs say

https://github.com/kubernetes/ingress-nginx/blob/main/pkg/flags/flags.go#L400

It should error out @ufou if there is an issue with the download.

Can you exec into the container and see if the file does exist?

What is the expected format for --maxmind-mirror?
Is it a URL pointing to the database in a .tar.gz format?
Or do you have to use https://www.npmjs.com/package/maxmind-geolite-mirror?

[ufou]

I set a plain URL for the maxmind mirror parameter and had both required databases named like GeoLite2-City.tar.gz GeoLite2-ASN.tar.gz but perhaps the requirement was to have both databases in a single tar.gz file named in a similar convention to the real maxmind download servers instead? I don't think I tried that, we have worked around this anyway by signing up for a 2nd maxmind account, if I get round to testing this I will report back