add support for geolocation

[monrax]

Add support for geolocation through:

1. Direct download at init time
2. Cronjob using maxmind/geoip to update databases periodically

[alix-graylog]

This looks good, thanks for adding this!

[alix-graylog]

Is this for the Maxmind api key?

[monrax]

yup! Both api key and account id

[alix-graylog]

Is this to allow for downloading of 3rd party plugins?

[monrax]

yes, but this values schema has been updated. See #6 for more details

[williamtrelawny]

@monrax can you please address Alix's questions above when you get a chance?

[monrax]

I just updated this branch, and rebased on top of feat/plugins, please take a look at PR #6 before attempting to merge this one.

This PR introduces support for the Graylog Geolocation Processor by fetching the mmdb files using MaxMind's GeoIp Update container as a CronJob. This is the recommended way to fetch mmdb files and keep them up to date. In order to test this, you will need a MaxMind GeoLite account. Once you have that, you will need to generate a new API key at https://www.maxmind.com/en/accounts//license-key -- then you just need to run:

helm upgrade graylog ./graylog -n graylog --reuse-values --set graylog.config.geolocation.enabled=true \
--set graylog.config.geolocation.maxmindGeoIp.enabled=true \
--set graylog.config.geolocation.maxmindGeoIp.accountId="<YOUR-MAXMIND-ACCOUNT-ID-HERE>" \
--set graylog.config.geolocation.maxmindGeoIp.licenseKey="<YOUR-MAXMIND-LICENSE-KEY-HERE>"

to perform the upgrade.

Another method is also available: given the URL of an .mmdb file available in a remote location, and a SHA256 hash of that file, by specifying both the url and checksum fields for a given geolocation database under graylog.config.geolocation.mmdbSources.{city|asn}, the copy-data init container will fetch the mmdb resource and check if the hashes match, and if so it will copy the file to the main application data/geolocation directory (mounted at /mnt/data/geolocation in the init container, and /usr/share/graylog/data/geolocation in the main graylog container).

---

Both methods have been tested in both microk8s and EKS.

[monrax]

Turning this into a draft PR until #6 is merged.

[alix-graylog]

I was able to test this one. Everything from what I can see is working as expected.