-
Notifications
You must be signed in to change notification settings - Fork 24.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for the 'Anonymous IP' database to the geoip processor #107287
Add support for the 'Anonymous IP' database to the geoip processor #107287
Conversation
Put the default fields for the city database in the same order as the valid fields for the city database. Interestingly, the 'TIMEZONE' (and the 'IP') are the only valid non-default properties.
@masseyke and I talked about the source of the As follow up work after this PR, I would like to organize, update, and document all those files so that their provenance is clear. |
Rather, they're the object properties under which those values will be written within a containing 'location' object, if the 'location' property has been selected.
and use a more general term instead. Maxmind seems to consistently refer to the GeoLite2 databases as 'GeoLite2 databases' and to their commercial offerings as 'GeoIP2 databases' -- both of them are 'IP geolocation databases' (which appears to me to be a generic term that applies to both their free and commercial databases as well as the things that others in the industry might provide).
nor are any 'included in the module'.
Pinging @elastic/es-data-management (Team:Data Management) |
Hi @joegallo, I've created a changelog YAML for you. |
This comment was marked as outdated.
This comment was marked as outdated.
I merged in |
Related to #101080 |
Catches up with Elasticsearch 8.14+ support for user-provided databases: - `Anonymous-IP` elastic/elasticsearch#107287 - `Enterprise` elastic/elasticsearch#107377 When compiled against Elasticsearch < 8.14, these methods neither exist in the interface nor are reachable by the GeoIP processor. Co-authored-by: Joe Gallo <joegallo@gmail.com>
Catches up with Elasticsearch 8.14+ support for user-provided databases: - `Anonymous-IP` elastic/elasticsearch#107287 - `Enterprise` elastic/elasticsearch#107377 When compiled against Elasticsearch < 8.14, these methods neither exist in the interface nor are reachable by the GeoIP processor. Co-authored-by: Joe Gallo <joegallo@gmail.com>
The same highlight also serves for elastic#107287, but I don't know an especially elegant way of making one highlight do double duty, so I did it the naive way.
Closes #90789
Adds support for the 'GeoIP2 Anonymous IP' database from MaxMind to the
geoip
processor.The
geoip
processor will automatically download the various 'GeoLite2' databases, but the 'GeoIP2 Anonymous IP' database is not a 'GeoLite2' database -- it's a commercial database available to those with a suitable license from MaxMind.The support that is being added for it in this PR is in line with the support that we already have for MaxMind's 'GeoIP2 City' and 'GeoIP2 Country' databases -- that is, one would need to arrange their own download management via some custom endpoint or otherwise arrange for the relevant file(s) to be in the
$ES_CONFIG/ingest-geoip
directory on the nodes of the cluster.