Skip to content

provider databases

GitHub Actions edited this page Jun 1, 2026 · 2 revisions

Provider Databases

You will learn how ASN, GeoIP, and bogon sources are configured, how they differ from normal public feeds, and where they appear in the system.

What a provider database is

Provider databases are enrichment sources that add context to other feeds. They are not threat intelligence — they provide ASN attribution, country attribution, or bogon reference data.

The three provider database roles:

Role use: tag Purpose
ASN use: [asn] Maps IPs to autonomous system numbers and names
GeoIP use: [geoip] Maps IPs to country codes
Bogons use: [bogons] Reference set of private, reserved, and non-routable addresses

How they are configured

Provider databases are configured as normal source feeds with an added use: role:

ASN example:

sources:
  iptoasn:
    url: https://iptoasn.com/data/ip2asn-v4.tsv.gz
    frequency: 1440
    category: asn
    use: [asn]
    ...

GeoIP example:

sources:
  geolite2_country:
    url: https://download.maxmind.com/app/geoip_download?edition_id=GeoLite2-Country-CSV&license_key=${MAXMIND_LICENSE_KEY}&suffix=zip
    frequency: 10080
    category: geolocation
    use: [geoip]
    hidden: true
    format: maxmind_country_csv
    ...

Bogon example:

sources:
  bogons:
    url: https://team-cymru.org/Services/Bogons/bogon-bn-agg.txt
    frequency: 1440
    category: special_use
    use: [bogons]
    ...

How they differ from normal feeds

ASN and GeoIP provider databases do not appear as normal public feeds in the browsing catalog. Bogon sources are different: a bogon source can be a public feed and also a provider tab. Their purpose is enrichment:

  • ASN databases produce per-feed ASN breakdowns. When you visit a feed detail page and see "40% of IPs belong to AS12345," that attribution comes from the configured ASN provider.
  • GeoIP databases produce per-feed country breakdowns and country-level comparison pages.
  • Bogon sources produce per-feed bogon overlap reports, showing how many IPs in a feed are private or reserved.

Multiple providers

You can configure multiple ASN, GeoIP, and bogon sources. Each produces independent per-feed artifacts. Users can switch between ASN and GeoIP providers on feed-detail pages, and bogon reports expose the configured bogon providers as comparison tabs.

Provider-list API routes and provider tabs are configuration-driven. They may show a configured provider even when the current feed has no readable artifact for that provider yet; the provider-specific request or tab state is where the missing artifact is reported.

One provider is selected as the default via defaults.yaml:

defaults:
  asn_provider: iptoasn
  geo_provider: dbip_country

The default provider is used for homepage summaries, IP lookup context, and the first tab shown on feed-detail pages.

Hidden from public browsing

Most ASN and GeoIP provider databases set hidden: true. They are not shown in the public feed list but are still active in the processing pipeline and still appear where provider tabs are needed. The admin UI shows them with full status and metadata.

Bogon sources are often not hidden — they can appear in the special_use category as public feeds alongside their enrichment role. Hidden bogon baselines can still appear in bogon provider tabs because those tabs describe reference data, not navigable public feed pages.

Download cadence

Provider databases have their own download cadence, independent of the feeds they enrich. GeoIP databases typically update weekly or monthly. ASN databases update daily. Bogon sources update daily.

When a provider database updates, the daemon reprocesses all enrichment artifacts that depend on it.

Getting Started

Installation

Running the Daemon

Configuration

Feed Configuration

Pipeline

Admin UI

Integrity

API Reference

Monitoring

CLI Tools

Troubleshooting

Updating

Catalog Maintenance

Security

Reference

Clone this wiki locally