Region and cities no longer appear after 2.0

[altendorfme]

It's been a week since the cities and region tabs haven't received any data, country works correctly, I updated by removing the geoip package along with updating to 2.0 as per the repository.

I also turned off Cloudflare to validate that it wasn't some kind of block.

I'm using Caddygen as Webservice

Any tips here?

[ruslandoga]

👋 @altendorfme

You can check what IPs Plausible receives: #2767 (reply in thread)

iex> remote_ip_and_headers = fn {:trace, _pid, :call, {_mod, _fun, [%Plug.Conn{remote_ip: remote_ip, req_headers: headers}]}} -> inspect([remote_ip: remote_ip, headers: headers]) end
iex> mod_fun_args = {PlausibleWeb.RemoteIP, :get, 1}
iex> how_many_times = 5
iex> :recon_trace.calls(mod_fun_args, how_many_times, formatter: remote_ip_and_headers)

And then you can connect to the running instance and try to look them up:

$ cd hosting
$ docker compose exec plausible bin/plausible remote

iex> Plausible.Geo.lookup("1.1.1.1") # but with the IPs you see in the headers / conn.remote_ip

This would hopefully help you debug this issue.

[altendorfme]

It seems that the IPs are arriving correctly, but when I use:
Plausible.Geo.lookup("143.137.xx.xx") // my ip
It returns:

%{
  "continent" => %{
    "code" => "SA",
    "geoname_id" => 6255150,
    "names" => %{
      "de" => "Südamerika",
      "en" => "South America",
      "es" => "Sudamérica",
      "fa" => "امریکای جنوبی",
      "fr" => "Amérique Du Sud",
      "ja" => "南アメリカ大陸",
      "ko" => "남아메리카",
      "pt-BR" => "América Do Sul",
      "ru" => "Южная Америка",
      "zh-CN" => "南美洲"
    }
  },
  "country" => %{
    "geoname_id" => 3469034,
    "is_in_european_union" => false,
    "iso_code" => "BR",
    "names" => %{
      "de" => "Brasilien",
      "en" => "Brazil",
      "es" => "Brasil",
      "fa" => "برزیل",
      "fr" => "Brésil",
      "ja" => "ブラジル",
      "ko" => "브라질",
      "pt-BR" => "Brasil",
      "ru" => "Бразилия",
      "zh-CN" => "巴西"
    }
  }
}

That's right, it's an IP from Brazil, but it doesn't show City or Region

[ruslandoga]

What does :locus.get_info(:geolocation) return?

[altendorfme]

iex> :locus.get_info(:geolocation)

{:ok,
 %{
   metadata: %{
     binary_format_version: {2, 0},
     build_epoch: 1688198873,
     database_type: "DBIP-Country-Lite",
     description: %{
       "en" => "DB-IP.com - IP to Country",
       "fr" => "DB-IP.com - IP vers Pays"
     },
     ip_version: 6,
     languages: ["en", "de", "es", "fr", "ja", "pt-BR", "ru", "zh-CN", "fa",
      "ko"],
     node_count: 1272144,
     record_size: 24
   },
   source: {:filesystem,
    '/app/lib/plausible-0.0.1/priv/geodb/dbip-country.mmdb.gz'},
   version: {{2023, 7, 1}, {8, 7, 53}}
 }}

and

System.get_env("MAXMIND_EDITION")

nil

[ruslandoga]

Seems like you are using DBIP Country Lite and not MaxMind. Please double check your configuration, it should have MAXMIND_LICENSE_KEY set at least, more info: https://plausible.io/docs/self-hosting-configuration#ip-geolocation

[altendorfme]

Ow! I just see where I went wrong, the ENV settings were in the old geoip packet and not plausible! Thank you very much!

:locus.get_info(:geolocation)

iex> :locus.get_info(:geolocation)
{:ok,
 %{
   metadata: %{
     binary_format_version: {2, 0},
     build_epoch: 1691080267,
     database_type: "GeoLite2-City",
     description: %{"en" => "GeoLite2 City database"},
     ip_version: 6,
     languages: ["de", "en", "es", "fr", "ja", "pt-BR", "ru", "zh-CN"],
     node_count: 5211078,
     record_size: 28
   },
   source: {:remote, {:maxmind, :"GeoLite2-City"}},
   version: {{2023, 8, 3}, {16, 31, 7}}
 }}

System.get_env("MAXMIND_EDITION")
"GeoLite2-City"

[pasqualevitiello]

Hey there, not an expert here. I did manage to get Plausible Self-Hosted up and running on a DigitalOcean droplet. By the way, I noticed that the regions and cities aren't showing up, so I decided to follow the advice in this thread to see what's wrong.

docker compose exec plausible bin/plausible remote
iex()> Plausible.Geo.lookup("myIPaddress")

returned

%{
  "continent" => %{
    "code" => "OC",
    "geoname_id" => 6255151,
    "names" => %{
      "de" => "Ozeanien",
      "en" => "Oceania",
      "es" => "Oceanía",
      "fa" => "اقیانوسیه",
      "fr" => "Océanie",
      "ja" => "オセアニア",
      "ko" => "오세아니아",
      "pt-BR" => "Oceania",
      "ru" => "Океания",
      "zh-CN" => "大洋洲"
    }
  },
  "country" => %{
    "geoname_id" => 2077456,
    "is_in_european_union" => false,
    "iso_code" => "AU",
    "names" => %{
      "de" => "Australien",
      "en" => "Australia",
      "es" => "Australia",
      "fa" => "استرالیا",
      "fr" => "Australie",
      "ja" => "オーストラリア",
      "ko" => "오스트레일리아",
      "pt-BR" => "Austrália",
      "ru" => "Австралия",
      "zh-CN" => "澳大利亚"
    }
  }
}

Then I tried to run :locus.get_info(:geolocation), and it returned

 %{
   metadata: %{
     binary_format_version: {2, 0},
     build_epoch: 1688198873,
     database_type: "DBIP-Country-Lite",
     description: %{
       "en" => "DB-IP.com - IP to Country",
       "fr" => "DB-IP.com - IP vers Pays"
     },
     ip_version: 6,
     languages: ["en", "de", "es", "fr", "ja", "pt-BR", "ru", "zh-CN", "fa",
      "ko"],
     node_count: 1272144,
     record_size: 24
   },
   source: {:filesystem,
    '/app/lib/plausible-0.0.1/priv/geodb/dbip-country.mmdb.gz'},
   version: {{2023, 7, 1}, {8, 7, 53}}
 }}

It seems like the DBIP-Country-Lite response doesn't include regions and cities data. So, I thought to give Maxmind a shot.

I checked out the v2.0 release notes, and it seems all you need to do is set up these two variables: MAXMIND_LICENSE_KEY and MAXMIND_EDITION. Then, recreate the container, right? But when I do that, the server doesn't kick off (502 error).

The docker-compose logs command returned quite a lot of errors that look like this:

<Error> DynamicQueryHandler: Code: 82. DB::Exception: Database plausible_events_db already exists.

Any ideas on what's gone wrong here?

[pasqualevitiello]

Something that I forgot to mention, I am using Cloudflare, but the DNS is not proxied.

BTW I don't really care to use MaxMind, I just want to show regions and cities information. Can that be done with DBIP?

[ruslandoga]

The last time I checked the free DB-IP City version didn't include geoname ids, so it wasn't possible to use it for city/regions feature.

[pasqualevitiello]

BTW the issue only occurs when I add MAXMIND_LICENSE_KEY and MAXMIND_EDITION variables. Can you recommend a step-by-step guide to install everything from scratch with DO?

[ruslandoga]

BTW the issue only occurs when I add MAXMIND_LICENSE_KEY and MAXMIND_EDITION variables.

So if you remove these and recreate the container it works, nginx can reach plausible, etc? And if you add them back, recreate the container, it's broken again? This seems very strange, especially since there are no errors in plausible container logs.

Can you recommend a step-by-step guide to install everything from scratch with DO?

It's mostly the same as the guide you used, with the difference that usually Caddy is used for the proxying

$ git clone https://github.com/plausible/hosting
$ cd hosting
# edit plausible-conf.env with secrets
# edit docker-compose.yml to publish `plausible` on `127.0.0.1:8000`
# edit reverse/proxy/docker-compose.caddy-gen.yml with your domain name
$ docker-compose -f docker-compose.yml -f reverse-proxy/docker-compose.caddy-gen.yml up -d

[pasqualevitiello]

So if you remove these and recreate the container it works, nginx can reach plausible, etc? And if you add them back, recreate the container, it's broken again? This seems very strange, especially since there are no errors in plausible container logs.

Yes, it's just like that. If I remove those vars and restart the container with

$ docker compose stop plausible
$ docker compose rm plausible
$ docker compose up -d

it works again. Thanks anyway for checking, this is very kind of you!

[jnreis]

The same problem here. The default geolocation database/service (DB-IP?) does not show Regions or Cities. This only works when adding the MAXMIND_EDITION and MAXMIND_LICENSE_KEY environment variables. It would be nice if this could work out of the box with the default geolocation database/service (DB-IP, MAXMIND, or any other you guys make as default).