Extremly high network & i/o usage normal?

[Unrepentant-Atheist]

I run the valhalla service with this docker-compose.yml

---
version: "3.9"
services:
  snippet-box:
    image: valhalla/valhalla:run-latest
    container_name: valhalla
    restart: unless-stopped
    command:
      - /bin/bash
      - -c
      - |
        wget http://download.geofabrik.de/europe/switzerland-latest.osm.pbf http://download.geofabrik.de/europe/liechtenstein-latest.osm.pbf
        mkdir -p valhalla_tiles
        valhalla_build_config --mjolnir-tile-dir ${PWD}/valhalla_tiles --mjolnir-tile-extract ${PWD}/valhalla_tiles.tar --mjolnir-timezone ${PWD}/valhalla_tiles/timezones.sqlite --mjolnir-admin ${PWD}/valhalla_tiles/admins.sqlite > valhalla.json
        valhalla_build_tiles -c valhalla.json switzerland-latest.osm.pbf liechtenstein-latest.osm.pbf
        valhalla_build_extract -c valhalla.json -v
        valhalla_service valhalla.json 1
    ports:
      - 8002:8002
    volumes:
      - map-data:/valhalla_tiles
volumes:
  map-data:
networks:
  default:
    name: valhallanet
    external: true

Is this usage normal???

[kevinkreiser]

i cant tell how many runs you did here but depending on your configuration this could be reasonable.

the memory usage looks fine to me. we have a couple of datastructures which are sparse have to have the full keyset so 4gb seems about right. CPU would only pick up when you are running the tile building which also seems right. writing to disk would definitely be expected because thats what you are doing, reading input from and writing output to disk. i would expect the writing to disk to taper off though after the tile building was done. the network usage is a bit strange to me. constant the whole time?i would have expected a blip when you get the data from geofabrik and thats about it.

if i were you, i would capture the log output and match it up to the time stamps on your graph. that should be pretty insightful about what is happening when. the above commands do a lot of interesting stuff 😄

[purew]

It seems both network and disk graphs are "aggregate". I assume that means they are showing the amount written/downloaded integrated over time. So if the line is flat, nothing is written or downloaded currently.

If so, the graphs make sense I think, due to how you download and build the tiles as part of the service upstart.

[kevinkreiser]

@purew i had that thought as well but didnt see the labels hahahaha. yeah cumulative numbers would explain that