Skip to content

Conversation

@jpinsonneau
Copy link
Contributor

@jpinsonneau jpinsonneau commented Jun 21, 2022

  • update zero-click loki config
    • improved compactor / ingester / query configurations
    • increase limits
    • updated loki version to 2.5.0
  • added new distributed-loki
    • Deployments:
      • distributor
      • query front end
    • StatefulSets:
      • ingester
      • querier
        These statefulSets uses volumeClaimTemplates that create a PersistentVolumeClaim for each pod.

Run kubectl apply -f ./examples/distributed-loki/ -n network-observability --recursive to deploy scalable loki
image

By default you will have 2 instances of each pod replicas: 2

@jpinsonneau jpinsonneau force-pushed the 374 branch 2 times, most recently from 1879b13 to b6f54f2 Compare June 22, 2022 11:50
@jpinsonneau jpinsonneau marked this pull request as ready for review June 22, 2022 11:51
Copy link

@mariomac mariomac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If I deploy Loki with these descriptors, I get the following error in the console:

image

I guess the issue is that there is no loki service, which is the default service for both ingester and querier in the FlowCollector description. Current services are:

loki-distributed-distributor             ClusterIP   172.30.96.13     <none>        3100/TCP,9095/TCP                     11m
loki-distributed-ingester                ClusterIP   172.30.180.46    <none>        3100/TCP,9095/TCP                     11m
loki-distributed-ingester-headless       ClusterIP   None             <none>        3100/TCP,9095/TCP                     11m
loki-distributed-memberlist              ClusterIP   None             <none>        7946/TCP                              11m
loki-distributed-querier                 ClusterIP   172.30.216.53    <none>        3100/TCP,9095/TCP                     11m
loki-distributed-querier-headless        ClusterIP   None             <none>        3100/TCP,9095/TCP                     11m
loki-distributed-query-frontend          ClusterIP   None             <none>

@jpinsonneau
Copy link
Contributor Author

I guess the issue is that there is no loki service, which is the default service for both ingester and querier in the FlowCollector description.

Correct I forgot to provide the updated version of flows_v1alpha1_flowcollector.yaml for this loki config
I'll add this to a separate file

@jpinsonneau
Copy link
Contributor Author

  • added section about NOO url configuration
  • added storage configuration

@jpinsonneau jpinsonneau requested a review from mariomac June 27, 2022 08:03
@jotak
Copy link
Member

jotak commented Jun 28, 2022

Tested both install modes (zero-click and distributed), both worked fine for me
/lgtm

Just a remark: we may want to script the distributed install mode (maybe in operator's make), and for that probably we may have to modify a little bit the configmap template so that we can just inject a few relevant variables. I started to write a script for myself, will see how I can share for more automation.

@jotak jotak merged commit be14cbd into netobserv:main Jun 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants