Permalink
Browse files

Integration lists close to working

  • Loading branch information...
thomashumio committed Jun 21, 2018
1 parent a2ed0be commit 0be69a5ff5f9b30ef45aaf66f5bac9aadc72d95d
Showing with 75 additions and 115 deletions.
  1. +9 −49 content/_index.md
  2. +0 −36 content/guides/others.md
  3. +2 −1 content/installation/ansible.md
  4. +2 −1 content/installation/aws.md
  5. +5 −1 content/installation/docker.md
  6. +1 −1 content/installation/nomad.md
  7. +3 −1 content/integrations/api-clients/browser-javascript.md
  8. +2 −1 content/integrations/api-clients/erlang-and-elixir.md
  9. +2 −1 content/integrations/api-clients/nodejs.md
  10. +1 −1 content/integrations/api-clients/python.md
  11. +2 −1 content/integrations/api-clients/swift.md
  12. +1 −1 content/integrations/data-shippers/beats/_index.md
  13. +1 −1 content/integrations/data-shippers/beats/filebeat.md
  14. +1 −1 content/integrations/data-shippers/beats/metricbeat.md
  15. +2 −1 content/integrations/data-shippers/fluentd.md
  16. +1 −1 content/integrations/data-shippers/kafka_connect.md
  17. +1 −1 content/integrations/data-shippers/logstash.md
  18. +1 −1 content/integrations/data-shippers/netflow.md
  19. +1 −1 content/integrations/data-shippers/rsyslog.md
  20. +1 −1 content/integrations/other/grafana.md
  21. +1 −1 content/integrations/other/nginx.md
  22. +2 −1 content/integrations/platform-integrations/cloudwatch.md
  23. +9 −3 content/integrations/platform-integrations/{docker.md → docker-integration.md}
  24. +1 −1 content/integrations/platform-integrations/heroku.md
  25. +1 −1 content/integrations/platform-integrations/kubernetes.md
  26. +3 −3 content/integrations/platform-integrations/mesos.md
  27. +1 −1 content/parsers/regexp-parsers.md
  28. +16 −0 layouts/shortcodes/integration-selection.html
  29. +2 −1 layouts/shortcodes/integrations.html
@@ -23,65 +23,25 @@ PageDuty, OpsGene or VictorOps) means Humio can be the backbone of your operatio
a power tool for your help-desk teams and your trusted navigator on an ocean of data.


_If you are new to log management the [introduction to log management]({{< relref "intro_to_log_management.md" >}})
_If you are new to log management the [introduction to log management]({{< ref "intro_to_log_management.md" >}})
will help you get to grips with the core concepts is and where Humio fits in to the logging ecosystem._

## Integrations

<a href="{{% ref "integrations/_index.md" %}}">Full List of Integrations</a>
<div class="integration-overview">
<div class="integration-overview__section">
<h3 class="integration-overview__section-title">Data Shippers</h3>
<ul class="icon-list">
<li><a href="{{% ref "filebeat.md" %}}">
<img src="/integrations/elastic.svg" style="width: 24px">
<div>Filebeat</div>
</a></li>
<li><a href="{{% ref "logstash.md" %}}">
<img src="/integrations/logstash.svg" style="width: 24px">
<div>Logstash</div>
</a></li>
<li><a href="{{% ref "rsyslog.md" %}}">
<img src="/integrations/rsyslog.svg" style="width: 24px">
<div>Rsyslog</div>
</a></li>
<li><a href="{{% ref "sending-data/data-shippers/_index.md" %}}">List All</a></li>
</ul>
<h5 class="integration-overview__section-title">Popular Data Shippers</h5>
{{% integration-selection "datashipper" %}}
</div>
<div class="integration-overview__section">
<h3 class="integration-overview__section-title">Platforms</h3>
<ul class="icon-list">
<li>
<img src="/integrations/kubernetes.svg" style="width: 24px">
<div>Kubernetes</div>
</li>
<li>
<img src="/integrations/cloudwatch.svg" style="width: 24px">
<div>Cloudwatch</div>
</li>
<li>
<img src="/integrations/mesos.svg" style="width: 24px">
<div>Mesos & DC/OS</div>
</li>
<li>List All</li>
</ul>
<h5 class="integration-overview__section-title">Popular Platforms</h5>
{{% integration-selection "platform" %}}
</div>
<div class="integration-overview__section">
<h3 class="integration-overview__section-title">Languages & Frameworks</h3>
<ul class="icon-list">
<li>
<img src="/integrations/python.svg" style="width: 24px">
<div>Python</div>
</li>
<li>
<img src="/integrations/erlang.svg" style="width: 24px">
<div>Erlang & Elixir</div>
</li>
<li>
<img src="/integrations/nodejs.svg" style="width: 24px">
<div>NodeJS</div>
</li>
<li>List All</li>
</ul>
<h5 class="integration-overview__section-title">Popular API Clients</h5>
{{% integration-selection "apiclient" %}}
</div>
</div>

This file was deleted.

Oops, something went wrong.
@@ -3,7 +3,8 @@ title: Ansible
pageImage: /integrations/ansible.svg
icon: /integrations/ansible-logo.svg
weight: 300
categories: ["Integration"]
categories: ["Integration", "Platform"]
categories_weight: 200
---

We provide a reference Ansible project on Github:
@@ -2,7 +2,8 @@
title: AWS
pageImage: /integrations/aws.svg
weight: 200
categories: ["Integration"]
categories: ["Integration", "Platform"]
categories_weight: 1
---

<!-- TODO: Peter -->
@@ -3,12 +3,16 @@ title: Running Humio as a Docker container
weight: 100
menuTitle: Docker
pageImage: /integrations/docker.svg
categories: ["Integration"]
categories: ["Integration", "Platform"]
---

Humio is distributed as a Docker image. This means that you can start an
instance without a complicated installation procedure.

{{% notice tip %}}
Looking for how to get logs from Docker into Humio? Try the [Docker logging integration]({{< ref "docker-integration.md" >}}) instead.
{{% /notice %}}

**Step 1**

Create an empty file on the host machine to store the Humio configuration.
@@ -3,7 +3,7 @@ title: Running Humio on Nomad
menuTitle: Nomad
pageImage: /integrations/nomad.svg
weight: 400
categories: ["Integration"]
categories: ["Integration", "Platform"]
---

If you want to install Humio on a Nomad cluster we have an example project that
@@ -2,8 +2,10 @@
menuTitle: Browser / JS
slug: "sending-browser-logs-to-humio"
title: "Sending Browser Logs to Humio"
categories: ["Integration"]
categories: ["Integration", "ApiClient"]
categories_weight: 10
pageImage: /integrations/javascript.svg
draft: true
---

TODO: Thomas
@@ -1,8 +1,9 @@
---
menuTitle: Erlang & Elixir
title: "Logging to Humio using Lager for Erlang/Elixir"
categories: ["Integration"]
categories: ["Integration", "ApiClient"]
pageImage: /integrations/erlang.svg
draft: true
---

TODO: Peter
@@ -1,8 +1,9 @@
---
menuTitle: NodeJS
title: "Logging from NodeJS to Humio"
categories: ["Integration"]
categories: ["Integration", "ApiClient"]
pageImage: /integrations/nodejs.svg
draft: true
---

TODO: Thomas
@@ -1,7 +1,7 @@
---
menuTitle: Python
title: "Python API Client"
categories: ["Integration"]
categories: ["Integration", "ApiClient"]
pageImage: /integrations/python.svg
---

@@ -1,7 +1,8 @@
---
menuTitle: Swift
categories: ["Integration"]
categories: ["Integration", "ApiClient"]
pageImage: /integrations/swift.svg
draft: true
---

TODO: Thomas
@@ -3,7 +3,7 @@ title: "Elastic Beats"
category_title: "Overview"
heading: "Humio & Elastic Beats"
weight: 100
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/elastic.svg
---

@@ -1,6 +1,6 @@
---
title: "Filebeat"
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/elastic.svg
---

@@ -1,6 +1,6 @@
---
title: "Metricbeat"
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/metricbeat.svg
---

@@ -1,6 +1,7 @@
---
title: "FluentD"
weight: 300
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/fluentd-logo.png
draft: true
---
@@ -1,6 +1,6 @@
---
title: "Kafka Connect"
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/kafka.svg
---

@@ -1,7 +1,7 @@
---
title: "Logstash"
weight: 200
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/logstash.svg
---

@@ -1,6 +1,6 @@
---
title: "NetFlow"
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/netflow.svg
---

@@ -1,7 +1,7 @@
---
title: "Rsyslog"
weight: 400
categories: ["Integration"]
categories: ["Integration", "DataShipper"]
pageImage: /integrations/rsyslog.svg
---

@@ -1,7 +1,7 @@
---
title: Grafana
weight: 700
categories: ["Integration"]
categories: ["Integration", "OtherIntegration"]
pageImage: /integrations/grafana.svg
---

@@ -1,6 +1,6 @@
---
title: "Nginx"
categories: ["Integration"]
categories: ["Integration", "OtherIntegration"]
pageImage: /integrations/nginx.svg
---

@@ -1,6 +1,7 @@
---
title: Using Humio with Cloudwatch
menuTitle: Cloudwatch
categories: ["Integration"]
categories: ["Integration", "Platform"]
pageImage: /integrations/cloudwatch.svg
draft: true
---
@@ -1,15 +1,21 @@
---
title: "Docker"
title: "Sending Docker Logs to Humio"
menuTitle: "Docker"
# DON'T ADD CATEGORIES HERE, ANOTHER PAGE ABOUT DOCKER HAS THOSE
slug: docker
pageImage: /integrations/docker.svg
---

There are two key steps to getting logs from Docker containers into Humio:

1. Shipping the container logs to Humio
2. Parsing the logs

{{% notice note %}}
In this guide, we assume that you use Docker in the standard way, where
logs are captured from `stdout` and `stderr`.

{{% notice tip %}}
Looking for how to run Humio in a Docker container? Try the [Docker installation guide]({{< ref "docker.md" >}}) instead.
{{% /notice %}}

## 1. Shipping container logs to Humio
@@ -22,7 +28,7 @@ With `docker2humio`, you configure and run a shipper container on each
Docker host. Then, you hook up all the containers for which you want
logs using the fluentd log-driver.

{{% notice tip %}}
{{% notice info %}}
You should set the __log types__ for your containers so Humio can parse the logs.
Humio can accept logs even when it does not know their type. So just start sending
logs to Humio, and then create and enhance the relevant parsers afterwards.
@@ -1,6 +1,6 @@
---
title: "Heroku"
categories: ["Integration"]
categories: ["Integration", "Platform"]
pageImage: /integrations/heroku.svg
---

@@ -1,6 +1,6 @@
---
title: "Kubernetes"
categories: ["Integration"]
categories: ["Integration", "Platform"]
pageImage: /integrations/kubernetes.svg
---

@@ -1,6 +1,6 @@
---
title: "DC/OS and Mesos"
categories: ["Integration"]
categories: ["Integration", "Platform"]
pageImage: /integrations/mesos.svg
---

@@ -124,6 +124,6 @@ The agent will add the following fields to each log entry
* At this state only logs from the private agents are being forwarded to Humio. humio/dcos2humio#8
* Only `stdout` and `stderr` logs are harvested from tasks

## Road map
## Road Map

* Forward DC/OS metrics. humio/dcos2humio#3
* Forward DC/OS metrics.
@@ -33,5 +33,5 @@ to see who they are defined.
{{% notice tip %}}
***Testing***
You can test the parser on the **Parser** page by adding some test data. This offers an interactive way to refine the parser.
See the section on [Testing the Parser]({{< ref "#testing-parsers" >}}) section below.
See the section on [Testing the Parser]({{< ref "creating-a-parser.md#testing" >}}) section below.
{{% /notice %}}
@@ -0,0 +1,16 @@
<ul class="icon-list">
{{ $target := (.Get 0) }}
{{ range $key, $category := .Site.Taxonomies.categories }}
{{ if eq $key $target }}
{{ range $category }}
<li>
<a href="{{ .Page.RelPermalink }}">
{{ if ne (or .Page.Params.icon .Page.Params.pageImage) nil }}
<img alt="" src="{{ (or .Page.Params.icon .Page.Params.pageImage) }}" />
{{ end }}
<div>{{ or .Page.Params.menuTitle .Page.Title }}</div></a>
</li>
{{ end }}
{{ end }}
{{ end }}
</ul>
Oops, something went wrong.

0 comments on commit 0be69a5

Please sign in to comment.