Datadog

Basic installations

Kubernetes

Windows

Labs

Python application

Kafka client

Java instrumented logs

Tags-Tags-Tags

Transparent Proxy

Information Scrubbing

Logs

Process

APM

Profiler

RUM

Connectivity

The forwarder

File tailing

datadog.yaml

Log processing

Latency

OOB log parsers

Limits applied to ingested log events

• Log entry limits
  • 100 tags, 256 characters each, 10MM/day
  • JSON format should contain less than 256 attributes
    • Keys should be less than 50 characters
      • Nested in less than 10 successive levels
      • If promoted as a facet 1024 characters if promoted as a facet
  • 18h in the past and 2h in the future

Masking

Removing log color codes

{
  "type": "mask_sequences",
  "name": "remove_log_color_codes",
  "replace_placeholder": "",
  "pattern" : "(\\x1B\\[[\\d;]*[JKmsu])"
}

Misc

After a certain period of time metrics, tags, and hosts no longer appear in the Datadog UI.

• Datadog docs