[panw] Adding traffic and threat performance benchmarks #7545

ebeahan · 2023-08-25T20:37:50Z

What does this PR do?

Add system benchmarks to panw package for TRAFFIC and THREAT type Palo Alto logs.

Adds the following directory structure. Leveraging shared configuration where possible, but partial templates aren't supported yet (elastic/elastic-integration-corpus-generator-tool#50).

└── system
    ├── threat-benchmark
    │   └── gotext.tpl
    │   ├── config.yml
    │   └── fields.yml
    ├── threat-logs.yml
    ├── traffic-benchmark
    │   └── gotext.tpl
    │   ├── config.yml
    │   └── fields.yml
    └── traffic-logs.yml

Testing results

TRAFFIC

$ elastic-package benchmark system --benchmark traffic-logs -v
...
--- Benchmark results for package: panw - START ---
╭────────────────────────────────────────────────────────────────────────────────────────────────╮
│ info                                                                                           │
├────────────────────────┬───────────────────────────────────────────────────────────────────────┤
│ benchmark              │                                                          traffic-logs │
│ description            │                             Benchmark 100MiB of Traffic logs ingested │
│ run ID                 │                                  812c5401-7199-460b-b543-c5adf68c8b2a │
│ package                │                                                                  panw │
│ start ts (s)           │                                                            1692995648 │
│ end ts (s)             │                                                            1692995734 │
│ duration               │                                                                 1m26s │
│ generated corpora file │ /Users/ericbeahan/.elastic-package/tmp/service_logs/corpus-2925172626 │
╰────────────────────────┴───────────────────────────────────────────────────────────────────────╯
╭────────────────────────────────────────────────────────────────╮
│ parameters                                                     │
├─────────────────────────────────┬──────────────────────────────┤
│ package version                 │                       3.15.0 │
│ input                           │                      logfile │
│ vars.paths                      │ [/tmp/service_logs/corpus-*] │
│ data_stream.name                │                        panos │
│ warmup time period              │                          10s │
│ benchmark time period           │                           0s │
│ wait for data timeout           │                        10m0s │
│ corpora.generator.size          │                       100MiB │
│ corpora.generator.template.path │    ./traffic-logs/gotext.tpl │
│ corpora.generator.template.raw  │                              │
│ corpora.generator.template.type │                       gotext │
│ corpora.generator.config.path   │          ./shared/config.yml │
│ corpora.generator.config.raw    │                        map[] │
│ corpora.generator.fields.path   │          ./shared/fields.yml │
│ corpora.generator.fields.raw    │                        map[] │
╰─────────────────────────────────┴──────────────────────────────╯
╭───────────────────────╮
│ cluster info          │
├───────┬───────────────┤
│ name  │ elasticsearch │
│ nodes │             1 │
╰───────┴───────────────╯
╭─────────────────────────────────────────────────╮
│ data stream stats                               │
├────────────────────────────┬────────────────────┤
│ data stream                │ logs-panw.panos-ep │
│ approx total docs ingested │             220136 │
│ backing indices            │                  1 │
│ store size bytes           │          236913613 │
│ maximum ts (ms)            │      1692977642000 │
╰────────────────────────────┴────────────────────╯
╭───────────────────────────────────────╮
│ disk usage for index .ds-logs-panw.pa │
│ nos-ep-2023.08.25-000001 (for all fie │
│ lds)                                  │
├──────────────────────────────┬────────┤
│ total                        │ 169 MB │
│ inverted_index.total         │  41 MB │
│ inverted_index.stored_fields │  81 MB │
│ inverted_index.doc_values    │  29 MB │
│ inverted_index.points        │  19 MB │
│ inverted_index.norms         │    0 B │
│ inverted_index.term_vectors  │    0 B │
│ inverted_index.knn_vectors   │    0 B │
╰──────────────────────────────┴────────╯
╭──────────────────────────────────────────────────────────╮
│ pipeline logs-panw.panos-3.15.0-traffic stats in node C_ │
│ siR9CHSQOPfytLu8iXBg                                     │
├───────────┬──────────────────────────────────────────────┤
│ Totals    │     Count: 219960 | Failed: 0 | Time: 5.995s │
│ csv ()    │     Count: 219960 | Failed: 0 | Time: 2.194s │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 28ms │
│ append () │       Count: 219960 | Failed: 0 | Time: 77ms │
│ set ()    │         Count: 43903 | Failed: 0 | Time: 7ms │
│ set ()    │       Count: 176057 | Failed: 0 | Time: 26ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 74ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 81ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 86ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 95ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 91ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 64ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 77ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 72ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 60ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 80ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 74ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 71ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 64ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 87ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 80ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 60ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 75ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 69ms │
│ set ()    │ Count: 219960 | Failed: 219960 | Time: 623ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 56ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 69ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 72ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 85ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 71ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 85ms │
│ set ()    │       Count: 219960 | Failed: 0 | Time: 95ms │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ set ()    │              Count: 0 | Failed: 0 | Time: 0s │
│ date ()   │              Count: 0 | Failed: 0 | Time: 0s │
│ date ()   │              Count: 0 | Failed: 0 | Time: 0s │
╰───────────┴──────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────╮
│ pipeline logs-panw.panos-3.15.0 stats in node C_siR9CHSQOPfytLu8iXBg                            │
├─────────────────────────────────────────────────────┬───────────────────────────────────────────┤
│ Totals                                              │ Count: 219962 | Failed: 0 | Time: 33.803s │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 77ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 38ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 36ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 43ms │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 78ms │
│ rename ()                                           │   Count: 219961 | Failed: 0 | Time: 129ms │
│ grok ()                                             │  Count: 219961 | Failed: 0 | Time: 2.159s │
│ pipeline (logs-panw.panos-3.15.0-traffic)           │  Count: 219961 | Failed: 0 | Time: 6.041s │
│ pipeline (logs-panw.panos-3.15.0-threat)            │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-hipmatch)          │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-userid)            │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-globalprotect)     │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-config)            │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-decryption)        │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-system)            │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-authentication)    │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-correlated_event)  │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-gtp)               │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-ip_tag)            │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-sctp)              │           Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-tunnel_inspection) │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │   Count: 219961 | Failed: 0 | Time: 105ms │
│ grok ()                                             │   Count: 146574 | Failed: 0 | Time: 309ms │
│ grok ()                                             │   Count: 146915 | Failed: 0 | Time: 275ms │
│ set ()                                              │    Count: 146574 | Failed: 0 | Time: 54ms │
│ set ()                                              │    Count: 146915 | Failed: 0 | Time: 57ms │
│ set ()                                              │    Count: 146574 | Failed: 0 | Time: 45ms │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │   Count: 219961 | Failed: 0 | Time: 675ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 61ms │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │   Count: 219961 | Failed: 0 | Time: 301ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 69ms │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │   Count: 219961 | Failed: 0 | Time: 281ms │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │   Count: 219961 | Failed: 0 | Time: 294ms │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 97ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 89ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 108ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 104ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 50ms │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 58ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 81ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 110ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 88ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 122ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 108ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 125ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 72ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 79ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 74ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 71ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 67ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 64ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 71ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 60ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 99ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 113ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 61ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 60ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 58ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 102ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 111ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 58ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 63ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 58ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 68ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 74ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 78ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 101ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 95ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 93ms │
│ convert ()                                          │   Count: 219961 | Failed: 0 | Time: 107ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 99ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 75ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 74ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 75ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 75ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 65ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 66ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 63ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 77ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 47ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 72ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 69ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 70ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 66ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 72ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 69ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 74ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 67ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 63ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 66ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 67ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 65ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 63ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 76ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 58ms │
│ gsub ()                                             │    Count: 219961 | Failed: 0 | Time: 64ms │
│ uppercase ()                                        │    Count: 219961 | Failed: 0 | Time: 51ms │
│ gsub ()                                             │    Count: 219961 | Failed: 0 | Time: 51ms │
│ uppercase ()                                        │    Count: 219961 | Failed: 0 | Time: 50ms │
│ gsub ()                                             │    Count: 219961 | Failed: 0 | Time: 35ms │
│ uppercase ()                                        │    Count: 219961 | Failed: 0 | Time: 34ms │
│ gsub ()                                             │    Count: 219961 | Failed: 0 | Time: 62ms │
│ uppercase ()                                        │    Count: 219961 | Failed: 0 | Time: 55ms │
│ lowercase ()                                        │    Count: 219961 | Failed: 0 | Time: 54ms │
│ lowercase ()                                        │    Count: 219961 | Failed: 0 | Time: 49ms │
│ lowercase ()                                        │    Count: 219961 | Failed: 0 | Time: 41ms │
│ remove ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ script ()                                           │   Count: 219961 | Failed: 0 | Time: 115ms │
│ script ()                                           │   Count: 219961 | Failed: 0 | Time: 508ms │
│ append ()                                           │     Count: 43903 | Failed: 0 | Time: 14ms │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 34ms │
│ append ()                                           │    Count: 219961 | Failed: 0 | Time: 53ms │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │      Count: 43864 | Failed: 0 | Time: 9ms │
│ set ()                                              │     Count: 43864 | Failed: 0 | Time: 17ms │
│ set ()                                              │      Count: 44332 | Failed: 0 | Time: 9ms │
│ set ()                                              │      Count: 43998 | Failed: 0 | Time: 9ms │
│ set ()                                              │    Count: 219961 | Failed: 0 | Time: 37ms │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 195ms │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 148ms │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 168ms │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 155ms │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ foreach ()                                          │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 237ms │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 115ms │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 119ms │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 137ms │
│ user_agent ()                                       │    Count: 219961 | Failed: 0 | Time: 84ms │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 137ms │
│ geoip ()                                            │   Count: 199066 | Failed: 0 | Time: 129ms │
│ geoip ()                                            │   Count: 219961 | Failed: 0 | Time: 140ms │
│ geoip ()                                            │   Count: 192465 | Failed: 0 | Time: 125ms │
│ rename ()                                           │    Count: 219961 | Failed: 0 | Time: 72ms │
│ rename ()                                           │    Count: 219961 | Failed: 0 | Time: 69ms │
│ rename ()                                           │    Count: 219961 | Failed: 0 | Time: 76ms │
│ rename ()                                           │    Count: 219961 | Failed: 0 | Time: 71ms │
│ rename ()                                           │   Count: 219961 | Failed: 0 | Time: 174ms │
│ rename ()                                           │   Count: 219961 | Failed: 0 | Time: 165ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 84ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 63ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 74ms │
│ convert ()                                          │    Count: 219961 | Failed: 0 | Time: 78ms │
│ community_id ()                                     │   Count: 219961 | Failed: 0 | Time: 440ms │
│ community_id ()                                     │   Count: 219961 | Failed: 0 | Time: 323ms │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 255ms │
│ grok ()                                             │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │           Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │   Count: 219961 | Failed: 0 | Time: 159ms │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │   Count: 146574 | Failed: 0 | Time: 122ms │
│ foreach ()                                          │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │   Count: 146915 | Failed: 0 | Time: 110ms │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │   Count: 219961 | Failed: 0 | Time: 119ms │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │    Count: 219962 | Failed: 0 | Time: 63ms │
│ remove ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │           Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │  Count: 219962 | Failed: 0 | Time: 3.215s │
│ remove ()                                           │    Count: 219962 | Failed: 0 | Time: 48ms │
│ script ()                                           │  Count: 219962 | Failed: 0 | Time: 1.112s │
│ pipeline (logs-panw.panos@custom)                   │    Count: 219962 | Failed: 0 | Time: 24ms │
╰─────────────────────────────────────────────────────┴───────────────────────────────────────────╯

--- Benchmark results for package: panw - END   ---
Done

THREAT

$ elastic-package benchmark system --benchmark threat-logs -v
...
--- Benchmark results for package: panw - START ---
╭────────────────────────────────────────────────────────────────────────────────────────────────╮
│ info                                                                                           │
├────────────────────────┬───────────────────────────────────────────────────────────────────────┤
│ benchmark              │                                                           threat-logs │
│ description            │                              Benchmark 100MiB of Threat logs ingested │
│ run ID                 │                                  99b50fea-1297-4d01-8a0d-f2aba2dfd294 │
│ package                │                                                                  panw │
│ start ts (s)           │                                                            1692994833 │
│ end ts (s)             │                                                            1692994883 │
│ duration               │                                                                   50s │
│ generated corpora file │ /Users/ericbeahan/.elastic-package/tmp/service_logs/corpus-3550437181 │
╰────────────────────────┴───────────────────────────────────────────────────────────────────────╯
╭────────────────────────────────────────────────────────────────╮
│ parameters                                                     │
├─────────────────────────────────┬──────────────────────────────┤
│ package version                 │                       3.15.0 │
│ input                           │                      logfile │
│ vars.paths                      │ [/tmp/service_logs/corpus-*] │
│ data_stream.name                │                        panos │
│ warmup time period              │                          10s │
│ benchmark time period           │                           0s │
│ wait for data timeout           │                        10m0s │
│ corpora.generator.size          │                       100MiB │
│ corpora.generator.template.path │     ./threat-logs/gotext.tpl │
│ corpora.generator.template.raw  │                              │
│ corpora.generator.template.type │                       gotext │
│ corpora.generator.config.path   │          ./shared/config.yml │
│ corpora.generator.config.raw    │                        map[] │
│ corpora.generator.fields.path   │          ./shared/fields.yml │
│ corpora.generator.fields.raw    │                        map[] │
╰─────────────────────────────────┴──────────────────────────────╯
╭───────────────────────╮
│ cluster info          │
├───────┬───────────────┤
│ name  │ elasticsearch │
│ nodes │             1 │
╰───────┴───────────────╯
╭─────────────────────────────────────────────────╮
│ data stream stats                               │
├────────────────────────────┬────────────────────┤
│ data stream                │ logs-panw.panos-ep │
│ approx total docs ingested │              97723 │
│ backing indices            │                  1 │
│ store size bytes           │           67989124 │
│ maximum ts (ms)            │      1692976824000 │
╰────────────────────────────┴────────────────────╯
╭───────────────────────────────────────╮
│ disk usage for index .ds-logs-panw.pa │
│ nos-ep-2023.08.25-000001 (for all fie │
│ lds)                                  │
├──────────────────────────────┬────────┤
│ total                        │  68 MB │
│ inverted_index.total         │  15 MB │
│ inverted_index.stored_fields │  36 MB │
│ inverted_index.doc_values    │  11 MB │
│ inverted_index.points        │ 5.7 MB │
│ inverted_index.norms         │    0 B │
│ inverted_index.term_vectors  │    0 B │
│ inverted_index.knn_vectors   │    0 B │
╰──────────────────────────────┴────────╯
╭─────────────────────────────────────────────────────────╮
│ pipeline logs-panw.panos-3.15.0-threat stats in node C_ │
│ siR9CHSQOPfytLu8iXBg                                    │
├────────────┬────────────────────────────────────────────┤
│ Totals     │    Count: 97523 | Failed: 0 | Time: 4.058s │
│ csv ()     │    Count: 97523 | Failed: 0 | Time: 1.343s │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 15ms │
│ set ()     │       Count: 48802 | Failed: 0 | Time: 8ms │
│ set ()     │       Count: 48721 | Failed: 0 | Time: 8ms │
│ set ()     │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 14ms │
│ append ()  │      Count: 97523 | Failed: 0 | Time: 37ms │
│ set ()     │       Count: 19489 | Failed: 0 | Time: 3ms │
│ set ()     │      Count: 78034 | Failed: 0 | Time: 12ms │
│ convert () │ Count: 97523 | Failed: 97523 | Time: 313ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 35ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 37ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 43ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 40ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 34ms │
│ set ()     │ Count: 97523 | Failed: 97523 | Time: 124ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 30ms │
│ set ()     │ Count: 97523 | Failed: 97523 | Time: 104ms │
│ set ()     │ Count: 97523 | Failed: 97523 | Time: 107ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 28ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 31ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 31ms │
│ set ()     │ Count: 97523 | Failed: 97523 | Time: 112ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 26ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 36ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 33ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 28ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 36ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 33ms │
│ set ()     │ Count: 97523 | Failed: 97523 | Time: 110ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 37ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 33ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 36ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 32ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 39ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 34ms │
│ script ()  │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()     │       Count: 16306 | Failed: 0 | Time: 5ms │
│ script ()  │      Count: 16306 | Failed: 0 | Time: 27ms │
│ set ()     │       Count: 16213 | Failed: 0 | Time: 5ms │
│ set ()     │      Count: 97523 | Failed: 0 | Time: 30ms │
│ trim ()    │      Count: 97523 | Failed: 0 | Time: 40ms │
│ split ()   │      Count: 97523 | Failed: 0 | Time: 40ms │
╰────────────┴────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────────────────────────────────╮
│ pipeline logs-panw.panos-3.15.0 stats in node C_siR9CHSQOPfytLu8iXBg                             │
├─────────────────────────────────────────────────────┬────────────────────────────────────────────┤
│ Totals                                              │   Count: 97523 | Failed: 0 | Time: 18.924s │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 36ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 16ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 15ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 15ms │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 34ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 59ms │
│ grok ()                                             │    Count: 97523 | Failed: 0 | Time: 1.487s │
│ pipeline (logs-panw.panos-3.15.0-traffic)           │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-threat)            │    Count: 97523 | Failed: 0 | Time: 4.083s │
│ pipeline (logs-panw.panos-3.15.0-hipmatch)          │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-userid)            │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-globalprotect)     │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-config)            │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-decryption)        │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-system)            │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-authentication)    │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-correlated_event)  │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-gtp)               │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-ip_tag)            │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-sctp)              │            Count: 0 | Failed: 0 | Time: 0s │
│ pipeline (logs-panw.panos-3.15.0-tunnel_inspection) │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 69ms │
│ grok ()                                             │     Count: 64713 | Failed: 0 | Time: 139ms │
│ grok ()                                             │     Count: 65181 | Failed: 0 | Time: 122ms │
│ set ()                                              │      Count: 64713 | Failed: 0 | Time: 25ms │
│ set ()                                              │      Count: 65181 | Failed: 0 | Time: 26ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 32ms │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │     Count: 97523 | Failed: 0 | Time: 331ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 27ms │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │     Count: 97523 | Failed: 0 | Time: 141ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 32ms │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │     Count: 97523 | Failed: 0 | Time: 131ms │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ date ()                                             │            Count: 0 | Failed: 0 | Time: 0s │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 45ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 39ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 50ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 51ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 24ms │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 26ms │
│ convert ()                                          │ Count: 97523 | Failed: 97523 | Time: 387ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 49ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 42ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 57ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 53ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 61ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 33ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 36ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 37ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 35ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 33ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 35ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 27ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 34ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 22ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 22ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 28ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 50ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 51ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 24ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 22ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 26ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 43ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 50ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 22ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 21ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 22ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 35ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 37ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 37ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 41ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 37ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 37ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 45ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 38ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 32ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 27ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 27ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 33ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 21ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 31ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 32ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 32ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 32ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 28ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 31ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 30ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 29ms │
│ convert ()                                          │ Count: 97523 | Failed: 97523 | Time: 524ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 34ms │
│ gsub ()                                             │      Count: 97523 | Failed: 0 | Time: 39ms │
│ uppercase ()                                        │      Count: 97523 | Failed: 0 | Time: 26ms │
│ gsub ()                                             │      Count: 97523 | Failed: 0 | Time: 25ms │
│ uppercase ()                                        │      Count: 97523 | Failed: 0 | Time: 25ms │
│ gsub ()                                             │      Count: 97523 | Failed: 0 | Time: 17ms │
│ uppercase ()                                        │      Count: 97523 | Failed: 0 | Time: 17ms │
│ gsub ()                                             │      Count: 97523 | Failed: 0 | Time: 30ms │
│ uppercase ()                                        │      Count: 97523 | Failed: 0 | Time: 29ms │
│ lowercase ()                                        │      Count: 97523 | Failed: 0 | Time: 29ms │
│ lowercase ()                                        │      Count: 97523 | Failed: 0 | Time: 26ms │
│ lowercase ()                                        │      Count: 97523 | Failed: 0 | Time: 26ms │
│ remove ()                                           │      Count: 97523 | Failed: 0 | Time: 21ms │
│ script ()                                           │      Count: 97523 | Failed: 0 | Time: 58ms │
│ script ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │       Count: 19489 | Failed: 0 | Time: 6ms │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │       Count: 32490 | Failed: 0 | Time: 5ms │
│ set ()                                              │       Count: 32519 | Failed: 0 | Time: 5ms │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │       Count: 32375 | Failed: 0 | Time: 5ms │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ set ()                                              │       Count: 32483 | Failed: 0 | Time: 5ms │
│ set ()                                              │       Count: 32665 | Failed: 0 | Time: 5ms │
│ set ()                                              │       Count: 19326 | Failed: 0 | Time: 4ms │
│ set ()                                              │       Count: 19622 | Failed: 0 | Time: 4ms │
│ set ()                                              │       Count: 19557 | Failed: 0 | Time: 4ms │
│ set ()                                              │       Count: 19529 | Failed: 0 | Time: 3ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 13ms │
│ set ()                                              │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │      Count: 97523 | Failed: 0 | Time: 78ms │
│ append ()                                           │      Count: 97523 | Failed: 0 | Time: 63ms │
│ append ()                                           │      Count: 97523 | Failed: 0 | Time: 71ms │
│ append ()                                           │      Count: 97523 | Failed: 0 | Time: 71ms │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ foreach ()                                          │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ geoip ()                                            │     Count: 97523 | Failed: 0 | Time: 114ms │
│ geoip ()                                            │      Count: 97523 | Failed: 0 | Time: 55ms │
│ geoip ()                                            │      Count: 97523 | Failed: 0 | Time: 56ms │
│ geoip ()                                            │      Count: 97523 | Failed: 0 | Time: 59ms │
│ user_agent ()                                       │      Count: 97523 | Failed: 0 | Time: 89ms │
│ geoip ()                                            │      Count: 97523 | Failed: 0 | Time: 61ms │
│ geoip ()                                            │      Count: 86795 | Failed: 0 | Time: 57ms │
│ geoip ()                                            │      Count: 97523 | Failed: 0 | Time: 61ms │
│ geoip ()                                            │      Count: 90697 | Failed: 0 | Time: 59ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 34ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 28ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 25ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 24ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 81ms │
│ rename ()                                           │      Count: 97523 | Failed: 0 | Time: 75ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 39ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 28ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 34ms │
│ convert ()                                          │      Count: 97523 | Failed: 0 | Time: 31ms │
│ community_id ()                                     │     Count: 97523 | Failed: 0 | Time: 202ms │
│ community_id ()                                     │     Count: 97523 | Failed: 0 | Time: 146ms │
│ append ()                                           │     Count: 97523 | Failed: 0 | Time: 119ms │
│ grok ()                                             │     Count: 97523 | Failed: 0 | Time: 179ms │
│ set ()                                              │       Count: 32329 | Failed: 0 | Time: 7ms │
│ set ()                                              │      Count: 97523 | Failed: 0 | Time: 97ms │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │      Count: 64713 | Failed: 0 | Time: 56ms │
│ foreach ()                                          │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │      Count: 65181 | Failed: 0 | Time: 55ms │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │      Count: 97523 | Failed: 0 | Time: 58ms │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ append ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │      Count: 97523 | Failed: 0 | Time: 27ms │
│ remove ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │            Count: 0 | Failed: 0 | Time: 0s │
│ remove ()                                           │    Count: 97523 | Failed: 0 | Time: 1.449s │
│ remove ()                                           │      Count: 97523 | Failed: 0 | Time: 26ms │
│ script ()                                           │     Count: 97523 | Failed: 0 | Time: 668ms │
│ pipeline (logs-panw.panos@custom)                   │      Count: 97523 | Failed: 0 | Time: 12ms │
╰─────────────────────────────────────────────────────┴────────────────────────────────────────────╯

--- Benchmark results for package: panw - END   ---
Done

elasticmachine · 2023-08-25T20:48:42Z

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2023-09-25T20:07:01.904+0000
Duration: 19 min 43 sec

Test stats 🧪

Test	Results
Failed	0
Passed	52
Skipped	0
Total	52

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

botelastic · 2023-09-24T21:14:19Z

Hi! We just realized that we haven't looked into this PR in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

ebeahan · 2023-09-25T19:44:49Z

/test

elasticmachine · 2023-09-25T20:25:58Z

🌐 Coverage report

Name	Metrics % (`covered/total`)	Diff
Packages	100.0% (`1/1`)	💚
Files	100.0% (`15/15`)	💚
Classes	100.0% (`15/15`)	💚
Methods	98.63% (`72/73`)	👍 5.297
Lines	94.204% (`3283/3485`)	👍 3.728
Conditionals	100.0% (`0/0`)	💚

elasticmachine · 2023-10-03T16:32:39Z

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

willemdh · 2023-10-06T13:31:17Z

@ebeahan Fyi, we notice a substantial difference in throughput with this panw integration vs the filebeat panw module.. We have an open support ticket for that, but for now no solution.

taylor-swanson

LGTM

I'm not too familiar with the benchmarking features, but at least from an overview of what's here, nothing glaring stands out to me.

initial pass at adding traffic and threat benchmarks

123bd30

botelastic bot added the Stalled label Sep 24, 2023

ebeahan changed the title ~~initial pass at adding traffic and threat benchmarks~~ [panw] Adding traffic and threat performance benchmarks Sep 25, 2023

botelastic bot removed the Stalled label Sep 25, 2023

make file/dir structure comply with package-spec

a8f1fc6

ebeahan added enhancement New feature or request Integration:panw Palo Alto Next-Gen Firewall labels Sep 25, 2023

ebeahan marked this pull request as ready for review September 25, 2023 20:27

ebeahan requested a review from a team as a code owner September 25, 2023 20:27

ebeahan added the Team:Security-External Integrations label Oct 3, 2023

taylor-swanson approved these changes Oct 10, 2023

View reviewed changes

ebeahan merged commit 8238506 into elastic:main Oct 10, 2023

ebeahan mentioned this pull request Oct 12, 2023

[panw][benchmarking] Linting validation errors of benchmarking config #8179

Closed

jsoriano mentioned this pull request Oct 17, 2023

Chore(deps): bump github.com/elastic/package-spec/v3 from 3.0.0-rc1 to 3.0.0 elastic/elastic-package#1507

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[panw] Adding traffic and threat performance benchmarks #7545

[panw] Adding traffic and threat performance benchmarks #7545

Uh oh!

ebeahan commented Aug 25, 2023 •

edited

Loading

Uh oh!

elasticmachine commented Aug 25, 2023 •

edited

Loading

Build stats

Test stats 🧪

Uh oh!

botelastic bot commented Sep 24, 2023

Uh oh!

ebeahan commented Sep 25, 2023

Uh oh!

elasticmachine commented Sep 25, 2023

Uh oh!

elasticmachine commented Oct 3, 2023

Uh oh!

willemdh commented Oct 6, 2023 •

edited

Loading

Uh oh!

taylor-swanson left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

[panw] Adding traffic and threat performance benchmarks #7545

[panw] Adding traffic and threat performance benchmarks #7545

Uh oh!

Conversation

ebeahan commented Aug 25, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Testing results

Uh oh!

elasticmachine commented Aug 25, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💚 Build Succeeded

Build stats

Test stats 🧪

🤖 GitHub comments

Uh oh!

botelastic bot commented Sep 24, 2023

Uh oh!

ebeahan commented Sep 25, 2023

Uh oh!

elasticmachine commented Sep 25, 2023

🌐 Coverage report

Uh oh!

elasticmachine commented Oct 3, 2023

Uh oh!

willemdh commented Oct 6, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

taylor-swanson left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

ebeahan commented Aug 25, 2023 •

edited

Loading

elasticmachine commented Aug 25, 2023 •

edited

Loading

willemdh commented Oct 6, 2023 •

edited

Loading