Skip to content

reduce error=InvalidPathSyntax #22925

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
hznor opened this issue Apr 22, 2025 · 3 comments
Closed

reduce error=InvalidPathSyntax #22925

hznor opened this issue Apr 22, 2025 · 3 comments
Labels
transform: reduce Anything `reduce` transform related type: bug A code related bug.

Comments

@hznor
Copy link

hznor commented Apr 22, 2025

Problem

I get this error:

2025-04-22T17:20:28.604166Z ERROR transform{component_kind="transform" component_id=kubernetes_pods_reduce_transform component_type=reduce}: vector::internal_events::reduce: Event field could not be reduced. path=KeyString("ExceptionDetail.Errors.10_0_199_64:9042.Data") error=InvalidPathSyntax { path: "ExceptionDetail.Errors.10_0_199_64:9042.Data" } error_type="condition_failed" stage="processing" internal_log_rate_limit=true

Configuration

      kubernetes_pods_reduce_transform:
        expire_after_ms: 15000
        flush_period_ms: 500
        inputs:
        - kubernetes_pods_fix_message
        max_events: 1000
        type: reduce

Version

0.42.0

@hznor hznor added the type: bug A code related bug. label Apr 22, 2025
@pront pront added the transform: reduce Anything `reduce` transform related label Apr 22, 2025
@pront
Copy link
Member

pront commented Apr 22, 2025

I cannot reproduce this with the latest Vector version:

transforms:
  transform0:
    type: reduce
    inputs:
      - my_input
    group_by:
      - id
    expire_after_ms: 2000
    max_events: 500
    merge_strategies:
      foo: array
tests:
  - name: map_transform0.space
    inputs:
      - type: vrl
        insert_at: transform0
        source: |
          . = {
            "ExceptionDetail.Errors.10_0_199_64:9042.Data": 1
          }
      - type: vrl
        insert_at: transform0
        source: |
          . = {
            "ExceptionDetail.Errors.10_0_199_64:9042.Data": 1
          }
    outputs:
      - extract_from: transform0
        conditions:
          - type: vrl
            source: |
              assert_eq!(., {"ExceptionDetail.Errors.10_0_199_64:9042.Data": 2 })

Result:

cargo run --color=always --profile dev -- test tests/reduce.yaml
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.72s
     Running `target/debug/vector test /tests/reduce.yaml`
Running tests
test map_transform0.space ... passed

Process finished with exit code 0

Please try using a more recent Vector version.

@pront pront closed this as completed Apr 22, 2025
@pront
Copy link
Member

pront commented Apr 22, 2025

Didn't mean to close just yet.

@pront pront reopened this Apr 22, 2025
@hznor
Copy link
Author

hznor commented Apr 27, 2025

That's correct, this error is apparently not present with the latest vector version.
Thank you 👍

@hznor hznor closed this as completed Apr 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
transform: reduce Anything `reduce` transform related type: bug A code related bug.
Projects
None yet
Development

No branches or pull requests

2 participants