When there are multiple Kafka-type sinks, some of the sinks may not function properly when Vector starts.

[loveyang2012]

A note for the community

No response

Problem

Due to certain reasons, my Vector configuration is as follows:
When I start Vector, only some of the sinks work properly, while others throw exceptions, resulting in data loss. However, if I delete the problematic sinks and then add them again, they work fine.
Is this a bug in Vector, or is it an issue with Kafka?

Configuration

sources:
  login-dtl:
    type: "kafka"
    bootstrap_servers: 10.250.11.12:6667
    group_id: jy-vector
    topics:
      - top-aes-ft-top-bos-login-dtl
  user-info:
    type: "kafka"
    bootstrap_servers: 10.250.11.12:6667
    group_id: jy-vector
    topics:
      - top-aes-ft-top-bus-user-info
  apflow-cm51006:
    type: "kafka"
    bootstrap_servers: 10.254.226.133:9092 
    group_id: jy-vector
    topics:
      - apflow-cm51006
  apflow-cm51007:
    type: "kafka"
    bootstrap_servers: 10.254.226.133:9092 
    group_id: jy-vector
    topics:
      - apflow-cm51007
  apflow-cm51010:
    type: "kafka"
    bootstrap_servers: 10.254.226.133:9092
    group_id: jy-vector
    topics:
      - apflow-cm51010

sinks:
  sink-login-dtl:
    type: "kafka"
    inputs: ["login-dtl"]
    bootstrap_servers: 10.230.198.155:9192
    topic: top-aes-ft-top-bos-login-dtl
    message_timeout_ms: 1000000
    socket_timeout_ms: 60000
    encoding:
     codec: "json"
  sink-user-info:
    type: "kafka"
    inputs: ["user-info"]
    bootstrap_servers: 10.230.198.155:9192
    topic: top-aes-ft-top-bus-user-info
    message_timeout_ms: 1000000
    socket_timeout_ms: 60000
    encoding:
     codec: "json"

  sink-cm51007:
    type: "kafka"
    inputs: ["apflow-cm51007"]
    bootstrap_servers: 10.230.198.155:9192
    topic: apflow-cm51007
    encoding:
     codec: "json"

  sink-cm51006:
    type: "kafka"
    inputs: ["apflow-cm51006"]
    bootstrap_servers: 10.230.198.155:9192
    topic: apflow-cm51006
    encoding:
     codec: "json"

  sink-cm51010:
    type: "kafka"
    inputs: ["apflow-cm51010"]
    bootstrap_servers: 10.230.198.155:9192
    topic: apflow-cm51010
    encoding:
     codec: "json"

api:
   enabled: true
   address: "127.0.0.1:8687"


timezone: "Asia/Shanghai"

Version

0.46

Debug Output

Example Data

Additional Context

No response

References

No response