Skip to content

Interconnects reconnects when EnableExternalDataChannel is enabled #18546

@kardymonds

Description

@kardymonds
  • yandex query tests trunk branch on testing/preprod (kuber),
  • old branch (2024-12-05) is working,
  • Image
  • log one pod (yq-red-alpha-0)
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373834:3164] [node 10005] ICH01 starting outgoing handshake
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463755225765681:2068] [node 10003] ICP06 reply for incoming handshake (actor [10000:7506465554817373831:3209]) is held
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463755225765681:2068] [node 10003] ICP09 (actor [10000:7506465554817373831:3209]) from: [10003:7506463754140386530:0] for: [10000:7506463755225765683:0]
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373829:3197] [node 10003] ICH07 SendExBlock ExternalDataChannelParams HandshakeId: "[\230\207\301]\010\224\333\3665S\332\351:>f\374;\360,\343\252Ws\t\240\233\036\311\264H\273"
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373831:3209] [node 0] ICH02 starting incoming handshake
2025-05-20 10:00:06 | NOTICE | INTERCONNECT_NETWORK | [10000 <-> 10005] 140626502633216:error:1408F10B:SSL routines:ssl3_get_record:wrong version number:/storage/d/srvdata/tared_svnc/cb33d18-c1ab45ec-87f21b56-ff8950c3/contrib/libs/openssl/ssl/record/ssl3_record.c:337:
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463733750928987:2063] [node 10005] ICP77 @350 StateWork -> StateWork
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463733750928987:2063] [node 10005] ICP052 dropped outgoing handshake: [10000:7506465554817373781:3130] poison: false
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463733750928987:2063] [node 10005] ICP111 dropped incoming handshake: [10000:7506465554817373796:3132] poison: true
2025-05-20 10:00:06 | INFO | INTERCONNECT | Proxy [10000:7506463733750928987:2063] [node 10005] ICP20 outgoing handshake succeeded
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | ICR04 Host: yq-red-alpha-3, RESOLVED address
2025-05-20 10:00:06 | INFO | INTERCONNECT | Handshake [10000:7506465554817373781:3130] [node 10005] ICH04 handshake succeeded
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | ICListener: [0:0:0] ICL04 Accepted from: fc00::19:6d15:50380
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373829:3197] [node 10003] ICH07 SendExBlock ExRequest HandshakeId: "[\230\207\301]\010\224\333\3665S\332\351:>f\374;\360,\343\252Ws\t\240\233\036\311\264H\273"
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373829:3197] [node 10003] ICH05 connected to peer
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | ICR04 Host: yq-red-alpha-3, RESOLVED address
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Handshake [10000:7506465554817373829:3197] [node 10003] ICH01 starting outgoing handshake
2025-05-20 10:00:06 | NOTICE | INTERCONNECT_NETWORK | [10000 <-> 10003] 140626502633216:error:1408F10B:SSL routines:ssl3_get_record:wrong version number:/storage/d/srvdata/tared_svnc/cb33d18-c1ab45ec-87f21b56-ff8950c3/contrib/libs/openssl/ssl/record/ssl3_record.c:337:
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463755225765681:2068] [node 10003] ICP77 @350 StateWork -> StateWork
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463755225765681:2068] [node 10003] ICP052 dropped outgoing handshake: [10000:7506465554817373808:3186] poison: false
2025-05-20 10:00:06 | DEBUG | INTERCONNECT | Proxy [10000:7506463755225765681:2068] [node 10003] ICP111 dropped incoming handshake: [10000:7506465554817373813:3168] poison: true
  • ic config
StartTcp: true
MaxInflightAmountOfDataInKB: 1024000
HandshakeTimeoutDuration {
  Seconds: 1
}
EncryptionMode: REQUIRED
PathToCertificateFile: "/opt/kikimr/ic-crt/tls.crt"
PathToPrivateKeyFile: "/opt/kikimr/ic-crt/tls.key"
PathToCaFile: "/opt/kikimr/ic-crt/ca.crt"
SendBufferDieLimitInMB: 30000
  • if add EnableExternalDataChannel: False - working

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions