[stable-25-1-3] Исключение thread.cpp:204: can not detach thread при работе под немезисом

[PavelEfarinov]

Nightly run with nemesis

Cluster version: stable-25-1-3.4e063a8

Active workloads:

• olap_workload
• oltp_workload
• node_broker_workload
• transfer_workload_row
• transfer_workload_column
• simple_queue_column
• simple_queue_row
• workload_log_column
• workload_log_row
• workload_log_column_select
• workload_log_row_select
• workload_topic

thread.cpp:204: can not detach thread

2025-07-16T05:23:15.670625+03:00 1284043 13620462775005056408 INFO ua_0/0 grpc call initialized, session_id [79cfc599-17e65e33-18ff69d6-81d55fd2], last_seq_no [0]
======= terminate() call stack ========
0. /tmp//-S/ydb/core/driver_lib/run/main.cpp:180: KikimrTerminateHandler @ 0x12A2DA4A
1. /tmp//-S/contrib/libs/cxxsupp/libcxxrt/exception.cc:1649: terminate @ 0x96B1AA8
2. ??:0: ?? @ 0x887C1AD
3. /-S/util/thread/factory.cpp:15: ~TPoolThread @ 0xA07D63E
4. /-S/util/thread/factory.cpp:13: ~TPoolThread @ 0xA07D63E
5. /-S/util/generic/ptr.h:36: CheckedDelete<IThreadFactory::IThread> @ 0xA07E377
6. /-S/util/generic/ptr.h:57: Destroy<IThreadFactory::IThread> @ 0xA07E377
7. /-S/util/generic/ptr.h:360: DoDestroy @ 0xA07E377
8. /-S/util/generic/ptr.h:290: ~THolder @ 0xA07E377
9. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:170: destroy @ 0xA07E377
10. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator_traits.h:334: destroy<THolder<IThreadFactory::IThread, TDelete>, 0> @ 0xA07E377
11. /-S/contrib/libs/cxxsupp/libcxx/include/vector:939: __base_destruct_at_end @ 0xA07E377
12. /-S/contrib/libs/cxxsupp/libcxx/include/vector:933: __clear @ 0xA07E377
13. /-S/contrib/libs/cxxsupp/libcxx/include/vector:716: clear @ 0xA07E377
14. /-S/util/thread/pool.cpp:186: Stop @ 0xA07E377
15. /-S/util/thread/pool.cpp:90: ~TImpl @ 0xA07DB5C
16. /-S/util/thread/pool.cpp:88: ?? @ 0xA07DDDD
17. /-S/util/generic/ptr.h:36: CheckedDelete<TThreadPool::TImpl> @ 0xA07C467
18. /-S/util/generic/ptr.h:57: Destroy<TThreadPool::TImpl> @ 0xA07C467
19. /-S/util/generic/ptr.h:360: DoDestroy @ 0xA07C467
20. /-S/util/generic/ptr.h:303: Reset @ 0xA07C467
21. /-S/util/generic/ptr.h:294: Destroy @ 0xA07C467
22. /-S/util/thread/pool.cpp:370: Stop @ 0xA07C467
23. /-S/ydb/library/yql/providers/s3/object_listers/yql_s3_list.h:84: ~TSharedListingContext @ 0xFAC1587
24. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:171: __release_shared @ 0xFAC1F09
25. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:217: __release_shared @ 0xFAC1F09
26. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:682: ~shared_ptr @ 0xFAC1F09
27. /tmp//-S/ydb/library/yql/providers/s3/object_listers/yql_s3_list.cpp:474: ~TS3ParallelLimitedListerFactory @ 0xFAC1F09
28. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:171: __release_shared @ 0x180E2E8B
29. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:217: __release_shared @ 0x180E2E8B
30. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:682: ~shared_ptr @ 0x180E2E8B
31. /tmp//-S/ydb/library/yql/providers/s3/provider/yql_s3_io_discovery.cpp:79: ~TS3IODiscoveryTransformer @ 0x180E2E8B
32. /tmp//-S/ydb/library/yql/providers/s3/provider/yql_s3_io_discovery.cpp:79: ?? @ 0x180E2F1D
33. /-S/util/generic/ptr.h:36: CheckedDelete<NYql::IGraphTransformer> @ 0x180E1297
34. /-S/util/generic/ptr.h:57: Destroy<NYql::IGraphTransformer> @ 0x180E1297
35. /-S/util/generic/ptr.h:360: DoDestroy @ 0x180E1297
36. /-S/util/generic/ptr.h:290: ~THolder @ 0x180E1297
37. /tmp//-S/ydb/library/yql/providers/s3/provider/yql_s3_datasource.cpp:22: ~TS3DataSourceProvider @ 0x180E1297
38. /tmp//-S/ydb/library/yql/providers/s3/provider/yql_s3_datasource.cpp:22: ~TS3DataSourceProvider @ 0x180E1297
39. /-S/util/generic/ptr.h:36: CheckedDelete<TThrRefBase> @ 0xF39EE12
40. /-S/util/generic/ptr.h:57: Destroy<TThrRefBase> @ 0xF39EE12
41. /-S/util/generic/ptr.h:405: UnRef @ 0xF39EE12
42. /-S/util/generic/ptr.h:410: UnRef @ 0xF39EE12
43. /-S/util/generic/ptr.h:481: UnRef @ 0xF39EE12
44. /-S/util/generic/ptr.h:625: UnRef @ 0xF39EE12
45. /-S/util/generic/ptr.h:523: ~TIntrusivePtr @ 0xF39EE12
46. /-S/contrib/libs/cxxsupp/libcxx/include/__utility/pair.h:63: ~pair @ 0xF39EE12
47. /-S/util/generic/hash_table.h:965: delete_node @ 0xF39EE12
48. /-S/util/generic/hash_table.h:1412: basic_clear @ 0xF39EE12
49. /-S/util/generic/hash_table.h:615: ~THashTable @ 0xF39D712
50. /-S/util/generic/hash.h:8: ~THashMap @ 0xF39D712
51. /-S/yql/essentials/core/yql_type_annotation.h:359: ~TTypeAnnotationContext @ 0xF39D712
52. /-S/yql/essentials/core/yql_type_annotation.h:359: ?? @ 0xF39DE9D
53. /-S/util/generic/ptr.h:36: CheckedDelete<TThrRefBase> @ 0x17720906
54. /-S/util/generic/ptr.h:57: Destroy<TThrRefBase> @ 0x17720906
55. /-S/util/generic/ptr.h:405: UnRef @ 0x17720906
56. /-S/util/generic/ptr.h:410: UnRef @ 0x17720906
57. /-S/util/generic/ptr.h:481: UnRef @ 0x17720906
58. /-S/util/generic/ptr.h:625: UnRef @ 0x17720906
59. /-S/util/generic/ptr.h:523: ~TIntrusivePtr @ 0x17720906
60. /tmp//-S/ydb/core/kqp/host/kqp_host.cpp:1115: ~TKqpHost @ 0x17720906
61. /tmp//-S/ydb/core/kqp/host/kqp_host.cpp:1115: ?? @ 0x17720A9D
62. /-S/util/generic/ptr.h:36: CheckedDelete<TThrRefBase> @ 0x175BD468
63. /-S/util/generic/ptr.h:57: Destroy<TThrRefBase> @ 0x175BD468
64. /-S/util/generic/ptr.h:405: UnRef @ 0x175BD468
65. /-S/util/generic/ptr.h:410: UnRef @ 0x175BD468
66. /-S/util/generic/ptr.h:481: UnRef @ 0x175BD468
67. /-S/util/generic/ptr.h:625: UnRef @ 0x175BD468
68. /-S/util/generic/ptr.h:523: ~TIntrusivePtr @ 0x175BD468
69. /tmp//-S/ydb/core/kqp/compile_service/kqp_compile_actor.cpp:37: ~TKqpCompileActor @ 0x175BD468
70. /tmp//-S/ydb/core/kqp/compile_service/kqp_compile_actor.cpp:37: ?? @ 0x175BD7FD
71. /-S/util/generic/ptr.h:36: CheckedDelete<NActors::IActor> @ 0xA1FBA77
72. /-S/util/generic/ptr.h:57: Destroy<NActors::IActor> @ 0xA1FBA77
73. /-S/util/generic/ptr.h:360: DoDestroy @ 0xA1FBA77
74. /-S/util/generic/ptr.h:290: ~THolder @ 0xA1FBA77
75. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:170: destroy @ 0xA1FBA77
76. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator_traits.h:334: destroy<THolder<NActors::IActor, TDelete>, 0> @ 0xA1FBA77
77. /-S/contrib/libs/cxxsupp/libcxx/include/vector:939: __base_destruct_at_end @ 0xA1FBA77
78. /-S/contrib/libs/cxxsupp/libcxx/include/vector:933: __clear @ 0xA1FBA77
79. /-S/contrib/libs/cxxsupp/libcxx/include/vector:716: clear @ 0xA1FBA77
80. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:113: DropUnregistered @ 0xA1FBA77
81. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:280: Execute @ 0xA1FC5D2
82. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:460: operator() @ 0xA1FFF42
83. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:512: ProcessExecutorPool @ 0xA1FFB10
84. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:538: ThreadProc @ 0xA200712
85. /-S/util/system/thread.cpp:244: ThreadProxy @ 0x974C837
86. ??:0: ?? @ 0x7F5F1AD0C608
87. ??:0: ?? @ 0x7F5F1AC31352
=======================================
uncaught exception:
    address -> 0x156858e38d10
    what() -> "(Error 22: Invalid argument) util/system/thread.cpp:204: can not detach thread"
    type -> TSystemError

[GrigoriyPA]

Посмотрел код по стеку из issue, выглядит так, что это не блокер, а падение вызвано багой в util. В этом деструкторе нету try / catch:
https://a.yandex-team.ru/arcadia/util/thread/factory.cpp?rev=r14804531#L13-17

По этому если pthread_detach фейлится тут:
https://a.yandex-team.ru/arcadia/util/system/thread.cpp?rev=r17001483#L205
То всё падает с terminate. При этом по стеку вызовов выше в деструкторах все не noexcept методы оборачиваются в try / catch:
https://a.yandex-team.ru/arcadia/util/thread/pool.cpp?rev=r16613529#L92-103

[zverevgeny]

снял тег area/cs @galnat

[GrigoriyPA]

Аналогичное падение наблюдается в topic sdk: https://paste.yandex-team.ru/4f635b0c-7787-418a-a63d-7aaec02027fc