{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":50647838,"defaultBranch":"master","name":"kudu","ownerLogin":"apache","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2016-01-29T08:00:06.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/47359?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1693558414.0","currentOid":""},"activityList":{"items":[{"before":"d1bc5b53ef006ac14bca4417c4745c5875d89734","after":"6d6364d19d287d8effb604b6ab11dfdff5db794e","ref":"refs/heads/master","pushedAt":"2024-05-23T19:33:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[metrics] Add tablet level metrics for scans op time\n\nWe currently have monitoring in place for scan data volume and\nslow scans, but we are still lacking monitoring data for scan\nrequest timings.\n\nIn this patch, I have added monitoring for scan request timings at\nthe tablet level to assist us in pinpointing specific scenarios of\nhigh CPU usage during scanning operations.\n\nChange-Id: I8f490cfb6f37aef60b34697100fb502374fcc503\nReviewed-on: http://gerrit.cloudera.org:8080/21291\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[metrics] Add tablet level metrics for scans op time"}},{"before":"7e8876a10d379d58f59f8a0edfe95026530d6190","after":"9bb5c3c8ae4e2892f9a67c5dc739dc6ffbc37d3e","ref":"refs/heads/branch-1.17.x","pushedAt":"2024-05-23T02:59:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Fix row_project codegen params noalias overflow\n\nfunction->addParamAttr is 0-based indexes, current row_project generator IR code is:\n `define i1 @ProjRead(i8* %src, %\"class.kudu::RowBlockRow\"* noalias %rbrow, %\"class.kudu::Arena\"* noalias %arena)`\nnot same as before.\n\nChange-Id: I1dab7d46cff96ed1ebbd020584a066f04e6ca12a\nReviewed-on: http://gerrit.cloudera.org:8080/19952\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin \n(cherry picked from commit c485c8c3cf4b76d8a55e2ec98e27803341285f75)\nReviewed-on: http://gerrit.cloudera.org:8080/21448\nTested-by: Alexey Serbin ","shortMessageHtmlLink":"Fix row_project codegen params noalias overflow"}},{"before":"1ca4559e4b06141b62dbacd75a509ca2cc2e4b9e","after":"7e8876a10d379d58f59f8a0edfe95026530d6190","ref":"refs/heads/branch-1.17.x","pushedAt":"2024-05-22T21:12:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Fix deadlock on fail for CBTree-test\n\nWhen TestConcurrentIterateAndInsert, TestConcurrentInsert,\nTestRacyConcurrentInsert fail while --gtest_repeat is used, they\nwill keep running forever. Instead of just returning on fail,\nthey should properly stop the other threads running, and then exit.\n\nTo reproduce the problem, run this on ARM (where the test actually\nfails):\n./bin/cbtree-test --gtest_repeat=100 --gtest_filter=*Racy*\n\nChange-Id: Ia10d05dfdc4a12cb034450f432693f054d138498\nReviewed-on: http://gerrit.cloudera.org:8080/21446\nTested-by: Alexey Serbin \nReviewed-by: Alexey Serbin \n(cherry picked from commit d1bc5b53ef006ac14bca4417c4745c5875d89734)\nReviewed-on: http://gerrit.cloudera.org:8080/21451\nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"Fix deadlock on fail for CBTree-test"}},{"before":"c2d25d5f57d102d9ad9869eaf208d035a22e18aa","after":"d1bc5b53ef006ac14bca4417c4745c5875d89734","ref":"refs/heads/master","pushedAt":"2024-05-22T19:22:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Fix deadlock on fail for CBTree-test\n\nWhen TestConcurrentIterateAndInsert, TestConcurrentInsert,\nTestRacyConcurrentInsert fail while --gtest_repeat is used, they\nwill keep running forever. Instead of just returning on fail,\nthey should properly stop the other threads running, and then exit.\n\nTo reproduce the problem, run this on ARM (where the test actually\nfails):\n./bin/cbtree-test --gtest_repeat=100 --gtest_filter=*Racy*\n\nChange-Id: Ia10d05dfdc4a12cb034450f432693f054d138498\nReviewed-on: http://gerrit.cloudera.org:8080/21446\nTested-by: Alexey Serbin \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"Fix deadlock on fail for CBTree-test"}},{"before":"d7fb77f4cfbf6d638c6d11009ce3728ae30e01e3","after":"c2d25d5f57d102d9ad9869eaf208d035a22e18aa","ref":"refs/heads/master","pushedAt":"2024-05-22T11:50:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[metrics] Add tablet level metrics for alter schema op time\n\nAdd tablet-level statistics to track the time consumption of\nalter schema operations.\n\nThe addition of monitoring items will aid in historical issue\ntracking and analysis, as well as facilitate the configuration\nof monitoring alarms.\n\nChange-Id: I034fc3141349a940ee8aaac22ca90e1948fc7a6a\nReviewed-on: http://gerrit.cloudera.org:8080/21300\nReviewed-by: Yingchun Lai \nTested-by: Yingchun Lai ","shortMessageHtmlLink":"[metrics] Add tablet level metrics for alter schema op time"}},{"before":"c485c8c3cf4b76d8a55e2ec98e27803341285f75","after":"d7fb77f4cfbf6d638c6d11009ce3728ae30e01e3","ref":"refs/heads/master","pushedAt":"2024-05-22T11:49:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Leader rebalance ignores soft deleted tables\n\nSoft deleted tables no longer provide read/write service.\nTherefore it is not needed to do leader rebalance for soft\ndeleted tables, which may take a long time.\nThis patch provides a configuration\n'leader_rebalancing_filter_soft_deleted_tables' to decide\nwhether to ignore soft deleted tables when leader rebalancing.\n\nChange-Id: I1e2f37b004ed7d394e18d21cce97a2c9702adba3\nReviewed-on: http://gerrit.cloudera.org:8080/21411\nTested-by: Kudu Jenkins\nReviewed-by: Marton Greber \nReviewed-by: Yingchun Lai ","shortMessageHtmlLink":"Leader rebalance ignores soft deleted tables"}},{"before":"247535e5ee93f6219c7ba00a1051524b2079411e","after":"c485c8c3cf4b76d8a55e2ec98e27803341285f75","ref":"refs/heads/master","pushedAt":"2024-05-22T05:58:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Fix row_project codegen params noalias overflow\n\nfunction->addParamAttr is 0-based indexes, current row_project generator IR code is:\n`define i1 @ProjRead(i8* %src, %\"class.kudu::RowBlockRow\"* noalias %rbrow, %\"class.kudu::Arena\"* noalias %arena)`\nnot same with before.\n\nChange-Id: I1dab7d46cff96ed1ebbd020584a066f04e6ca12a\nReviewed-on: http://gerrit.cloudera.org:8080/19952\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"Fix row_project codegen params noalias overflow"}},{"before":"49d2bc9ed51307cd9b258681cb64a92ef1cf07a5","after":"247535e5ee93f6219c7ba00a1051524b2079411e","ref":"refs/heads/master","pushedAt":"2024-05-21T02:31:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Allow creating a table with empty range partition\n\nCurrently, when creating a table without setting range partition,\nit will create an unbounded partition defaultly. In some cases,\nthis method is not suitable. For example, the user wants to create\na table with empty partition, and add a new partition daily to\nimport the data into Kudu. Besides, copying a empty partition table\nto another cluster will create an unbounded partition table when\nusing the CLI command 'kudu table copy'. It changes the orginal\ntable structure.\nTherefore, it is better to support to create a table with empty\npartition, that is without any partitions.\n\nChange-Id: I480072a693e5b6f1a13f86cb1475cff0452472e7\nReviewed-on: http://gerrit.cloudera.org:8080/21328\nReviewed-by: Yingchun Lai \nTested-by: Yingchun Lai ","shortMessageHtmlLink":"Allow creating a table with empty range partition"}},{"before":"46c4cb1c2906a77f700509d02813a15dbf919927","after":"49d2bc9ed51307cd9b258681cb64a92ef1cf07a5","ref":"refs/heads/master","pushedAt":"2024-05-16T13:06:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[alter_table-test] Increase assertion timeout\n\nOn ubuntu 22.04 release build, AlterReplicationFactorWhileWriting test\nfailed with timeout. So timeout was increased to 60 seconds.\n\nChange-Id: Ifc51365a798569c22e680eb3e7723a5f330d43c5\nReviewed-on: http://gerrit.cloudera.org:8080/21347\nTested-by: Kudu Jenkins\nReviewed-by: Attila Bukor ","shortMessageHtmlLink":"[alter_table-test] Increase assertion timeout"}},{"before":"eb0a41fdb0642baa61a58f925bb82157330abe7a","after":"46c4cb1c2906a77f700509d02813a15dbf919927","ref":"refs/heads/master","pushedAt":"2024-05-15T15:57:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[security-flags-itest] Fix missing command line flags\n\nIt is a known phenomenon, that static libraries won't be included into\nan executable if there are no usage for any function or variable[1].\nThis means the initialization routines in the library won't be executed,\neven if these initialization routines have side effects, such as\nregistering the variable in the gflags ecosystem. As a result, the\nCheckRpcAuthnFlagsGroupValidator test failed because\n\"rpc_authentication\" flag was not registered properly. To solve this\nissue, a command line variable check is added, so now the library will\nbe used in the executable and the initialization routines will be\nexecuted.\n\n[1] https://stackoverflow.com/questions/1229430/how-do-i-prevent-my-unused-global-variables-being-compiled-out-of-my-static-li\n\nChange-Id: Iec751e8761562612d97b886740c9b20cd134a0bc\nReviewed-on: http://gerrit.cloudera.org:8080/21399\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[security-flags-itest] Fix missing command line flags"}},{"before":"feaf1daf56895c921fd08917334ce31d81f8b3e4","after":"eb0a41fdb0642baa61a58f925bb82157330abe7a","ref":"refs/heads/master","pushedAt":"2024-05-15T00:54:10.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[common] get rid of MutexLock\n\nSince contemporary STL library provides both std::lock_guard and\nstd::unique_lock, there is no need to keep MutexLock.\n\nChange-Id: I49e0ef2c688ef8be74d018bb9bffe70b6655e654\nReviewed-on: http://gerrit.cloudera.org:8080/21415\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"[common] get rid of MutexLock"}},{"before":"b607633fd3c2b676fbd2cbe57c44bddf818dc457","after":"feaf1daf56895c921fd08917334ce31d81f8b3e4","ref":"refs/heads/master","pushedAt":"2024-05-14T22:19:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[tablet] fix race accessing OpState's start time\n\nThis patch addresses a race reported by TSAN with traces like below:\n\nWARNING: ThreadSanitizer: data race (pid=11024)\n Write of size 8 at 0x7b580011f260 by thread T174:\n #0 kudu::tablet::OpState::set_start_time(kudu::MonoTime) src/kudu/tablet/ops/op.h:274:58\n #1 kudu::tablet::WriteOp::Start() src/kudu/tablet/ops/write_op.cc:273:11\n #2 kudu::tablet::OpDriver::Prepare() src/kudu/tablet/ops/op_driver.cc:329:7\n #3 kudu::tablet::OpDriver::PrepareTask() src/kudu/tablet/ops/op_driver.cc:249:31\n ...\n\n Previous read of size 8 at 0x7b580011f260 by thread T5 (mutexes: write M835553159786377312):\n #0 kudu::tablet::OpState::start_time() const src/kudu/tablet/ops/op.h:272:40\n #1 kudu::tablet::WriteOp::ToString() const src/kudu/tablet/ops/write_op.cc:378:36\n #2 kudu::tablet::OpDriver::ToStringUnlocked() const src/kudu/tablet/ops/op_driver.cc:209:23\n #3 kudu::tablet::OpDriver::ToString() const src/kudu/tablet/ops/op_driver.cc:203:10\n #4 kudu::tablet::TabletReplica::GetInFlightOps(...) const src/kudu/tablet/tablet_replica.cc:728:41\n #5 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage(...) src/kudu/tserver/tserver_path_handlers.cc:286:14\n ...\n\nChange-Id: I52de0840aa20f64cf15c7a9da2d553257c7e85e7\nReviewed-on: http://gerrit.cloudera.org:8080/21427\nTested-by: Kudu Jenkins\nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"[tablet] fix race accessing OpState's start time"}},{"before":"5fccfbc2bda0d017d283cbefcb3cb8e4b026c8e9","after":"b607633fd3c2b676fbd2cbe57c44bddf818dc457","ref":"refs/heads/master","pushedAt":"2024-05-13T16:02:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"KUDU-3568 Fix compaction budgeting test by setting memory hard limit\n\nTestRowSetCompactionSkipWithBudgetingConstraints can fail if the\nmemory on node running the test is high. It happens because the test\ngenerates deltas of size worth a few MBs that is multiplied with a\npreset factor to ensure the result (i.e. memory required for rowset\ncompaction completion) is of high value of the order of 200 GB per\nrowset.\n\nEven though nodes running the test generally don't have so much\nphysical memory, it is still possible to end up with high memory nodes.\nOn such nodes, the test might fail.\n\nThe patch fixes that problem by deterministically ensuring that\ncompaction memory requirement is always higher than the memory hard\nlimit. It does that by doing the following:\n1. Move out the budgeting compaction tests out in a separate binary.\n2. This gives flexibility to set the memory hard limit as per test\n needs. It is important to node that once a memory hard limit is\n set, it remains the same for all tests executed through\n binary lifecycle.\n3. Set the hard memory limit to 1 GB which is enough to handle compaction\n requirements for TestRowSetCompactionProceedWithNoBudgetingConstraints.\n For TestRowSetCompactionSkipWithBudgetingConstraints, it is not\n enough because we set the delta memory factor high to exceed 1 GB.\n Both the test are now expected to succeed deterministically.\n\nChange-Id: I85d104e1d066507ce8e72a00cc5165cc4b85e48d\nReviewed-on: http://gerrit.cloudera.org:8080/21416\nTested-by: Alexey Serbin \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"KUDU-3568 Fix compaction budgeting test by setting memory hard limit"}},{"before":"358f0f172609e1a0ea359eb4e8118d0584926b3d","after":"5fccfbc2bda0d017d283cbefcb3cb8e4b026c8e9","ref":"refs/heads/master","pushedAt":"2024-05-10T16:15:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[master] fix race in auto leader rebalancing\n\nIt turned out that auto leader rebalancing task wasn't explicitly\nshutdown upon shutting down catalog manager. That lead to race\nconditions as reported by TSAN, at least in test scenarios (see below).\nThis patch addresses the issue.\n\n WARNING: ThreadSanitizer: data race (pid=23827)\n Write of size 1 at 0x7b4000008208 by main thread:\n #0 AnnotateRWLockDestroy thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interface_ann.cpp:264 (auto_rebalancer-test+0x33575e)\n #1 kudu::rw_spinlock::~rw_spinlock() src/kudu/util/locks.h:89:5 (libmaster.so+0x359376)\n #2 kudu::master::TSManager::~TSManager() src/kudu/master/ts_manager.cc:108:1 (libmaster.so+0x4ad201)\n #3 kudu::master::TSManager::~TSManager() src/kudu/master/ts_manager.cc:107:25 (libmaster.so+0x4ad229)\n #4 std::__1::default_delete::operator()(kudu::master::TSManager*) const thirdparty/installed/tsan/include/c++/v1/memory:2262:5 (libmaster.so+0x407ce7)\n #5 std::__1::unique_ptr >::reset(kudu::master::TSManager*) thirdparty/installed/tsan/include/c++/v1/memory:2517:7 (libmaster.so+0x40157d)\n #6 std::__1::unique_ptr >::~unique_ptr() thirdparty/installed/tsan/include/c++/v1/memory:2471:19 (libmaster.so+0x4015eb)\n #7 kudu::master::Master::~Master() src/kudu/master/master.cc:263:1 (libmaster.so+0x3f7a4a)\n #8 kudu::master::Master::~Master() src/kudu/master/master.cc:261:19 (libmaster.so+0x3f7dc9)\n #9 std::__1::default_delete::operator()(kudu::master::Master*) const thirdparty/installed/tsan/include/c++/v1/memory:2262:5 (libmaster.so+0x435627)\n #10 std::__1::unique_ptr >::reset(kudu::master::Master*) thirdparty/installed/tsan/include/c++/v1/memory:2517:7 (libmaster.so+0x42e6ed)\n #11 kudu::master::MiniMaster::Shutdown() src/kudu/master/mini_master.cc:120:13 (libmaster.so+0x4c2612)\n ...\n Previous atomic write of size 4 at 0x7b4000008208 by thread T439 (mutexes: write M1141235379631443968):\n #0 __tsan_atomic32_compare_exchange_strong thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interface_atomic.cpp:780 (auto_rebalancer-test+0x33eb60)\n #1 base::subtle::Release_CompareAndSwap(int volatile*, int, int) /src/kudu/gutil/atomicops-internals-tsan.h:88:3 (libmaster.so+0x2e2b34)\n #2 kudu::rw_semaphore::unlock_shared() src/kudu/util/rw_semaphore.h:91:19 (libmaster.so+0x2e29c8)\n #3 kudu::rw_spinlock::unlock_shared() src/kudu/util/locks.h:99:10 (libmaster.so+0x2e28ef)\n #4 std::__1::shared_lock::~shared_lock() /thirdparty/installed/tsan/include/c++/v1/shared_mutex:369:19 (libmaster.so+0x2e23e0)\n #5 kudu::master::TSManager::GetAllDescriptors(std::__1::vector, std::__1::allocator > >*) const src/kudu/master/ts_manager.cc:206:1 (libmaster.so+0x4adeb6)\n #6 kudu::master::AutoLeaderRebalancerTask::RunLeaderRebalancer() src/kudu/master/auto_leader_rebalancer.cc:405:16 (libmaster.so+0x2fb51b)\n #7 kudu::master::AutoLeaderRebalancerTask::RunLoop() src/kudu/master/auto_leader_rebalancer.cc:445:7 (libmaster.so+0x2fbaa9)\n\nThis is a follow-up to 10efaf2c77dfe5e4474505e0267c583c011703be.\n\nChange-Id: Iccd66d00280d22b37386230874937e5260f07f3b\nReviewed-on: http://gerrit.cloudera.org:8080/21417\nReviewed-by: Wang Xixu <1450306854@qq.com>\nTested-by: Alexey Serbin \nReviewed-by: Yifan Zhang ","shortMessageHtmlLink":"[master] fix race in auto leader rebalancing"}},{"before":"35716499d850ed594ea93255efa84708c3d65537","after":"358f0f172609e1a0ea359eb4e8118d0584926b3d","ref":"refs/heads/master","pushedAt":"2024-05-08T16:58:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"KUDU-613: Cleanup of cache code\n\nThis patch moves some classes out of the\nanonymous namespace and into the headers\nof the cache and nvm_cache files. These\nclasses will be used by the new SLRU cache.\nThis path also templatizes the HandleTable class\nto be used by both the cache and nvm_cache files.\n\nChange-Id: I506d4577c0ae873b01d7fa4f53846d6fd0f664cf\nReviewed-on: http://gerrit.cloudera.org:8080/21018\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"KUDU-613: Cleanup of cache code"}},{"before":"b72fc6255a77418ef87fc5f07476528b027c6f99","after":"35716499d850ed594ea93255efa84708c3d65537","ref":"refs/heads/master","pushedAt":"2024-05-08T11:42:49.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[tablet] update the severity level of some tablet metrics\n\nThe motivation for this update was a request to provide information\non the number of rows returned by scanners run against a particular\ntablet. That's to be on par with the following tablet metrics of the\nMetricLevel::kInfo severity level:\n * rows_inserted\n * rows_updated\n * rows_upserted\n * rows_deleted\n\nI also took the liberty of updating the level of some other tablet\nmetrics to make their severity level more consistent with the rest\nof tablet metrics that have similar semantics.\n\nChange-Id: If468eeef8488f4a28bdc23a2fc45073e4a3592d4\nReviewed-on: http://gerrit.cloudera.org:8080/21384\nReviewed-by: Attila Bukor \nTested-by: Attila Bukor ","shortMessageHtmlLink":"[tablet] update the severity level of some tablet metrics"}},{"before":"259fcc2b501077402e3d0e0d474a7ca475b70b5f","after":"b72fc6255a77418ef87fc5f07476528b027c6f99","ref":"refs/heads/master","pushedAt":"2024-05-07T14:04:46.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[metrics] Add metrics for create and delete op time\n\nAdd server-level statistics to track the time consumption of\ncreate tablet and delete tablet operations.\nThe addition of monitoring items will aid in historical issue\ntracking and analysis, as well as facilitate the configuration\nof monitoring alarms.\n\nChange-Id: I02bd52013caa94a33143cb16ff3831a49b74bac4\nReviewed-on: http://gerrit.cloudera.org:8080/21316\nTested-by: Kudu Jenkins\nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[metrics] Add metrics for create and delete op time"}},{"before":"b7bf6b03b01a7c8f561d9bd7ff132fc255b2209f","after":"a71b5b54c81d935ae01ce033aa07e33677aeeabb","ref":"refs/heads/gh-pages","pushedAt":"2024-05-07T14:04:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[blog] Fix typo in blogpost\n\nThis patch adds a missing space for Backup and Restore heading and\nuniform some line spacings.\n\nChange-Id: Iec743b5151ac9c139d3b3513f99d0369cfe0fc93\nReviewed-on: http://gerrit.cloudera.org:8080/21378\nTested-by: Abhishek Chennaka \nReviewed-by: Mahesh Reddy \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[blog] Fix typo in blogpost"}},{"before":"1f0c0b0172fb211e74848c87fce983e45280e66d","after":"259fcc2b501077402e3d0e0d474a7ca475b70b5f","ref":"refs/heads/master","pushedAt":"2024-05-07T07:28:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[CMakeLists] Make kudu_test_main static\n\nThis change makes sure that kudu_util.so is loaded at the beginning of\nthe library search order. This is needed because in unwind_safeness.cc\nthere is a dlsym execution in the constructor function, that creates a\nwrapper for dlopen and dlclose to prevent a potential deadlock during\nunwind stack resolve. It looks for the next declaration of the functions\ncalled \"dlopen\" and \"dlclose\" in shared object files. If kudu_util is\nloaded too late, then it won't find these functions and throws an error.\nThis happens in ubuntu 22.04 test runs. To solve this issue, the\nkudu_test_main was changed to a static library and kudu_util was moved\nto the front of the library list.\n\nThis is a best effort fix, and it should only have impact on test\nexecution.\n\nChange-Id: I0dfeb1fa04ed91e95fd1f8d789f020dd44289fea\nReviewed-on: http://gerrit.cloudera.org:8080/21282\nTested-by: Alexey Serbin \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[CMakeLists] Make kudu_test_main static"}},{"before":"732f0c1e51bca04091431859918a3b84866373a0","after":"1f0c0b0172fb211e74848c87fce983e45280e66d","ref":"refs/heads/master","pushedAt":"2024-05-03T18:03:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[g++11] Fix DecrementIntCell for g++10 and g++11\n\nThere seems to be a compiler bug, that optimizes out the safety check\nfor INT_MIN in the DecrementIntCell function. It appears on RHEL 9.2\nwith g++ 11.4.1. Only in Release build. For more infoi, see:\n\nhttps://stackoverflow.com/questions/78424303/g-optimizes-away-check-for-int-min-in-release-build\n\nThe issue seems to be fixed in g++12 and not yet present in g++9.\n\nSolution:\nSlightly change the function to ensure it is compiled correctly.\nThis modification should not alter the correct optimized code.\n\nBasically, any change where the compiler cannot perform the two\noptimization steps (in this order) should address the issue:\n\n+ if (x == INT_MIN) x = INT_MAX; else x -= 1; ====> x -= 1\n(this is equivalent on the x86 platform).\n+ if (x - 1 < x) ====> if (true)\n(this equivalence holds only at the mathematical level).\n\nChange-Id: Ia3cea2849a88c4d7e2587ceb805cd3258652e3c5\nReviewed-on: http://gerrit.cloudera.org:8080/21396\nTested-by: Alexey Serbin \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"[g++11] Fix DecrementIntCell for g++10 and g++11"}},{"before":"c39e72a98e124e5a12080bac42105b996594d806","after":"732f0c1e51bca04091431859918a3b84866373a0","ref":"refs/heads/master","pushedAt":"2024-05-03T15:59:58.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[tserver] limit number of trace metrics for TabletCopyClient\n\nThe trace metrics registry assumes that the number of entries is quite\nsmall, with the current threshold of 100. In its turn, a thread pool\nunconditionally registers and updates its trace metrics while executing\nsubmitted tasks. Since a tablet server might host thousands of tablet\nreplicas, it's not a good idea to include the UUID of the tablet into\nthe name of the download thread pool spawned by every TabletCopyClient\ninstance.\n\nThis is a follow-up to 0d95304fa46ee5d96bcaa934c7660369f2860e06.\n\nChange-Id: I334aa81aaed2378e7cae558bd8bb9e0f0c970fec\nReviewed-on: http://gerrit.cloudera.org:8080/21393\nTested-by: Marton Greber \nReviewed-by: Marton Greber ","shortMessageHtmlLink":"[tserver] limit number of trace metrics for TabletCopyClient"}},{"before":"fdb42489d76098eeca371ac57ae02ea176438c64","after":"c39e72a98e124e5a12080bac42105b996594d806","ref":"refs/heads/master","pushedAt":"2024-05-02T21:36:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[tablet] fix WriteOp::ToString() for non-started ops\n\nAfter [1] and prior to this patch, at least linked_list-test and\nupdate_scan_delta_compact-test would fail from time to time with\nDCHECK triggered like in the snippet below:\n\n F20240430 19:48:41.064476 2463727 monotime.cc:342] Check failed: t_beg.Initialized()\n *** Check failure stack trace: ***\n @ 0x7f3c1472548d google::LogMessage::Fail() at ??:0\n @ 0x7f3c147290d7 google::LogMessage::SendToLog() at ??:0\n @ 0x7f3c14724e8c google::LogMessage::Flush() at ??:0\n @ 0x7f3c147265c9 google::LogMessageFatal::~LogMessageFatal() at ??:0\n @ 0x7f3c1564dff0 kudu::operator-() at ??:0\n @ 0x7f3c1b46a0cd kudu::tablet::WriteOp::ToString() at ??:0\n @ 0x7f3c1b454416 kudu::tablet::OpDriver::ToStringUnlocked() at ??:0\n @ 0x7f3c1b45436f kudu::tablet::OpDriver::ToString() at ??:0\n @ 0x7f3c1b42d154 kudu::tablet::TabletReplica::GetInFlightOps() at ??:0\n @ 0x7f3c1c121c1d kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0\n\nThis is a follow-up to [1].\n\n[1] https://github.com/apache/kudu/commit/ad3936521af034ffcac637f97cd8c932f6289b4f\n\nChange-Id: Ie4cf49a72d4c7c40c6663a763e79958643fac9a4\nReviewed-on: http://gerrit.cloudera.org:8080/21381\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"[tablet] fix WriteOp::ToString() for non-started ops"}},{"before":"0de168f7e0abcf0c29facefcc9c0c9e12b284140","after":"1ca4559e4b06141b62dbacd75a509ca2cc2e4b9e","ref":"refs/heads/branch-1.17.x","pushedAt":"2024-05-02T21:00:07.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"KUDU-3569 fix race in CFileSet::Iterator::OptimizePKPredicates()\n\nThis patch addresses data race reported in KUDU-3569, using\nthe tablet schema defined by the iterator's projection instead of\nthe schema stored in the tablet metadata file. The latter might\nbe swapped by concurrently running AlterTable, which is the root\ncause of the data race.\n\nThis is a follow-up to 936d7edc4e4b69d2e1f1dffc96760cb3fd57a934.\n\nChange-Id: I92daa74cb86a77a4350f42db9ca5dec3a0d4ff75\nReviewed-on: http://gerrit.cloudera.org:8080/21359\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka \n(cherry picked from commit 977f1911fbcc4d5c323d6ae7ce7c1ab100ed11ea)\n Conflicts:\n src/kudu/tablet/cfile_set.h\nReviewed-on: http://gerrit.cloudera.org:8080/21366","shortMessageHtmlLink":"KUDU-3569 fix race in CFileSet::Iterator::OptimizePKPredicates()"}},{"before":"a6923a82b532b3d5c86547dfd9b0772bc97ae884","after":"fdb42489d76098eeca371ac57ae02ea176438c64","ref":"refs/heads/master","pushedAt":"2024-05-02T17:28:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[build] Fix RocksDB Snappy dependency.\n\nRocksDB uses Snappy. When statically linking Kudu, librocksdb.a contains\nmultiple undefined symbols that are defined in libsnappy.a. In the case\nof static linking, the order of libraries passed to the linker matters,\nand libsnappy.a must come after librocksdb.a. This sometimes causes the\nrelease build to fail on RHEL 9.3.\n\nChange-Id: I3ce75f69d94436f732dbe9a0011546b1ae494824\nReviewed-on: http://gerrit.cloudera.org:8080/21370\nReviewed-by: Attila Bukor \nTested-by: Attila Bukor ","shortMessageHtmlLink":"[build] Fix RocksDB Snappy dependency."}},{"before":"0d95304fa46ee5d96bcaa934c7660369f2860e06","after":"a6923a82b532b3d5c86547dfd9b0772bc97ae884","ref":"refs/heads/master","pushedAt":"2024-05-02T09:42:13.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"martongreber","name":null,"path":"/martongreber","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/106229128?s=80&v=4"},"commit":{"message":"[Python] Update dependencies and 3.10 support\n\nThis patch updates the package dependencies to clearly define the\nsupported Python versions. Previously, supported versions were\ndetermined through trial and error (KUDU-2951). With this update, the\nfollowing versions are now explicitly supported:\n\n- Python 2.7\n- Python 3.6 to 3.10 (inclusive)\n\nThis patch adds support for the newer Python versions 3.9 and 3.10.\nSupport for Python versions 3.0 to 3.5 has been discontinued due to\ndependency complications in this range. However, this decision can be\nrevisited based on community feedback. To re-add support for these\nversions, use the following marker in `setup.py` and `requirements.txt`:\n'python_version >= 3.0, < 3.6'.\n\nTesting was conducted manually on:\n- Ubuntu 20: Python 2.7, Python 3.6 to 3.10\n- SLES 15 SP5: Python 3.10\n\nThe `setup.py` file has been updated to reflect these changes,\nensuring the correct versions are visible on PyPI upon the next release.\n\nChange-Id: I930a15018158563996819fb33d32a3bb5641c396\nReviewed-on: http://gerrit.cloudera.org:8080/21380\nTested-by: Marton Greber \nReviewed-by: Attila Bukor \nReviewed-by: Zoltan Martonka ","shortMessageHtmlLink":"[Python] Update dependencies and 3.10 support"}},{"before":"ad3936521af034ffcac637f97cd8c932f6289b4f","after":"0d95304fa46ee5d96bcaa934c7660369f2860e06","ref":"refs/heads/master","pushedAt":"2024-05-01T04:48:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[tserver] fix typo in generating name of tablet copy pool\n\nDon't use std::string instance after calling std::move() on it:\neven if it's in valid state, it's contents is unspecified, so\nthe result name for the thread pool isn't what it expected to be.\n\nChange-Id: If7287fd1255e174482e81fdfc863f5f4140199d7\nReviewed-on: http://gerrit.cloudera.org:8080/21374\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"[tserver] fix typo in generating name of tablet copy pool"}},{"before":"3912a97cd8998ef04c4e6f9c38bd365c582e8171","after":"ad3936521af034ffcac637f97cd8c932f6289b4f","ref":"refs/heads/master","pushedAt":"2024-04-29T20:59:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"Minor refactoring on Op class\n\nWe have derived various types of operations based on the Op class.\nNow, if we need to add time statistics for these operations, it\nwould be repetitive to add an initial timestamp separately for\neach derived class.\n\nIn this patch, I moved the 'start_time_' from the WriteOp class to\nthe OpState class, making it easier for subsequent derived classes\nto use.\n\nSince there are no logical changes, no additional unit tests have\nbeen added.\n\nChange-Id: Ie391d4a55b8da08a62025a05cc466fc2b947099c\nReviewed-on: http://gerrit.cloudera.org:8080/21342\nReviewed-by: Yingchun Lai \nTested-by: Yingchun Lai \nReviewed-by: Alexey Serbin ","shortMessageHtmlLink":"Minor refactoring on Op class"}},{"before":"977f1911fbcc4d5c323d6ae7ce7c1ab100ed11ea","after":"3912a97cd8998ef04c4e6f9c38bd365c582e8171","ref":"refs/heads/master","pushedAt":"2024-04-27T14:45:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"KUDU-3570 fix use-after-free in MajorDeltaCompactionOp\n\nThis patch addresses heap-use-after-free and data race issues reported\nin KUDU-3570. With this and one prior patch, neither TSAN nor ASAN\nreports any warnings when running alter_table-randomized-test, at least\nthat's the stats collected from more than 100 iterations.\n\nChange-Id: I491c6d98bed8780bcfb62f152db471d7a260d305\nReviewed-on: http://gerrit.cloudera.org:8080/21362\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"KUDU-3570 fix use-after-free in MajorDeltaCompactionOp"}},{"before":"b2a6fe26266e170b5e885d1ddac6a5f03ded1759","after":"977f1911fbcc4d5c323d6ae7ce7c1ab100ed11ea","ref":"refs/heads/master","pushedAt":"2024-04-26T23:59:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"KUDU-3569 fix race in CFileSet::Iterator::OptimizePKPredicates()\n\nThis patch addresses data race reported in KUDU-3569, using\nthe tablet schema defined by the iterator's projection instead of\nthe schema stored in the tablet metadata file. The latter might\nbe swapped by concurrently running AlterTable, which is the root\ncause of the data race.\n\nThis is a follow-up to 936d7edc4e4b69d2e1f1dffc96760cb3fd57a934.\n\nChange-Id: I92daa74cb86a77a4350f42db9ca5dec3a0d4ff75\nReviewed-on: http://gerrit.cloudera.org:8080/21359\nTested-by: Alexey Serbin \nReviewed-by: Abhishek Chennaka ","shortMessageHtmlLink":"KUDU-3569 fix race in CFileSet::Iterator::OptimizePKPredicates()"}},{"before":"a0a523018983d5c28efed44ef85c7680e7ce8c03","after":"b2a6fe26266e170b5e885d1ddac6a5f03ded1759","ref":"refs/heads/master","pushedAt":"2024-04-25T15:44:20.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"asfgit","name":null,"path":"/asfgit","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1341245?s=80&v=4"},"commit":{"message":"[util] fix TidyBot warnings in ScopedTracer\n\nThis patch removes superfluous constructs from ScopedTracer, addressing\nwarnings output by CLANG tidy, e.g.:\n\n 2024-04-24 18:49:17,524 INFO: src/kudu/util/debug/trace_event.h:1379:3: warning: 5 uninitialized fields at the end of the constructor call [\n clang-analyzer-optin.cplusplus.UninitializedObject]\n ScopedTracer() : p_data_(nullptr) {}\n ^\n ...\n\nThis patch doesn't contain any functional modifications.\n\nChange-Id: I0e2f8578180955d0c8c788a0ee160deefba6a3ca\nReviewed-on: http://gerrit.cloudera.org:8080/21352\nReviewed-by: Mahesh Reddy \nReviewed-by: Yingchun Lai \nTested-by: Alexey Serbin ","shortMessageHtmlLink":"[util] fix TidyBot warnings in ScopedTracer"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEUmKZ2gA","startCursor":null,"endCursor":null}},"title":"Activity ยท apache/kudu"}