{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":349172057,"defaultBranch":"main","name":"venice","ownerLogin":"linkedin","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2021-03-18T18:04:30.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/357098?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1714601565.0","currentOid":""},"activityList":{"items":[{"before":"40ed8875fb4d5ed7dda358fe58835548adddfebd","after":"4f6c731ab0689683deb210369427c5e268e18da2","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T21:31:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@40ed8875fb4d5ed7dda358fe58835548adddfebd 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/40ed8875fb4d5ed7dda358fe58835548adddfebd/hovercard\" href=\"https://github.com/linkedin/venice/commit/40ed8875fb4d5ed7dda358fe58835548adddfebd\"><tt>40ed887</tt></a> 🚀"}},{"before":"69e2e51637bafd77c86202ed5989456dc85fe974","after":"40ed8875fb4d5ed7dda358fe58835548adddfebd","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T21:30:29.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[server][da-vinci] Log VersionTopic offset when logging lossy rewind error (#952)\n\n* [server][da-vinci] Log VersionTopic offset when logging lossy rewind error\r\n\r\nWithout VT offset, it's difficult to find the right offset to dump VT\r\nfor troubleshooting.","shortMessageHtmlLink":"[server][da-vinci] Log VersionTopic offset when logging lossy rewind …"}},{"before":"7df577eec08acd3a6c9fd389c07bbcda185f0aad","after":"40ed8875fb4d5ed7dda358fe58835548adddfebd","ref":"refs/heads/main","pushedAt":"2024-05-01T21:30:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"huangminchn","name":"Min Huang","path":"/huangminchn","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10958899?s=80&v=4"},"commit":{"message":"[server][da-vinci] Log VersionTopic offset when logging lossy rewind error (#952)\n\n* [server][da-vinci] Log VersionTopic offset when logging lossy rewind error\r\n\r\nWithout VT offset, it's difficult to find the right offset to dump VT\r\nfor troubleshooting.","shortMessageHtmlLink":"[server][da-vinci] Log VersionTopic offset when logging lossy rewind …"}},{"before":"7df577eec08acd3a6c9fd389c07bbcda185f0aad","after":"69e2e51637bafd77c86202ed5989456dc85fe974","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T20:35:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@7df577eec08acd3a6c9fd389c07bbcda185f0aad 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/7df577eec08acd3a6c9fd389c07bbcda185f0aad/hovercard\" href=\"https://github.com/linkedin/venice/commit/7df577eec08acd3a6c9fd389c07bbcda185f0aad\"><tt>7df577e</tt></a> 🚀"}},{"before":"e47e401e178d0050c0fa1f5565c6d5b08d7e7730","after":"7df577eec08acd3a6c9fd389c07bbcda185f0aad","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T20:34:28.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[server] Make separate drainer for batch and hybrid store ingestions (#973)\n\nMake separate drainer for batch and hybrid store ingestions so that batch store ingestions does not affect hybrid store ingestions.\r\n\r\n---------\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[server] Make separate drainer for batch and hybrid store ingestions (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2272771523\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/973\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/973/hovercard\" href=\"https://github.com/linkedin/venice/pull/973\">#…</a>"}},{"before":"054ea3f9a0591a1f7710202567bbd1de7103a32e","after":"7df577eec08acd3a6c9fd389c07bbcda185f0aad","ref":"refs/heads/main","pushedAt":"2024-05-01T20:34:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"majisourav99","name":"Sourav Maji","path":"/majisourav99","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/62683561?s=80&v=4"},"commit":{"message":"[server] Make separate drainer for batch and hybrid store ingestions (#973)\n\nMake separate drainer for batch and hybrid store ingestions so that batch store ingestions does not affect hybrid store ingestions.\r\n\r\n---------\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[server] Make separate drainer for batch and hybrid store ingestions (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2272771523\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/973\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/973/hovercard\" href=\"https://github.com/linkedin/venice/pull/973\">#…</a>"}},{"before":"054ea3f9a0591a1f7710202567bbd1de7103a32e","after":"e47e401e178d0050c0fa1f5565c6d5b08d7e7730","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T17:44:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@054ea3f9a0591a1f7710202567bbd1de7103a32e 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/054ea3f9a0591a1f7710202567bbd1de7103a32e/hovercard\" href=\"https://github.com/linkedin/venice/commit/054ea3f9a0591a1f7710202567bbd1de7103a32e\"><tt>054ea3f</tt></a> 🚀"}},{"before":"8eac102d6de6f05a391810c7d394a986aa65c9fa","after":"054ea3f9a0591a1f7710202567bbd1de7103a32e","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T17:43:35.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[controller] Do not delete parent VT for target colo batch push (#964)\n\nTruncate topic after push is in terminal state if\r\n 1. Its a hybrid store or regular push. (Hybrid store target push uses repush which does not have target regions)\r\n 2. If target region push is enabled and job to push data only to target region completed (status == PUSHED)\r\n\r\n---------\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[controller] Do not delete parent VT for target colo batch push (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2266210816\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/964\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/964/hovercard\" href=\"https://github.com/linkedin/venice/pull/964\">#964</a>)"}},{"before":"05836eb93d11343c77514008005fe954408c9dbd","after":"054ea3f9a0591a1f7710202567bbd1de7103a32e","ref":"refs/heads/main","pushedAt":"2024-05-01T17:43:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"majisourav99","name":"Sourav Maji","path":"/majisourav99","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/62683561?s=80&v=4"},"commit":{"message":"[controller] Do not delete parent VT for target colo batch push (#964)\n\nTruncate topic after push is in terminal state if\r\n 1. Its a hybrid store or regular push. (Hybrid store target push uses repush which does not have target regions)\r\n 2. If target region push is enabled and job to push data only to target region completed (status == PUSHED)\r\n\r\n---------\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[controller] Do not delete parent VT for target colo batch push (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2266210816\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/964\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/964/hovercard\" href=\"https://github.com/linkedin/venice/pull/964\">#964</a>)"}},{"before":"05836eb93d11343c77514008005fe954408c9dbd","after":"8eac102d6de6f05a391810c7d394a986aa65c9fa","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T17:11:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@05836eb93d11343c77514008005fe954408c9dbd 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/05836eb93d11343c77514008005fe954408c9dbd/hovercard\" href=\"https://github.com/linkedin/venice/commit/05836eb93d11343c77514008005fe954408c9dbd\"><tt>05836eb</tt></a> 🚀"}},{"before":"164aca2d8c95fcd0cff7ddc52e6119e60ac13e33","after":"05836eb93d11343c77514008005fe954408c9dbd","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T17:10:00.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[router] Added config to enable DNS resolution before SSL (#970)\n\n* [router] Added config to enable DNS resolution before SSL\r\n\r\nConfig to enable this feature:\r\nrouter.resolve.before.ssl\r\n\r\nWhen this config is enabled, \"SslInitializer#enableSslTaskExecutor\"\r\nwill not be called, and the SSL handshake thread pool count will\r\nbe used to construct the DNS resolution thread pool.\r\n\r\nBesides, added two new SSL related metrics using the API from Netty:\r\npending_ssl_handshake_count\r\ntotal_failed_ssl_handshake_count","shortMessageHtmlLink":"[router] Added config to enable DNS resolution before SSL (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270264928\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/970\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/970/hovercard\" href=\"https://github.com/linkedin/venice/pull/970\">#970</a>)"}},{"before":"b2301acfe2fd4cd6694cc38f296c0807810cf76a","after":"05836eb93d11343c77514008005fe954408c9dbd","ref":"refs/heads/main","pushedAt":"2024-05-01T17:09:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"huangminchn","name":"Min Huang","path":"/huangminchn","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10958899?s=80&v=4"},"commit":{"message":"[router] Added config to enable DNS resolution before SSL (#970)\n\n* [router] Added config to enable DNS resolution before SSL\r\n\r\nConfig to enable this feature:\r\nrouter.resolve.before.ssl\r\n\r\nWhen this config is enabled, \"SslInitializer#enableSslTaskExecutor\"\r\nwill not be called, and the SSL handshake thread pool count will\r\nbe used to construct the DNS resolution thread pool.\r\n\r\nBesides, added two new SSL related metrics using the API from Netty:\r\npending_ssl_handshake_count\r\ntotal_failed_ssl_handshake_count","shortMessageHtmlLink":"[router] Added config to enable DNS resolution before SSL (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270264928\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/970\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/970/hovercard\" href=\"https://github.com/linkedin/venice/pull/970\">#970</a>)"}},{"before":"b2301acfe2fd4cd6694cc38f296c0807810cf76a","after":"164aca2d8c95fcd0cff7ddc52e6119e60ac13e33","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T00:43:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@b2301acfe2fd4cd6694cc38f296c0807810cf76a 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/b2301acfe2fd4cd6694cc38f296c0807810cf76a/hovercard\" href=\"https://github.com/linkedin/venice/commit/b2301acfe2fd4cd6694cc38f296c0807810cf76a\"><tt>b2301ac</tt></a> 🚀"}},{"before":"abc1271fc056250eeee3a370b85f74372467df77","after":"b2301acfe2fd4cd6694cc38f296c0807810cf76a","ref":"refs/heads/javadoc","pushedAt":"2024-05-01T00:42:42.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[admin-tool] Fixed mishandling of get store response in store migration (#968)\n\nStore migration's end migration command assumes /store returns null for non-existing store. However,\r\nit actually throws exception instead and is not handled properly which causes confusion for the user.","shortMessageHtmlLink":"[admin-tool] Fixed mishandling of get store response in store migrati…"}},{"before":"eade77a2e5b37115b81f20f50d48701209dc8bb6","after":"b2301acfe2fd4cd6694cc38f296c0807810cf76a","ref":"refs/heads/main","pushedAt":"2024-05-01T00:42:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"xunyin8","name":"Xun Yin","path":"/xunyin8","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7265832?s=80&v=4"},"commit":{"message":"[admin-tool] Fixed mishandling of get store response in store migration (#968)\n\nStore migration's end migration command assumes /store returns null for non-existing store. However,\r\nit actually throws exception instead and is not handled properly which causes confusion for the user.","shortMessageHtmlLink":"[admin-tool] Fixed mishandling of get store response in store migrati…"}},{"before":"eade77a2e5b37115b81f20f50d48701209dc8bb6","after":"abc1271fc056250eeee3a370b85f74372467df77","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T22:35:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@eade77a2e5b37115b81f20f50d48701209dc8bb6 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/eade77a2e5b37115b81f20f50d48701209dc8bb6/hovercard\" href=\"https://github.com/linkedin/venice/commit/eade77a2e5b37115b81f20f50d48701209dc8bb6\"><tt>eade77a</tt></a> 🚀"}},{"before":"9296ce4bd93cde8b2fdbca43d11bcb4c837a9984","after":"eade77a2e5b37115b81f20f50d48701209dc8bb6","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T22:34:12.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[changelog] Let bootstrapping changelog consumer consumes after-image (#966)\n\nMake bootstrapping consumer also consume after-image data from version topic, instead of before-after image data from cc topic. Fixed a few small bugs during the journey, and clean up the integration tests.\r\nBugs:\r\n\r\nseekToChekpoint needs to be blocked by get(), otherwise consumer will jump to non-deterministic offsets and yield wrong results.\r\nwhen persisting after-image values to local storage, we should extra bytes from ByteBuffer, instead of converting to array directly.","shortMessageHtmlLink":"[changelog] Let bootstrapping changelog consumer consumes after-image (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2266550826\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/966\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/966/hovercard\" href=\"https://github.com/linkedin/venice/pull/966\">…</a>"}},{"before":"1bd3b092db163307888c2f5ebc62add9a12f00d0","after":"eade77a2e5b37115b81f20f50d48701209dc8bb6","ref":"refs/heads/main","pushedAt":"2024-04-30T22:33:52.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"sixpluszero","name":"Jialin Liu","path":"/sixpluszero","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8380335?s=80&v=4"},"commit":{"message":"[changelog] Let bootstrapping changelog consumer consumes after-image (#966)\n\nMake bootstrapping consumer also consume after-image data from version topic, instead of before-after image data from cc topic. Fixed a few small bugs during the journey, and clean up the integration tests.\r\nBugs:\r\n\r\nseekToChekpoint needs to be blocked by get(), otherwise consumer will jump to non-deterministic offsets and yield wrong results.\r\nwhen persisting after-image values to local storage, we should extra bytes from ByteBuffer, instead of converting to array directly.","shortMessageHtmlLink":"[changelog] Let bootstrapping changelog consumer consumes after-image (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2266550826\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/966\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/966/hovercard\" href=\"https://github.com/linkedin/venice/pull/966\">…</a>"}},{"before":"1bd3b092db163307888c2f5ebc62add9a12f00d0","after":"9296ce4bd93cde8b2fdbca43d11bcb4c837a9984","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T19:01:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@1bd3b092db163307888c2f5ebc62add9a12f00d0 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/1bd3b092db163307888c2f5ebc62add9a12f00d0/hovercard\" href=\"https://github.com/linkedin/venice/commit/1bd3b092db163307888c2f5ebc62add9a12f00d0\"><tt>1bd3b09</tt></a> 🚀"}},{"before":"8a7e1bd8dea9ca5429073d0f61db54278e8114b7","after":"1bd3b092db163307888c2f5ebc62add9a12f00d0","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T19:00:37.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[vpj] Skip closing the SparkSession and let it be closed at app shutdown (#972)\n\nIn \"AbstractDataWriterSparkJob\", we need a \"SparkSession\" and to get one, we use \"SparkSession.Builder()...getOrCreate()\". This either provides an existing \"SparkSession\", or creates a new one if one doesn't exist already. \"SparkContext\" has a \"ShutdownHook\" that closes the session at the end of the JVM. When VPJ is executed via \"spark-submit\", it executes in the Spark driver. In this case, we do not wish to close the \"SparkSession\" and instead let the \"ShutdownHook\" take care of it. This is also okay for client-mode of Spark execution as those can be expected to be short lived. If someone needs a way to explicitly close a \"SparkSession\", we can add a new function that helps achieve that. We don't have such a need right now.","shortMessageHtmlLink":"[vpj] Skip closing the SparkSession and let it be closed at app shutd…"}},{"before":"da82ba86433d0959cfba02b7d65c98009d4baefe","after":"1bd3b092db163307888c2f5ebc62add9a12f00d0","ref":"refs/heads/main","pushedAt":"2024-04-30T19:00:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nisargthakkar","name":"Nisarg Thakkar","path":"/nisargthakkar","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2492915?s=80&v=4"},"commit":{"message":"[vpj] Skip closing the SparkSession and let it be closed at app shutdown (#972)\n\nIn \"AbstractDataWriterSparkJob\", we need a \"SparkSession\" and to get one, we use \"SparkSession.Builder()...getOrCreate()\". This either provides an existing \"SparkSession\", or creates a new one if one doesn't exist already. \"SparkContext\" has a \"ShutdownHook\" that closes the session at the end of the JVM. When VPJ is executed via \"spark-submit\", it executes in the Spark driver. In this case, we do not wish to close the \"SparkSession\" and instead let the \"ShutdownHook\" take care of it. This is also okay for client-mode of Spark execution as those can be expected to be short lived. If someone needs a way to explicitly close a \"SparkSession\", we can add a new function that helps achieve that. We don't have such a need right now.","shortMessageHtmlLink":"[vpj] Skip closing the SparkSession and let it be closed at app shutd…"}},{"before":"da82ba86433d0959cfba02b7d65c98009d4baefe","after":"8a7e1bd8dea9ca5429073d0f61db54278e8114b7","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T18:13:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@da82ba86433d0959cfba02b7d65c98009d4baefe 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/da82ba86433d0959cfba02b7d65c98009d4baefe/hovercard\" href=\"https://github.com/linkedin/venice/commit/da82ba86433d0959cfba02b7d65c98009d4baefe\"><tt>da82ba8</tt></a> 🚀"}},{"before":"37eea04b6831c38e7e7114b9c50e391868abef75","after":"da82ba86433d0959cfba02b7d65c98009d4baefe","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T18:11:43.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[vpj] Fix building or fetching dictionary for repush jobs (#971)\n\nRecently, we refactored some code around compression metric collection and using mapper to build dictionary. This refactoring had a bug where the dictionary building for repush jobs was skipped and if VPJ sends control messages directly, then the push would fail, as the \"START_OF_PUSH\" would not have any dictionary. This change fixes the issue and reenables a dictionary to be built for KIF repush as well.","shortMessageHtmlLink":"[vpj] Fix building or fetching dictionary for repush jobs (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270328876\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/971\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/971/hovercard\" href=\"https://github.com/linkedin/venice/pull/971\">#971</a>)"}},{"before":"ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967","after":"da82ba86433d0959cfba02b7d65c98009d4baefe","ref":"refs/heads/main","pushedAt":"2024-04-30T18:11:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nisargthakkar","name":"Nisarg Thakkar","path":"/nisargthakkar","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2492915?s=80&v=4"},"commit":{"message":"[vpj] Fix building or fetching dictionary for repush jobs (#971)\n\nRecently, we refactored some code around compression metric collection and using mapper to build dictionary. This refactoring had a bug where the dictionary building for repush jobs was skipped and if VPJ sends control messages directly, then the push would fail, as the \"START_OF_PUSH\" would not have any dictionary. This change fixes the issue and reenables a dictionary to be built for KIF repush as well.","shortMessageHtmlLink":"[vpj] Fix building or fetching dictionary for repush jobs (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270328876\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/971\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/971/hovercard\" href=\"https://github.com/linkedin/venice/pull/971\">#971</a>)"}},{"before":"ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967","after":"37eea04b6831c38e7e7114b9c50e391868abef75","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T17:53:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967/hovercard\" href=\"https://github.com/linkedin/venice/commit/ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967\"><tt>ddd1b1e</tt></a> 🚀"}},{"before":"120a811d5c1f1fa354f58536dd913b3a93e74eb8","after":"ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967","ref":"refs/heads/javadoc","pushedAt":"2024-04-30T17:50:46.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[server] - Fix consumer leaks in TM that occur when the thread owning consumer is interrupted (#967)\n\nCurrently, if a thread owning a consumer is interrupted, the consumer is not \r\nreturned to the consumer pool. This occurs because the blocking calls throw an \r\ninterrupted exception when invoked by a thread with the interrupt status set. \r\nIn this case, it is the `LBQ::put` call in `TMDF::releaseConsumer`.\r\n\r\nAs a result, we eventually run out of consumers to execute metadata requests. \r\nThis situation typically arises when non-blocking metrics collection threads \r\ncancel active executions to terminate slow queries.","shortMessageHtmlLink":"[server] - Fix consumer leaks in TM that occur when the thread owning…"}},{"before":"d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082","after":"ddd1b1e5f8ee7a65483d8fbd8cd43e7804cfa967","ref":"refs/heads/main","pushedAt":"2024-04-30T17:50:27.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"sushantmane","name":"Sushant Mane","path":"/sushantmane","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7715725?s=80&v=4"},"commit":{"message":"[server] - Fix consumer leaks in TM that occur when the thread owning consumer is interrupted (#967)\n\nCurrently, if a thread owning a consumer is interrupted, the consumer is not \r\nreturned to the consumer pool. This occurs because the blocking calls throw an \r\ninterrupted exception when invoked by a thread with the interrupt status set. \r\nIn this case, it is the `LBQ::put` call in `TMDF::releaseConsumer`.\r\n\r\nAs a result, we eventually run out of consumers to execute metadata requests. \r\nThis situation typically arises when non-blocking metrics collection threads \r\ncancel active executions to terminate slow queries.","shortMessageHtmlLink":"[server] - Fix consumer leaks in TM that occur when the thread owning…"}},{"before":"d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082","after":"120a811d5c1f1fa354f58536dd913b3a93e74eb8","ref":"refs/heads/javadoc","pushedAt":"2024-04-29T23:11:51.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to javadoc from @ linkedin/venice@d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082 🚀","shortMessageHtmlLink":"Deploying to javadoc from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/linkedin/venice/commit/d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082/hovercard\" href=\"https://github.com/linkedin/venice/commit/d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082\"><tt>d2ddd1c</tt></a> 🚀"}},{"before":"7e094467b2e70fdf9eb1203bc6037ae115d34a9d","after":"d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082","ref":"refs/heads/javadoc","pushedAt":"2024-04-29T23:09:54.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"[vpj] Do not mark overall status COMPLETE till all region finishes (#969)\n\nThe overall status should not be updated to COMPLETE till all the region are pushed when target region push is enabled.\r\n\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[vpj] Do not mark overall status COMPLETE till all region finishes (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270090318\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/969\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/969/hovercard\" href=\"https://github.com/linkedin/venice/pull/969\">#969</a>"}},{"before":"ba9a6a7a02b782de241fb6a23c59a3e437c226c2","after":"d2ddd1c9a6ef7e8f7dea6980ae3b0cad71946082","ref":"refs/heads/main","pushedAt":"2024-04-29T23:09:37.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"majisourav99","name":"Sourav Maji","path":"/majisourav99","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/62683561?s=80&v=4"},"commit":{"message":"[vpj] Do not mark overall status COMPLETE till all region finishes (#969)\n\nThe overall status should not be updated to COMPLETE till all the region are pushed when target region push is enabled.\r\n\r\n\r\nCo-authored-by: Sourav Maji <tester@linkedin.com>","shortMessageHtmlLink":"[vpj] Do not mark overall status COMPLETE till all region finishes (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270090318\" data-permission-text=\"Title is private\" data-url=\"https://github.com/linkedin/venice/issues/969\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/linkedin/venice/pull/969/hovercard\" href=\"https://github.com/linkedin/venice/pull/969\">#969</a>"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEPzx0OQA","startCursor":null,"endCursor":null}},"title":"Activity · linkedin/venice"}