{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":349495657,"defaultBranch":"master","name":"hudi","ownerLogin":"suryaprasanna","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2021-03-19T16:58:45.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/20996567?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1720590518.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"7c2dc1d616944a7e24693e7710005c52fc446601","ref":"refs/heads/empty-ingestion-commit-with-metadata","pushedAt":"2024-07-10T05:48:38.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Provide an API to create empty commit\n\nSummary: By creating empty commit, checkpoints from the commit files can be transferred to new instants. So, this change is used to create emptyCommit by copying the extrametadata from the last completed non-table service commit in the timeline. Generally, empty commits are created max one instant per day per dataset, the cadence to transfer metadata can be configured that way bloating of the commit timeline can be avoided. whenever there is no new data to be written.","shortMessageHtmlLink":"Provide an API to create empty commit"}},{"before":null,"after":"2fc956794c1effc3dbd09b665eac1266503f407f","ref":"refs/heads/empty-clean-ingestion-commits","pushedAt":"2024-07-10T04:07:25.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Fix empty clean commit logic and make it configurable\n\nSummary: This change fixes empty clean commit logic and also makes it configurable.","shortMessageHtmlLink":"Fix empty clean commit logic and make it configurable"}},{"before":"d9eb7b469bf112a0185729ec1ca98f22632755d0","after":"4b52e27eb3eb8e607e24a62e5ff672c67d72b020","ref":"refs/heads/master","pushedAt":"2024-07-05T23:17:25.000Z","pushType":"push","commitsCount":148,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7954] Fix data skipping with secondary index when there are no log files (#11575)","shortMessageHtmlLink":"[HUDI-7954] Fix data skipping with secondary index when there are no …"}},{"before":"913c320e4a5e46b59b06b38821813b270349a918","after":"d9eb7b469bf112a0185729ec1ca98f22632755d0","ref":"refs/heads/master","pushedAt":"2024-05-14T09:02:08.000Z","pushType":"push","commitsCount":136,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7535] Add metrics for sourceParallelism and Refresh profile in S3/GCS (#10918)\n\nCo-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>","shortMessageHtmlLink":"[HUDI-7535] Add metrics for sourceParallelism and Refresh profile in …"}},{"before":"398c9a23c84a54aecfea8e6c7948f198785710c5","after":"913c320e4a5e46b59b06b38821813b270349a918","ref":"refs/heads/master","pushedAt":"2024-04-10T20:00:52.000Z","pushType":"push","commitsCount":16,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[MINOR] Fix BUG: HoodieLogFormatWriter: unable to close output stream for log file HoodieLogFile{xxx} (#10989)\n\n* due to java.lang.IllegalStateException: Shutdown in progress, cause:\r\n    when `org.apache.hudi.common.table.log.HoodieLogFormatWriter.close` tries to `removeShutdownHook`, hooks were already removed by JVM when triggered (hooks == null)","shortMessageHtmlLink":"[MINOR] Fix BUG: HoodieLogFormatWriter: unable to close output stream…"}},{"before":"314969b1a7d2e5e24f099829d2b5e5b0c5b99893","after":"b5ef634c3490ffa6703d17f6056badc9faa672e9","ref":"refs/heads/rollback-unittest","pushedAt":"2024-04-10T19:45:51.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Support replacecommit rollback as part of rollbackFailedWrites","shortMessageHtmlLink":"Support replacecommit rollback as part of rollbackFailedWrites"}},{"before":"482a8cccc2ec6e7ecc675cf9e446f79b0849f808","after":"314969b1a7d2e5e24f099829d2b5e5b0c5b99893","ref":"refs/heads/rollback-unittest","pushedAt":"2024-04-05T05:06:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Removed duplicate unit test","shortMessageHtmlLink":"Removed duplicate unit test"}},{"before":"9b372b24121c5a6ecb3765f2d9cbe2bf70528e26","after":"482a8cccc2ec6e7ecc675cf9e446f79b0849f808","ref":"refs/heads/rollback-unittest","pushedAt":"2024-04-05T05:02:00.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Include rollback of clustering commit as part of auto rollback mechanism","shortMessageHtmlLink":"Include rollback of clustering commit as part of auto rollback mechanism"}},{"before":"d749457f9d5efcef3f7abff4765e6da50afca412","after":"398c9a23c84a54aecfea8e6c7948f198785710c5","ref":"refs/heads/master","pushedAt":"2024-04-05T00:37:37.000Z","pushType":"push","commitsCount":17,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7564] Revert hive sync inconsistency and reason for it (#10959)","shortMessageHtmlLink":"[HUDI-7564] Revert hive sync inconsistency and reason for it (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2222640246\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/10959\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/10959/hovercard\" href=\"https://github.com/apache/hudi/pull/10959\">apache#…</a>"}},{"before":"784af0e17867f249159d4b6040568f3139f91545","after":"d749457f9d5efcef3f7abff4765e6da50afca412","ref":"refs/heads/master","pushedAt":"2024-03-25T15:56:47.000Z","pushType":"push","commitsCount":9,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7513] Add jackson-module-scala to spark bundle (#10877)","shortMessageHtmlLink":"[HUDI-7513] Add jackson-module-scala to spark bundle (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2191350051\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/10877\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/10877/hovercard\" href=\"https://github.com/apache/hudi/pull/10877\">apache#10877</a>)"}},{"before":"e726306cf0905512e3afe4b875cb15dfbef40e52","after":"784af0e17867f249159d4b6040568f3139f91545","ref":"refs/heads/master","pushedAt":"2024-03-19T18:29:08.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7514] Update Manifest file after the parquet writer closed in LSMTimelineWriter (#10883)","shortMessageHtmlLink":"[HUDI-7514] Update Manifest file after the parquet writer closed in L…"}},{"before":"81cddbb77c2e555c044956d57e0b393f59c95ecc","after":"e726306cf0905512e3afe4b875cb15dfbef40e52","ref":"refs/heads/master","pushedAt":"2024-03-16T02:02:22.000Z","pushType":"push","commitsCount":118,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7466] Add parallel listing of existing partitions in Glue Catalog sync (#10460)\n\n* Add parallel listing of existing partitions\r\n\r\n* Improve with new approach\r\n\r\n* Fix checkstyle\r\n\r\n* Fix listing for empty list of commits\r\n\r\n* Fix logic for HiveSyncTool\r\n\r\n* Fix lint errors\r\n\r\n* Fix IT\r\n\r\n* Use custom thread names\r\n\r\n* Address review comments\r\n\r\n---------\r\n\r\nCo-authored-by: vmakarevich <vitali.makarevich@instructure.com>","shortMessageHtmlLink":"[HUDI-7466] Add parallel listing of existing partitions in Glue Catal…"}},{"before":null,"after":"9b372b24121c5a6ecb3765f2d9cbe2bf70528e26","ref":"refs/heads/rollback-unittest","pushedAt":"2024-02-11T03:28:40.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Create rollback unittest","shortMessageHtmlLink":"Create rollback unittest"}},{"before":"c5573ab34b28cb9bdc2ee4875d2cb6c14e27fe62","after":"81cddbb77c2e555c044956d57e0b393f59c95ecc","ref":"refs/heads/master","pushedAt":"2024-02-11T03:27:38.000Z","pushType":"push","commitsCount":21,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6902] Containerize the Azure CI (#10512)\n\n* [HUDI-6902] Containerize the Azure tests\r\n\r\n* remove warning message","shortMessageHtmlLink":"[HUDI-6902] Containerize the Azure CI (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2085122904\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/10512\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/10512/hovercard\" href=\"https://github.com/apache/hudi/pull/10512\">apache#10512</a>)"}},{"before":"624cab734d5f904ab0341039ffb9ef6e39f0f37a","after":"c5573ab34b28cb9bdc2ee4875d2cb6c14e27fe62","ref":"refs/heads/master","pushedAt":"2024-02-01T00:15:47.000Z","pushType":"push","commitsCount":27,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7344] Use Java <Input/Output>Stream instead of FSData<Input/Output>Stream when possible (#10573)","shortMessageHtmlLink":"[HUDI-7344] Use Java &lt;Input/Output&gt;Stream instead of FSData&lt;Input/Out…"}},{"before":"854e0b5e3b8c4058aeb84586a427e82db23cc559","after":null,"ref":"refs/heads/syalla_pw_one_index_at_a_time","pushedAt":"2024-01-22T08:17:58.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"}},{"before":"b30678e5d37b724f02d731c8e14a5127db221086","after":null,"ref":"refs/heads/syalla_pw_record_index_implementation","pushedAt":"2024-01-22T08:17:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"}},{"before":"84a4eb0d6948d2b73d5c9636a411af74b4769eb2","after":null,"ref":"refs/heads/test_branch","pushedAt":"2024-01-22T08:17:31.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"}},{"before":"33955de1fa567359c558b39785a5f168311bf64c","after":null,"ref":"refs/heads/HUDI-3545","pushedAt":"2024-01-22T05:55:03.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"}},{"before":"68e703e3a4987a1d9ec6e20fae0ad7436f77bd3c","after":"624cab734d5f904ab0341039ffb9ef6e39f0f37a","ref":"refs/heads/master","pushedAt":"2024-01-22T00:16:17.000Z","pushType":"push","commitsCount":19,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7315] Disable constructing NOT filter predicate when pushing down its wrapped filter unsupported, as its operand's primitive value is incomparable (#10537)","shortMessageHtmlLink":"[HUDI-7315] Disable constructing NOT filter predicate when pushing do…"}},{"before":"473cf9a8284fa9e59d1509ae1d5b1a43afc7ea7b","after":"68e703e3a4987a1d9ec6e20fae0ad7436f77bd3c","ref":"refs/heads/master","pushedAt":"2024-01-16T23:20:11.000Z","pushType":"push","commitsCount":113,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[MINOR] Handle parsing of all zero timestamps with MDT suffixes. (#10481)","shortMessageHtmlLink":"[MINOR] Handle parsing of all zero timestamps with MDT suffixes. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2075387516\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/10481\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/10481/hovercard\" href=\"https://github.com/apache/hudi/pull/10481\">apa…</a>"}},{"before":"cf01b475b8e938949de634be54e520bb9b6c0635","after":"473cf9a8284fa9e59d1509ae1d5b1a43afc7ea7b","ref":"refs/heads/master","pushedAt":"2023-11-29T18:51:43.000Z","pushType":"push","commitsCount":119,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-7138] Fix error table writer and schema registry provider (#10173)\n\n\r\n---------\r\n\r\nCo-authored-by: rmahindra123 <rmahindra@Rajeshs-MacBook-Pro.local>","shortMessageHtmlLink":"[HUDI-7138] Fix error table writer and schema registry provider (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2010567668\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/10173\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/10173/hovercard\" href=\"https://github.com/apache/hudi/pull/10173\">apac…</a>"}},{"before":"c9c7c1019f5ca903ad3782f79370663f5ae26cb9","after":"cf01b475b8e938949de634be54e520bb9b6c0635","ref":"refs/heads/master","pushedAt":"2023-11-07T03:14:03.000Z","pushType":"push","commitsCount":43,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[MINOR] Hotfix in HdfsParquetImportProcedure for format parameter is not need to add (#9993)","shortMessageHtmlLink":"[MINOR] Hotfix in HdfsParquetImportProcedure for format parameter is …"}},{"before":"8e434b816dc81dd6902699ac972ef83f0d307b02","after":"c9c7c1019f5ca903ad3782f79370663f5ae26cb9","ref":"refs/heads/master","pushedAt":"2023-10-21T05:41:00.000Z","pushType":"push","commitsCount":31,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6952] Skip reading the uncommitted log files for log reader (#9879)\n\nThis is to avoid potential exceptions when the reader is processing an uncommitted log file while the\r\ncleaning or rollback service removes the log file.","shortMessageHtmlLink":"[HUDI-6952] Skip reading the uncommitted log files for log reader (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1948709634\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/9879\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/9879/hovercard\" href=\"https://github.com/apache/hudi/pull/9879\">ap…</a>"}},{"before":"6ed0fca1520b9b6be9d98b7a03177a58ca799296","after":"8e434b816dc81dd6902699ac972ef83f0d307b02","ref":"refs/heads/master","pushedAt":"2023-10-10T00:30:22.000Z","pushType":"push","commitsCount":254,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6832]  Ensure other table services with correct path are not affected by table with wrong path. (#9652)","shortMessageHtmlLink":"[HUDI-6832] Ensure other table services with correct path are not aff…"}},{"before":null,"after":"84a4eb0d6948d2b73d5c9636a411af74b4769eb2","ref":"refs/heads/test_branch","pushedAt":"2023-07-20T21:39:07.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Test","shortMessageHtmlLink":"Test"}},{"before":"e039dd7caff3178eab2b07eba7d7c8cf4069b2fd","after":"6ed0fca1520b9b6be9d98b7a03177a58ca799296","ref":"refs/heads/master","pushedAt":"2023-07-20T21:37:40.000Z","pushType":"push","commitsCount":13,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6501] HoodieHeartbeatClient should stop all heartbeats and not delete heartbeat files for close (#9160)","shortMessageHtmlLink":"[HUDI-6501] HoodieHeartbeatClient should stop all heartbeats and not …"}},{"before":"e039dd7caff3178eab2b07eba7d7c8cf4069b2fd","after":"6ed0fca1520b9b6be9d98b7a03177a58ca799296","ref":"refs/heads/master","pushedAt":"2023-07-20T21:37:39.939Z","pushType":"push","commitsCount":13,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6501] HoodieHeartbeatClient should stop all heartbeats and not delete heartbeat files for close (#9160)","shortMessageHtmlLink":"[HUDI-6501] HoodieHeartbeatClient should stop all heartbeats and not …"}},{"before":"0964e4bc4aeb82ba6230920736c3d432bfdb5d59","after":"d8073e7e042d879324f45f26f00d9d059c1e5d0a","ref":"refs/heads/incremental-file-sync-bug-fix","pushedAt":"2023-07-16T18:52:43.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"Address review comments","shortMessageHtmlLink":"Address review comments"}},{"before":"37d3d8ef504794d64fb87c838bf58bafa8acaa16","after":"e039dd7caff3178eab2b07eba7d7c8cf4069b2fd","ref":"refs/heads/master","pushedAt":"2023-07-16T18:39:36.863Z","pushType":"push","commitsCount":5,"pusher":{"login":"suryaprasanna","name":"Surya Prasanna","path":"/suryaprasanna","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20996567?s=80&v=4"},"commit":{"message":"[HUDI-6478] Simplifying INSERT_INTO configs for spark-sql (#9123)","shortMessageHtmlLink":"[HUDI-6478] Simplifying INSERT_INTO configs for spark-sql (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1788661465\" data-permission-text=\"Title is private\" data-url=\"https://github.com/apache/hudi/issues/9123\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/apache/hudi/pull/9123/hovercard\" href=\"https://github.com/apache/hudi/pull/9123\">apache#9123</a>)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEe11h1gA","startCursor":null,"endCursor":null}},"title":"Activity · suryaprasanna/hudi"}