{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":651154474,"defaultBranch":"main","name":"databricks-llm-fine-tuning","ownerLogin":"mshtelma","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-06-08T16:03:02.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/2151050?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1696890433.0","currentOid":""},"activityList":{"items":[{"before":"d1be21c8454e7d42906618c0caef03b627384d36","after":"719bf1899ebed902711b606ed392bc94320fc16e","ref":"refs/heads/main","pushedAt":"2023-10-12T07:48:46.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fsdp support (#10)\n\n* Prompt eng (#1)\r\n\r\n* adding intiial files\r\n\r\n* adding prompt and optimized inference files\r\n\r\n* correcting keys\r\n\r\n* changing prompt_utils directory\r\n\r\n* Added /dev/shm mounting for distributed training\r\n\r\n* Prompt eng (#2)\r\n\r\n* adding intiial files\r\n\r\n* adding prompt and optimized inference files\r\n\r\n* correcting keys\r\n\r\n* changing prompt_utils directory\r\n\r\n* prompt Engineering\r\n\r\n* adding changes\r\n\r\n* adding load_model\r\n\r\n* Added support for FSDP\r\n\r\n* Added support for FSDP\r\n\r\n* Added support for FSDP\r\n\r\n---------\r\n\r\nCo-authored-by: puneet-jain159 <101398142+puneet-jain159@users.noreply.github.com>","shortMessageHtmlLink":"Fsdp support (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1939411447\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/10\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/10/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/10\">#10</a>)"}},{"before":"aa99914d314b6dca0c3feed1414bfd2bb906b44f","after":"d1be21c8454e7d42906618c0caef03b627384d36","ref":"refs/heads/main","pushedAt":"2023-10-11T07:16:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"run_llm_training_datagen added (#4)\n\nAdded a utility for enabling easy generation of llm training data.","shortMessageHtmlLink":"run_llm_training_datagen added (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1865552833\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/4\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/4/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/4\">#4</a>)"}},{"before":"8c8e6e758245f05b213b0efe870ecac47ec51707","after":"b1e45ad12ccca3eba5efb43f5eb4821563ac449f","ref":"refs/heads/fsdp_support","pushedAt":"2023-10-10T13:00:50.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Added support for FSDP","shortMessageHtmlLink":"Added support for FSDP"}},{"before":null,"after":"8c8e6e758245f05b213b0efe870ecac47ec51707","ref":"refs/heads/fsdp_support","pushedAt":"2023-10-09T22:27:13.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Added support for FSDP","shortMessageHtmlLink":"Added support for FSDP"}},{"before":"a11d8cfd523112fa183ad44a17c3cd6c865623c9","after":"d0abc7ab2e0dbd2adc14790326adbecbad3dfd33","ref":"refs/heads/LLM_LCR_Morphir","pushedAt":"2023-10-09T11:53:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Generate test data for LCR rules","shortMessageHtmlLink":"Generate test data for LCR rules"}},{"before":"367936f30c66103223f403e3a480cba1a3a58bd2","after":"aa99914d314b6dca0c3feed1414bfd2bb906b44f","ref":"refs/heads/main","pushedAt":"2023-08-29T18:48:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Added /dev/shm mounting for distributed training","shortMessageHtmlLink":"Added /dev/shm mounting for distributed training"}},{"before":"b9330085b4a6a40c28b61bb6f0bae6a4456dfdfb","after":"367936f30c66103223f403e3a480cba1a3a58bd2","ref":"refs/heads/main","pushedAt":"2023-08-29T14:29:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Added /dev/shm mounting for distributed training","shortMessageHtmlLink":"Added /dev/shm mounting for distributed training"}},{"before":"6c4e931fd4dd53de0375f430282a6238a0650f68","after":"b9330085b4a6a40c28b61bb6f0bae6a4456dfdfb","ref":"refs/heads/main","pushedAt":"2023-08-29T12:25:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Improved logging to mlflow","shortMessageHtmlLink":"Improved logging to mlflow"}},{"before":"17a4b61376f46c4122338bf251d9e80083f7ebb6","after":"6c4e931fd4dd53de0375f430282a6238a0650f68","ref":"refs/heads/main","pushedAt":"2023-08-29T10:42:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Improved logging to mlflow","shortMessageHtmlLink":"Improved logging to mlflow"}},{"before":"cfb721654bf865b5df5d1333dfceaa088089d8fc","after":"17a4b61376f46c4122338bf251d9e80083f7ebb6","ref":"refs/heads/main","pushedAt":"2023-08-29T10:38:58.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Improved logging to mlflow","shortMessageHtmlLink":"Improved logging to mlflow"}},{"before":"75fcf0b50e54fdd4d6f0aa6b743b8bc11f4cfcae","after":"cfb721654bf865b5df5d1333dfceaa088089d8fc","ref":"refs/heads/main","pushedAt":"2023-08-29T10:27:47.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Improved logging to mlflow","shortMessageHtmlLink":"Improved logging to mlflow"}},{"before":"302731ff8a3b90ca9b6d04149528bed9dedef24b","after":"75fcf0b50e54fdd4d6f0aa6b743b8bc11f4cfcae","ref":"refs/heads/main","pushedAt":"2023-08-29T08:32:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"c59bdabf371bcab8c3ddaa0f7b246fb0f0c0e6c1","after":"302731ff8a3b90ca9b6d04149528bed9dedef24b","ref":"refs/heads/main","pushedAt":"2023-08-28T21:38:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"16ea80d441b47e97801c67696b1a9b0ae7cde5b8","after":"c59bdabf371bcab8c3ddaa0f7b246fb0f0c0e6c1","ref":"refs/heads/main","pushedAt":"2023-08-28T21:09:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"7ffbb171d7d0129ec54aaf571a8ec0d52b201b5a","after":"16ea80d441b47e97801c67696b1a9b0ae7cde5b8","ref":"refs/heads/main","pushedAt":"2023-08-28T21:06:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"5d2d750ef89c5802525261f50bf99fcbee62123e","after":"7ffbb171d7d0129ec54aaf571a8ec0d52b201b5a","ref":"refs/heads/main","pushedAt":"2023-08-28T21:04:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"6ccf51c2c5290c581eeabff479bd2ccae6e80954","after":"963c02d4b409fe736d894244c0560baf62dcc19c","ref":"refs/heads/mainold","pushedAt":"2023-08-28T20:56:52.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"test (#9)\n\n* Modularising\r\n\r\n* Added support for vector search\r\n\r\n* Added support for vector search\r\n\r\n* Added support for vector search\r\n\r\n* Support for Llama v2\r\n\r\n* Support for Llama v2\r\n\r\n* small changes\r\n\r\n* llama v2 13b\r\n\r\n* Support for Llama v2 - Added hyperparameters\r\n\r\n* small changes\r\n\r\n* fixes\r\n\r\n* formatting\r\n\r\n* Update README.md\r\n\r\n* formatting\r\n\r\n* small fixes\r\n\r\n* Support for saved_to_disk datasets\r\n\r\n* Initial commit: LCR ==> Domain Schema && Domain Schema ==> ELM\r\n\r\n* The Stack data prep\r\n\r\n* The Stack ABAP is working\r\n\r\n* Small changes\r\n\r\n* small update\r\n\r\n* Fixes & support for proper distributed fine tuning\r\n\r\n* Fixes & support for proper distributed fine tuning (#8)\r\n\r\n---------\r\n\r\nCo-authored-by: mshtelma <mshtelma>\r\nCo-authored-by: Anastasia Prokaieva <88480495+AnastasiaProkaieva@users.noreply.github.com>","shortMessageHtmlLink":"test (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1870491397\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/9\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/9/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/9\">#9</a>)"}},{"before":null,"after":"6ccf51c2c5290c581eeabff479bd2ccae6e80954","ref":"refs/heads/mainold","pushedAt":"2023-08-28T20:54:20.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Modularising","shortMessageHtmlLink":"Modularising"}},{"before":"549d5d30f5155fd9c88ade8d2d4d8eb0a7c98194","after":null,"ref":"refs/heads/fix","pushedAt":"2023-08-28T20:48:01.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"}},{"before":"cc65585ea6dedd6a34d57fd0f9e9c6f5bf94aa95","after":"5d2d750ef89c5802525261f50bf99fcbee62123e","ref":"refs/heads/main","pushedAt":"2023-08-28T20:47:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning (#8)","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1870479961\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/8\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/8/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/8\">#8</a>)"}},{"before":null,"after":"549d5d30f5155fd9c88ade8d2d4d8eb0a7c98194","ref":"refs/heads/fix","pushedAt":"2023-08-28T20:46:31.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"36460fa931c8a3f4cc7e1fe46c9451f1f256a086","after":null,"ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-28T20:41:34.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"}},{"before":"9c454977bf805ec3ebfc8a2df61aae4eab5e9a0a","after":"cc65585ea6dedd6a34d57fd0f9e9c6f5bf94aa95","ref":"refs/heads/main","pushedAt":"2023-08-28T20:41:24.000Z","pushType":"pr_merge","commitsCount":10,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Merge pull request #7 from mshtelma/DSS_Scaling_LLM_DL\n\nSupport for distributed training","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1870471854\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/7\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/7/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/7\">#7</a> from mshtelma/DSS_Scaling_LLM_DL"}},{"before":"8e640720a4c48cd53794b8df8ddb39db69481ad0","after":"36460fa931c8a3f4cc7e1fe46c9451f1f256a086","ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-28T20:39:51.000Z","pushType":"pr_merge","commitsCount":5,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Merge pull request #6 from mshtelma/main\n\nmerging upstream","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1870470001\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mshtelma/databricks-llm-fine-tuning/issues/6\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mshtelma/databricks-llm-fine-tuning/pull/6/hovercard\" href=\"https://github.com/mshtelma/databricks-llm-fine-tuning/pull/6\">#6</a> from mshtelma/main"}},{"before":"aa2860b64710acf2aecb2642a9513d4db10b31e2","after":"8e640720a4c48cd53794b8df8ddb39db69481ad0","ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-28T07:24:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Fixes & support for proper distributed fine tuning","shortMessageHtmlLink":"Fixes &amp; support for proper distributed fine tuning"}},{"before":"ad80547d2c08c1ee2d8b0ed018f207c14f049a7f","after":"aa2860b64710acf2aecb2642a9513d4db10b31e2","ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-27T17:42:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"small update","shortMessageHtmlLink":"small update"}},{"before":"42ce8eb1eee5e914f0d80096931d821f6cb5df8a","after":"ad80547d2c08c1ee2d8b0ed018f207c14f049a7f","ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-24T07:53:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"Small changes","shortMessageHtmlLink":"Small changes"}},{"before":null,"after":"42ce8eb1eee5e914f0d80096931d821f6cb5df8a","ref":"refs/heads/DSS_Scaling_LLM_DL","pushedAt":"2023-08-21T21:51:44.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"The Stack ABAP is working","shortMessageHtmlLink":"The Stack ABAP is working"}},{"before":"522f96e3dec06f89fdb90f2b04728b098a10af16","after":"42ce8eb1eee5e914f0d80096931d821f6cb5df8a","ref":"refs/heads/CG_ABAP","pushedAt":"2023-08-17T12:32:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"The Stack ABAP is working","shortMessageHtmlLink":"The Stack ABAP is working"}},{"before":"a11d8cfd523112fa183ad44a17c3cd6c865623c9","after":"522f96e3dec06f89fdb90f2b04728b098a10af16","ref":"refs/heads/CG_ABAP","pushedAt":"2023-08-17T11:18:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mshtelma","name":"Michael Shtelma","path":"/mshtelma","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2151050?s=80&v=4"},"commit":{"message":"The Stack data prep","shortMessageHtmlLink":"The Stack data prep"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAADlUkxEAA","startCursor":null,"endCursor":null}},"title":"Activity · mshtelma/databricks-llm-fine-tuning"}