{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":285065983,"defaultBranch":"main","name":"backend","ownerLogin":"triton-inference-server","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2020-08-04T18:32:16.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/68086070?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726663796.0","currentOid":""},"activityList":{"items":[{"before":"8364bf4390f23de5097ef1f16db484ac19e795e9","after":null,"ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-09-18T12:49:56.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"}},{"before":null,"after":"ac03a5d97403dec841ad46d0439e93db12c9268f","ref":"refs/heads/r24.09","pushedAt":"2024-09-07T00:28:23.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pvijayakrish","name":"Pavithra Vijayakrishnan","path":"/pvijayakrish","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/160681768?s=80&v=4"},"commit":{"message":"doc: Add TRT-LLM backend to the doc (#102)\n\n* Add TRT-LLM backend to the doc\r\n\r\n* Add TRT-LLM backend to platform support matrix\r\n\r\n* Switch the order of vLLM and TRT-LLM","shortMessageHtmlLink":"doc: Add TRT-LLM backend to the doc (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2476657500\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/102\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/102/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/102\">#102</a>)"}},{"before":null,"after":"ac03a5d97403dec841ad46d0439e93db12c9268f","ref":"refs/heads/pvijayakrish-24.09-build","pushedAt":"2024-09-04T20:25:41.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pvijayakrish","name":"Pavithra Vijayakrishnan","path":"/pvijayakrish","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/160681768?s=80&v=4"},"commit":{"message":"doc: Add TRT-LLM backend to the doc (#102)\n\n* Add TRT-LLM backend to the doc\r\n\r\n* Add TRT-LLM backend to platform support matrix\r\n\r\n* Switch the order of vLLM and TRT-LLM","shortMessageHtmlLink":"doc: Add TRT-LLM backend to the doc (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2476657500\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/102\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/102/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/102\">#102</a>)"}},{"before":"73d39231ac3a04e297af98eea14908b30ae3f4a1","after":null,"ref":"refs/heads/krish-trtllm-user-guide","pushedAt":"2024-08-29T21:03:46.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"}},{"before":"30fa78aabe827e071c353dec3d4eabbcc115573a","after":"ac03a5d97403dec841ad46d0439e93db12c9268f","ref":"refs/heads/main","pushedAt":"2024-08-29T21:03:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"doc: Add TRT-LLM backend to the doc (#102)\n\n* Add TRT-LLM backend to the doc\r\n\r\n* Add TRT-LLM backend to platform support matrix\r\n\r\n* Switch the order of vLLM and TRT-LLM","shortMessageHtmlLink":"doc: Add TRT-LLM backend to the doc (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2476657500\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/102\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/102/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/102\">#102</a>)"}},{"before":"1d36963cfe8204a4186a56fc99f462d078fa30a6","after":"73d39231ac3a04e297af98eea14908b30ae3f4a1","ref":"refs/heads/krish-trtllm-user-guide","pushedAt":"2024-08-27T19:10:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"Switch the order of vLLM and TRT-LLM","shortMessageHtmlLink":"Switch the order of vLLM and TRT-LLM"}},{"before":null,"after":"30fa78aabe827e071c353dec3d4eabbcc115573a","ref":"refs/heads/r24.08","pushedAt":"2024-08-11T17:49:24.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"pvijayakrish","name":"Pavithra Vijayakrishnan","path":"/pvijayakrish","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/160681768?s=80&v=4"},"commit":{"message":"refactor: Refactor string input check (#101)\n\nRefactor string input tensor checks","shortMessageHtmlLink":"refactor: Refactor string input check (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2417565545\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/101\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/101/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/101\">#101</a>)"}},{"before":"e4a711ce234d156cb595d389a285fe49852bb095","after":"1d36963cfe8204a4186a56fc99f462d078fa30a6","ref":"refs/heads/krish-trtllm-user-guide","pushedAt":"2024-08-08T00:13:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"Add TRT-LLM backend to platform support matrix","shortMessageHtmlLink":"Add TRT-LLM backend to platform support matrix"}},{"before":null,"after":"e4a711ce234d156cb595d389a285fe49852bb095","ref":"refs/heads/krish-trtllm-user-guide","pushedAt":"2024-08-07T17:59:54.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"Add TRT-LLM backend to the doc","shortMessageHtmlLink":"Add TRT-LLM backend to the doc"}},{"before":"cb72fd5d0203a5cd374d2d1a459a020fe24c6f9f","after":"30fa78aabe827e071c353dec3d4eabbcc115573a","ref":"refs/heads/main","pushedAt":"2024-07-31T16:01:48.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"refactor: Refactor string input check (#101)\n\nRefactor string input tensor checks","shortMessageHtmlLink":"refactor: Refactor string input check (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2417565545\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/101\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/101/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/101\">#101</a>)"}},{"before":"5d6905d0c347f3ded8df0c6842c04a8847d97bd1","after":"8364bf4390f23de5097ef1f16db484ac19e795e9","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-30T22:40:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Update copyright","shortMessageHtmlLink":"Update copyright"}},{"before":"ea004a89ec7fdbc305e8e9f4da7f5f75e7ee50f8","after":"5d6905d0c347f3ded8df0c6842c04a8847d97bd1","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-28T21:16:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Minor updates","shortMessageHtmlLink":"Minor updates"}},{"before":"64be2465d423e81115e6d483ec552d52e30c6939","after":"ea004a89ec7fdbc305e8e9f4da7f5f75e7ee50f8","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-26T00:12:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Update backend_common.h","shortMessageHtmlLink":"Update backend_common.h"}},{"before":"9694903b3b592324e8580c809d84081e5b6541e6","after":"64be2465d423e81115e6d483ec552d52e30c6939","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-26T00:02:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Update include/triton/backend/backend_common.h\n\nCo-authored-by: Tanmay Verma <tanmay2592@gmail.com>","shortMessageHtmlLink":"Update include/triton/backend/backend_common.h"}},{"before":"d654e0b13c4044ceb5fe423d2f4ba30ff601d16e","after":"9694903b3b592324e8580c809d84081e5b6541e6","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-19T22:58:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Improve readability","shortMessageHtmlLink":"Improve readability"}},{"before":null,"after":"d654e0b13c4044ceb5fe423d2f4ba30ff601d16e","ref":"refs/heads/yinggeh-DLIS-6832-validate-gpu-string-tensors","pushedAt":"2024-07-18T23:17:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"yinggeh","name":"Yingge He","path":"/yinggeh","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/157551214?s=80&v=4"},"commit":{"message":"Refactor string input checks","shortMessageHtmlLink":"Refactor string input checks"}},{"before":null,"after":"ebb5900457361519e77d278a418f5128cf60fc3e","ref":"refs/heads/rmccormick-awq-flaky","pushedAt":"2024-07-12T22:56:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"},"commit":{"message":"Add debug statements to show underlying issue","shortMessageHtmlLink":"Add debug statements to show underlying issue"}},{"before":null,"after":"cb72fd5d0203a5cd374d2d1a459a020fe24c6f9f","ref":"refs/heads/r24.07","pushedAt":"2024-07-08T16:05:43.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"fpetrini15","name":"Francesco Petrini","path":"/fpetrini15","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/24305871?s=80&v=4"},"commit":{"message":"Add kCUDAExecutionAccelerator constant (#100)","shortMessageHtmlLink":"Add kCUDAExecutionAccelerator constant (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2337124254\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/100\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/100/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/100\">#100</a>)"}},{"before":null,"after":"cb72fd5d0203a5cd374d2d1a459a020fe24c6f9f","ref":"refs/heads/r24.06","pushedAt":"2024-06-08T00:59:24.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"mc-nv","name":"Misha Chornyi","path":"/mc-nv","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/99709299?s=80&v=4"},"commit":{"message":"Add kCUDAExecutionAccelerator constant (#100)","shortMessageHtmlLink":"Add kCUDAExecutionAccelerator constant (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2337124254\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/100\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/100/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/100\">#100</a>)"}},{"before":"25c41938a3d4b1bd9b6600d561ca003a9fcb07b9","after":"cb72fd5d0203a5cd374d2d1a459a020fe24c6f9f","ref":"refs/heads/main","pushedAt":"2024-06-06T23:34:59.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"Add kCUDAExecutionAccelerator constant (#100)","shortMessageHtmlLink":"Add kCUDAExecutionAccelerator constant (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2337124254\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/100\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/100/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/100\">#100</a>)"}},{"before":"0070e8fac69473a688b80c61b72ef75ff4b53a07","after":null,"ref":"refs/heads/rmccormick-fix-pinned-memory","pushedAt":"2024-06-06T23:28:28.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"}},{"before":"b5dab15553f787d0a336b237bb983077948091d1","after":"25c41938a3d4b1bd9b6600d561ca003a9fcb07b9","ref":"refs/heads/main","pushedAt":"2024-06-06T23:28:26.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"},"commit":{"message":"chore: Use log level ERROR when logging backend errors with LOG_IF_ERROR (#99)","shortMessageHtmlLink":"chore: Use log level ERROR when logging backend errors with LOG_IF_ER…"}},{"before":null,"after":"78225c56a28097f1b575879014f9f0118a2b5008","ref":"refs/heads/krish-ort-options","pushedAt":"2024-06-05T23:39:47.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"krishung5","name":"Kris Hung","path":"/krishung5","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43719498?s=80&v=4"},"commit":{"message":"Add kCUDAExecutionAccelerator constant","shortMessageHtmlLink":"Add kCUDAExecutionAccelerator constant"}},{"before":"3bc2017867371da777a0dc766bba58d935627a7d","after":"0070e8fac69473a688b80c61b72ef75ff4b53a07","ref":"refs/heads/rmccormick-fix-pinned-memory","pushedAt":"2024-06-05T23:19:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"},"commit":{"message":"Update copyrights","shortMessageHtmlLink":"Update copyrights"}},{"before":"fa754465eb3172f60bd3bbc89a008ec77b73cf99","after":"3bc2017867371da777a0dc766bba58d935627a7d","ref":"refs/heads/rmccormick-fix-pinned-memory","pushedAt":"2024-06-05T21:44:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"},"commit":{"message":"Add default TRITON_REPO_ORGANIZATION for standalone build","shortMessageHtmlLink":"Add default TRITON_REPO_ORGANIZATION for standalone build"}},{"before":null,"after":"fa754465eb3172f60bd3bbc89a008ec77b73cf99","ref":"refs/heads/rmccormick-fix-pinned-memory","pushedAt":"2024-06-05T19:54:18.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"rmccorm4","name":"Ryan McCormick","path":"/rmccorm4","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21284872?s=80&v=4"},"commit":{"message":"Use ERROR for LOG_IF_ERROR calls in backends","shortMessageHtmlLink":"Use ERROR for LOG_IF_ERROR calls in backends"}},{"before":"f9e9a15544b31b3b1b31973cc67d22b99037fb70","after":null,"ref":"refs/heads/imant-deprecated","pushedAt":"2024-05-28T20:04:39.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Tabrizian","name":"Iman Tabrizian","path":"/Tabrizian","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10105175?s=80&v=4"}},{"before":"9dfb76ba3dd69f68fb1f794bff6790129ad7f51e","after":"b5dab15553f787d0a336b237bb983077948091d1","ref":"refs/heads/main","pushedAt":"2024-05-28T20:04:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Tabrizian","name":"Iman Tabrizian","path":"/Tabrizian","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10105175?s=80&v=4"},"commit":{"message":"Remove deprecated use of find_package(CUDA) (#98)\n\n* Remove deprecated use of find_package(CUDA)\r\n\r\n* Fix CUDA architectures","shortMessageHtmlLink":"Remove deprecated use of find_package(CUDA) (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2311847934\" data-permission-text=\"Title is private\" data-url=\"https://github.com/triton-inference-server/backend/issues/98\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/triton-inference-server/backend/pull/98/hovercard\" href=\"https://github.com/triton-inference-server/backend/pull/98\">#98</a>)"}},{"before":"d0304699ba985ecbde218f54dbf5816c400046ba","after":"f9e9a15544b31b3b1b31973cc67d22b99037fb70","ref":"refs/heads/imant-deprecated","pushedAt":"2024-05-24T19:12:57.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"Tabrizian","name":"Iman Tabrizian","path":"/Tabrizian","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10105175?s=80&v=4"},"commit":{"message":"Fix CUDA architectures","shortMessageHtmlLink":"Fix CUDA architectures"}},{"before":"42c6e170380fa3630a872250292c920827083eeb","after":"d0304699ba985ecbde218f54dbf5816c400046ba","ref":"refs/heads/imant-deprecated","pushedAt":"2024-05-24T16:57:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Tabrizian","name":"Iman Tabrizian","path":"/Tabrizian","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10105175?s=80&v=4"},"commit":{"message":"Fix CUDA architectures","shortMessageHtmlLink":"Fix CUDA architectures"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xOFQxMjo0OTo1Ni4wMDAwMDBazwAAAAS5rgv7","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNS0yNFQxNjo1Nzo0MS4wMDAwMDBazwAAAARTP8XC"}},"title":"Activity · triton-inference-server/backend"}