Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@vansangpfiev
Copy link

No description provided.

@vansangpfiev vansangpfiev marked this pull request as ready for review August 5, 2024 03:24
@vansangpfiev vansangpfiev merged commit 3d5a0cc into feature/cicd-v0.11.0 Aug 5, 2024
vansangpfiev added a commit that referenced this pull request Aug 5, 2024
* Add Dockerfile for runner windows

* Add Dockerfile for linux

* Change CI agent

* fix: build linux (#70)

Co-authored-by: vansangpfiev <sang@jan.ai>

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: vansangpfiev <vansangpfiev@gmail.com>
Co-authored-by: vansangpfiev <sang@jan.ai>
vansangpfiev added a commit that referenced this pull request Aug 6, 2024
* TensorRT-LLM v0.10 update

* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <lokravi@amazon.com>
Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>

* TensorRT-LLM v0.11 Update (NVIDIA#1969)

* fix: add formatter

* fix: use executor API

* fix: sync

* fix: remove requests thread

* fix: support unload endpoint for server example, handle release resources properly

* refactor: InferenceState

* fix: new line character for Mistral and Openhermes

* fix: add benchmark script

* Add Dockerfile for runner windows (#69)

* Add Dockerfile for runner windows

* Add Dockerfile for linux

* Change CI agent

* fix: build linux (#70)

Co-authored-by: vansangpfiev <sang@jan.ai>

---------

Co-authored-by: Hien To <tominhhien97@gmail.com>
Co-authored-by: vansangpfiev <vansangpfiev@gmail.com>
Co-authored-by: vansangpfiev <sang@jan.ai>

* fix: default batch_size

* chore: only linux build

---------

Co-authored-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
Co-authored-by: Loki <lokravi@amazon.com>
Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>
Co-authored-by: sangjanai <sang@jan.ai>
Co-authored-by: hiento09 <136591877+hiento09@users.noreply.github.com>
Co-authored-by: Hien To <tominhhien97@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants