Skip to content

Conversation

@harrisonyhq
Copy link
Collaborator

Purpose

Originlly, when you want to launch inference by ucm, you need to configure lots of params in command line, which is not friendly for usage. Now we support launch from config yaml, meanwhile, still support the original launch style.

Modifications

Users can launch from yaml config file. for more details please refer to documents.

Test

No need test.

@harrisonyhq harrisonyhq force-pushed the dev-ucm-v1 branch 2 times, most recently from 56750f0 to 19f0c3e Compare November 20, 2025 09:32
@ygwpz ygwpz merged commit 310a596 into ModelEngine-Group:dev-ucm-v1 Nov 20, 2025
3 checks passed
ygwpz pushed a commit that referenced this pull request Nov 22, 2025
* [Feat] Support launch from config file

* [Docs] Update documents for launch with yaml

* [Fix] Change load only on first rank into configuration

* [Feat] Add support for hit ratio in yaml

* [Fix] Fix load only first rank in non mla scene
flesher0813 pushed a commit to flesher0813/unified-cache-management that referenced this pull request Nov 26, 2025
* [Feat] Support launch from config file

* [Docs] Update documents for launch with yaml

* [Fix] Change load only on first rank into configuration

* [Feat] Add support for hit ratio in yaml

* [Fix] Fix load only first rank in non mla scene
flesher0813 pushed a commit to flesher0813/unified-cache-management that referenced this pull request Nov 28, 2025
* [Feat] Support launch from config file

* [Docs] Update documents for launch with yaml

* [Fix] Change load only on first rank into configuration

* [Feat] Add support for hit ratio in yaml

* [Fix] Fix load only first rank in non mla scene
qyh111 pushed a commit to qyh111/unified-cache-management that referenced this pull request Nov 28, 2025
* [Feat] Support launch from config file

* [Docs] Update documents for launch with yaml

* [Fix] Change load only on first rank into configuration

* [Feat] Add support for hit ratio in yaml

* [Fix] Fix load only first rank in non mla scene
Lijiachen1018 pushed a commit to Lijiachen1018/unified-cache-management that referenced this pull request Nov 29, 2025
* [Feat] Support launch from config file

* [Docs] Update documents for launch with yaml

* [Fix] Change load only on first rank into configuration

* [Feat] Add support for hit ratio in yaml

* [Fix] Fix load only first rank in non mla scene
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants