[AINode] Decoupling inference manager into request_manager, pool_manager#16131

Merged

CRZbulabula merged 6 commits intoapache:masterfrom

yunbow30944:decoupling_inference_manager

Aug 19, 2025

Commits on Aug 18, 2025

Add state of request pools and basic load balance
Liu Zhengyun
committed
Decoupling inference manager with pool manager and request manager
Liu Zhengyun
committed
simplify the structure and fix some mistakes
Liu Zhengyun
committed
fix some mistakes
Liu Zhengyun
committed
add a exception

CRZbulabula
authored and
Liu Zhengyun
committed
Rename some modules
Liu Zhengyun
committed