1.25.0
1.25.0
New Features
-
ML Job: Added support for creating ML job definitions and launching jobs with different
arguments without re-uploading payloads. -
Inference Autocapture (PuPr): The
create_serviceAPI will now acceptautocaptureas a new argument to indicate
whether inference data will be captured. -
Model serving: Introduced the
min_instancesfield in themv.create_service()and
HuggingFacePipelineModel.log_model_and_create_service()APIs (defaulting to 0). The service now launches
with themin_instancesand automatically scales betweenmin_instancesandmax_instancesbased on
traffic and hardware utilization. Whenmin_instancesis set to 0, the service will automatically suspend
if no traffic is detected for a period of time.
Bug Fixes
Behavior Changes
-
Inference Autocapture (PuPr):
list_services()now showsautocapture_enabledcolumn to indicate if model
service has autocapture enabled. -
Model serving: The
mv.create_service()andHuggingFacePipelineModel.log_model_and_create_service()APIs now
include amin_instancesfield (defaulting to 0). When these APIs are called without specifyingmin_instances,
the system will now launch the service with 1 instance and enable auto scaling. This replaces the previous behavior,
wheremin_instanceswas automatically set to matchmax_instances, resulting in the immediate launch of the
maximum number of instances.