1.9.1
Bug Fixes
- Registry: Fix a bug when trying to set the PAD token the HuggingFace
text-generation model had multiple EOS tokens.
The handler picks the first EOS token as PAD token now.
New Features
- DataConnector: DataConnector objects can now be pickled
- Dataset: Dataset objects can now be pickled
- Registry (PrPr): Introducing
create_service function in snowflake/ml/model/models/huggingface_pipeline.py
which creates a service to log a HF model and upon successful logging, an inference service is created.
from snowflake.ml.model.models import huggingface_pipeline
hf_model_ref = huggingface_pipeline.HuggingFacePipelineModel(
model="gpt2",
task="text-generation", # Optional
)
hf_model_ref.create_service(
session=session,
service_name="test_service",
service_compute_pool="test_compute_pool",
image_repo="test_repo",
...
)
- Experiment Tracking (PrPr): New module for managing and tracking ML experiments in Snowflake.
from snowflake.ml.experiment import ExperimentTracking
exp = ExperimentTracking(session=sp_session, database_name="ML", schema_name="PUBLIC")
exp.set_experiment("MY_EXPERIMENT")
with exp.start_run():
exp.log_param("batch_size", 32)
exp.log_metrics("accuracy", 0.98, step=10)
exp.log_model(my_model, model_name="MY_MODEL")
- Registry: Added support for wide input (500+ features) for inference done using SPCS