Skip to content

1.9.1

Choose a tag to compare

@snowflake-connectors-app snowflake-connectors-app released this 18 Jul 22:09
e7f04a0

1.9.1

Bug Fixes

  • Registry: Fix a bug when trying to set the PAD token the HuggingFace text-generation model had multiple EOS tokens.
    The handler picks the first EOS token as PAD token now.

New Features

  • DataConnector: DataConnector objects can now be pickled
  • Dataset: Dataset objects can now be pickled
  • Registry (PrPr): Introducing create_service function in snowflake/ml/model/models/huggingface_pipeline.py
    which creates a service to log a HF model and upon successful logging, an inference service is created.
from snowflake.ml.model.models import huggingface_pipeline

hf_model_ref = huggingface_pipeline.HuggingFacePipelineModel(
  model="gpt2",
  task="text-generation", # Optional
)


hf_model_ref.create_service(
    session=session,
    service_name="test_service",
    service_compute_pool="test_compute_pool",
    image_repo="test_repo",
    ...
)
  • Experiment Tracking (PrPr): New module for managing and tracking ML experiments in Snowflake.
from snowflake.ml.experiment import ExperimentTracking

exp = ExperimentTracking(session=sp_session, database_name="ML", schema_name="PUBLIC")

exp.set_experiment("MY_EXPERIMENT")

with exp.start_run():
  exp.log_param("batch_size", 32)
  exp.log_metrics("accuracy", 0.98, step=10)
  exp.log_model(my_model, model_name="MY_MODEL")
  • Registry: Added support for wide input (500+ features) for inference done using SPCS