v0.12.0
New features
- Support new instance types (e.g. g3 and g4 instances) #655 (deliahu)
- Support batched TensorFlow and ONNX predictions #666 #562 (vishalbollu)
- Allow users to configure availability zones #681 #677 (vishalbollu)
- Support multiple cortex clusters in the same region #661 #664 #660 (deliahu)
- Add AWS resource pricing to
cortex cluster up
confirmation message #647 #690 #641 (deliahu) - Autofill instance distribution based on spot price #670 #603 (vishalbollu)
- Add support for passing environment variables through to containers #694 #688 (vishalbollu)
Bug fixes
- Surface operator connection error messages in CLI #659 #658 (deliahu)
- Fix occasional logs stream errors #689 (vishalbollu)
- Install pip packages with --no-cache-dir #623 (vishalbollu)
Misc
- Convert predictor APIs into Python classes #636 #666 #589 (vishalbollu)
- Rename sample to payload in Python APIs #626 (vishalbollu)
- Confirm before deleting a deployment #692 #674 (vishalbollu)
- Check for unsupported instance types 952a1f7 (deliahu)
- Check user EC2 limits before spinning up instances #638 #653 #584 (vishalbollu, deliahu)
- Add
cortex cluster info --debug
command #691 #657 (deliahu) - Remove upper limit on CPU target utilization #635 (deliahu)
- Improve cortex deploy response message #650 #642 (deliahu)
- Improve API status output #656 #652 (deliahu)
- Improve spot config documentation #670 #627 (vishalbollu)
- Pre-download Docker images on cluster installation #662 #569 (deliahu)
- Remove
cortex support
command #683 #668 (vishalbollu) - Stream logs from all pods to CloudWatch #671 #586 (vishalbollu)
- Support running
cortex deploy
from subdirectories #675 #673 (deliahu) - Set log group and bucket name defaults to cluster name #693 #680 (vishalbollu)