chatglm2-6b-sagemaker

Streaming enabled inferencing of ChatGLM2-6B on AWS SageMaker

Deployment

• chatglm2-6b-djl.ipynb is the notebook to prepare and deploy ChatGLM2-6B to AWS SageMaker
• lambda directory is the Lambda Function source code for accpeting API calls and invoking SageMaker inference endpoint