Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge PEFT feature branch #11240

Merged
merged 8 commits into from Feb 29, 2024
Expand Up @@ -4,7 +4,20 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"## Serving LLMs with MLflow: Leveraging Custom PyFunc\n",
"## Serving LLMs with MLflow: Leveraging Custom PyFunc"
]
},
{
"cell_type": "raw",
"metadata": {},
"source": [
"<a href=\"https://raw.githubusercontent.com/mlflow/mlflow/master/docs/source/llms/custom-pyfunc-for-llms/notebooks/custom-pyfunc-advanced-llm.ipynb\" class=\"notebook-download-btn\">Download this Notebook</a>"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"### Introduction\n",
"\n",
Expand Down
313 changes: 257 additions & 56 deletions docs/source/llms/transformers/guide/index.rst

Large diffs are not rendered by default.

162 changes: 63 additions & 99 deletions docs/source/llms/transformers/index.rst

Large diffs are not rendered by default.

Expand Up @@ -6,8 +6,20 @@
"source": [
"## Introduction to MLflow and OpenAI's Whisper\n",
"\n",
"Discover the integration of [OpenAI's Whisper](https://huggingface.co/openai), an [ASR system](https://en.wikipedia.org/wiki/Speech_recognition), with MLflow in this tutorial.\n",
"\n",
"Discover the integration of [OpenAI's Whisper](https://huggingface.co/openai), an [ASR system](https://en.wikipedia.org/wiki/Speech_recognition), with MLflow in this tutorial.\n"
]
},
{
"cell_type": "raw",
"metadata": {},
"source": [
"<a href=\"https://raw.githubusercontent.com/mlflow/mlflow/master/docs/source/llms/transformers/tutorials/audio-transcription/whisper.ipynb\" class=\"notebook-download-btn\">Download this Notebook</a>"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### What You Will Learn in This Tutorial\n",
"\n",
"- Establish an audio transcription **pipeline** using the Whisper model.\n",
Expand Down Expand Up @@ -333,6 +345,10 @@
" signature=signature,\n",
" input_example=audio,\n",
" model_config=model_config,\n",
" # Since MLflow 2.11.0, you can save the model in 'reference-only' mode to reduce storage usage by not saving\n",
" # the base model weights but only the reference to the HuggingFace model hub. To enable this, uncomment the\n",
" # following line:\n",
" # save_pretrained=False,\n",
" )"
]
},
Expand Down
Expand Up @@ -6,7 +6,20 @@
"source": [
"## Introduction to Conversational AI with MLflow and DialoGPT\n",
"\n",
"Welcome to our tutorial on integrating [Microsoft's DialoGPT](https://huggingface.co/microsoft/DialoGPT-medium) with MLflow's transformers flavor to explore conversational AI.\n",
"Welcome to our tutorial on integrating [Microsoft's DialoGPT](https://huggingface.co/microsoft/DialoGPT-medium) with MLflow's transformers flavor to explore conversational AI."
]
},
{
"cell_type": "raw",
"metadata": {},
"source": [
"<a href=\"https://raw.githubusercontent.com/mlflow/mlflow/master/docs/source/llms/transformers/tutorials/conversational/conversational-model.ipynb\" class=\"notebook-download-btn\">Download this Notebook</a>"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"### Learning Objectives\n",
"\n",
Expand Down
Expand Up @@ -6,8 +6,20 @@
"source": [
"## Fine-Tuning Transformers with MLflow for Enhanced Model Management\n",
"\n",
"Welcome to our in-depth tutorial on fine-tuning Transformers models with enhanced management using MLflow.\n",
"\n",
"Welcome to our in-depth tutorial on fine-tuning Transformers models with enhanced management using MLflow."
]
},
{
"cell_type": "raw",
"metadata": {},
"source": [
"<a href=\"https://raw.githubusercontent.com/mlflow/mlflow/master/docs/source/llms/transformers/tutorials/fine-tuning/transformers-fine-tuning.ipynb\" class=\"notebook-download-btn\">Download the Fine Tuning Notebook</a>"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### What You Will Learn in This Tutorial\n",
"\n",
"- Understand the process of fine-tuning a Transformers model.\n",
Expand Down