Add tutorial for Llama-3-8B lora training and deployment

[shashank3959]

• Adds a notebook for Llama-3-8b LoRA PEFT with NeMo FW
• Adds a notebook for sending multi-LoRA inference request to NVIDIA NIM
• Adds README that includes instructions fore context and set up

[shashank3959]

@chrisalexiuk-nvidia @vinhngx could you please review?

[chrisalexiuk-nvidia]

There's some formatting mismatch here for the Fig Text.

[shashank3959]

Adding @nealvaidya for any review comments covering the NIM part

[chrisalexiuk-nvidia]

First notebook workin' like a charm.

[nealvaidya]

Few things, mostly in readme. NIM notebook looks good

[jgerh]

Deploy Multiple LoRA Inference Adapters with NVIDIA NIM <./llama3-lora-deploy-nim.ipynb>`__

Comment on edits: Remove the number, update the title to an imperative verb, and change this step to a Heading 2 by adding ---------------------- under the revised title.

[jgerh]

This procedure demonstrates how to deploy multiple LoRA adapters with NVIDIA . . .

[jgerh]

You will deploy the PubMedQA LoRA adapter
from the first notebook, alongside two previously trained LoRA adapters
(GSM8K <https://github.com/openai/grade-school-math>,
SQuAD <https://rajpurkar.github.io/SQuAD-explorer/>) that are
available on NVIDIA NGC as examples.

[jgerh]

.. note::
Although it’s not necessary that you complete the LoRA training and secure the adapter from the preceding notebook (“Creating a LoRA adapter with NeMo Framework”) to proceed with this one, it is advisable. Regardless, you can continue to learn about LoRA deployment with NIM using other adapters that you’ve downloaded from NVIDIA NGC.

[jgerh]

1. Download the example LoRA adapters.

Comment on edits: Changes this step to a sentence and remove the Heading 3 tag ^^^^^^^^^^^^^^^^^^

[jgerh]

The following steps assume that you have authenticated with NGC and downloaded the CLI tool, as listed in the Requirements section.

[jgerh]

2. Prepare the LoRA model store.

Comment on edits: Changes this step to a sentence and remove the Heading 3 tag ^^^^^^^^^^^^^^^^^^

[jgerh]

3. Set Up NIM.

Comment on edits: Changes this step to a sentence and remove the Heading 3 tag ^^^^^^^^^^^^^^^^^^

[jgerh]

There are several options to configure NIM other than the ones listed above. You can find a full list in NIM configuration documentation.

[jgerh]

4. Start the notebook.

Comment on edits: Changes this step to a sentence and remove the Heading 3 tag ^^^^^^^^^^^^^^^^^^

[jgerh]

You can use the same NeMo

[jgerh]

Completed review of ReadMe.rst

[jgerh]

Llama 3 LoRA Fine-Tuning and Deployment with NeMo Framework and NVIDIA NIM

Comment on edits: Missed this change. Title should be capitalized.

[shashank3959]

Updated

[jgerh]

I missed one change. Title should be capitalized: Llama 3 LoRA Fine-Tuning and Deployment with NeMo Framework and NVIDIA NIM

[jgerh]

Approved comments

[oyilmaz-nvidia]

Approving based on other reviews.