Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update: readme for bedrock finetuning manifest added #233

Merged
merged 1 commit into from
Aug 30, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions manifests/bedrock-finetuning-sfn/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# Amazon Bedrock Finetuning

## Description

The manifest `manifests/bedrock-finetuning-sfn/deployment.yaml` deploys a finetuning job for Amazon Bedrock.

The module creates a finetuning job for Amazon Bedrock model of choice. Finetuning is triggered by dropping new file into created S3 Bucket. This triggers step function execution that using Lambda invokes the finetuning job and provides all the necessary parameters. You can expand this solution by adding more steps to the step function or by adding other modules. The manifest uses networking module to create the resources inside a VPC.

### Architecture

![Bedrock Finetuning Architecture](docs/BedrockManifestArch.jpg "Bedrock Finetuning Architecture")


## Deployment

For deployment instructions, please refer to [DEPLOYMENT.MD](https://github.com/awslabs/aiops-modules/blob/main/DEPLOYMENT.md).

## User Guide

### Running Finetuning Job

Below are the steps to run the Finetuning Job. The steps assume you have deployed the manifest

1. Upload Training Data to an S3 Bucket. Make sure the data is ina format accepted by the specified model.

2. The S3 Put event will trigger the finetuning job in Bedrock. You can verify if the job started in Bedrock Console.
3. After the job completes you can use fine-tuned model in your application.


Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading