[example] add LoRA support

[haofanwang]

This PR is motivated by train_text_to_image_lora.py. ColossalAI framework can further optimize the training.

[github-actions]

Your pre-commit check failed, follow the steps to run pre-commit on your file for code style consistency.

1. install pre-commit via "pip install pre-commit"
2. install pre-commit hooks via "pre-commit install"
3. run pre-commit on file with format error via "pre-commit run --files path" by replacing "path" with the actual file path
4. commit and push to your branch

View your job at https://github.com/hpcaitech/ColossalAI/actions/runs/4215016352.
Read our "CONTRIBUTING.md" for more reference to the code style.

[Fazziekey]

Thanks a lot for your PR, LoRA is an amazing tech to finetune model

[Fazziekey]

@haofanwang can you run pip install pre-commit && pre-commit install to fix your code style and pass our ci? Here is the contributed guide: https://github.com/hpcaitech/ColossalAI/blob/main/CONTRIBUTING.md

[haofanwang]

@Fazziekey Done.

[Fazziekey]

@haofanwang Thanks a lot for your Pull request, it is really amazing