Skip to content

Commit

Permalink
Update Readme.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mobicham committed Nov 20, 2023
1 parent bfac35c commit b1fe770
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions code/Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -85,8 +85,8 @@ We provide a comple example to quantize ViT models that you can find in the ```v
### Quantize Custom Models 🗜️
If you want to quantize your own model architecture, you need to write a patching function that goes through all the linear layers and replaces them with ```HQQLinear```. You can follow the examples provided in ```hqq/models```.

### Models from Hugging Face Hub 🤗
We provide pre-quantized LLama2 models that you can directly use from [Hugging Face Hub](https://huggingface.co/mobiuslabsgmbh):
### Models from HuggingFace Hub 🤗
We provide pre-quantized LLama2 models that you can directly use from [HuggingFace Hub](https://huggingface.co/mobiuslabsgmbh):

Here's an example:
```Python
Expand Down

0 comments on commit b1fe770

Please sign in to comment.