Docs for starcoder2 (#524)

README.md

@@ -115,6 +115,7 @@ https://github.com/EricLBuehler/mistral.rs/assets/65165915/09d9a30f-1e22-4b9a-90
 |Phi 3 Vision|✅| |✅| |
 |Idefics 2|✅| |✅| |
 |Gemma 2|✅|✅|✅|✅|
+|Starcoder 2|✅|✅|✅|✅|
 
 ## APIs and Integrations
 
@@ -345,6 +346,7 @@ Additionally, for models without quantization, the model architecture should be
 - `phi3`
 - `qwen2`
 - `gemma2`
+- `starcoder2`
 
 ### Architecture for vision models
 
@@ -438,6 +440,7 @@ Example:
 |Phi 3 Vision| | |✅|
 |Idefics 2| | |✅|
 |Gemma 2| | |✅|
+|Starcoder 2| | |✅|
 
 **Device mapping support**
 |Model category|Supported|
@@ -460,6 +463,7 @@ Example:
 |Phi 3 Vision| | | |
 |Idefics 2| | | |
 |Gemma 2|✅| | |
+|Starcoder 2|✅| | |
 
 **AnyMoE support**
 |Model|AnyMoE|
@@ -474,6 +478,7 @@ Example:
 |Phi 3 Vision| |
 |Idefics 2| |
 |Gemma 2|✅|
+|Starcoder 2|✅|
 
 
 ### Using derivative model

mistralrs-pyo3/API.md

@@ -22,6 +22,7 @@ Additionally, for models without quantization, the model architecture should be
 - `Phi3`
 - `Qwen2`
 - `Gemma2`
+- `Starcoder2`
 
 ### Architecture for vision models
 - `Phi3V`

mistralrs-pyo3/src/which.rs

@@ -12,6 +12,7 @@ pub enum Architecture {
     Phi3,
     Qwen2,
     Gemma2,
+    Starcoder2,
 }
 
 impl From<Architecture> for NormalLoaderType {
@@ -25,6 +26,7 @@ impl From<Architecture> for NormalLoaderType {
             Architecture::Phi3 => Self::Phi3,
             Architecture::Qwen2 => Self::Qwen2,
             Architecture::Gemma2 => Self::Gemma2,
+            Architecture::Starcoder2 => Self::Starcoder2,
         }
     }
 }