Updating Docs

erfanzar · Dec 18, 2023 · 51a3fb3 · 51a3fb3
1 parent d4d644a
commit 51a3fb3
Show file tree

Hide file tree

Showing 4 changed files with 16 additions and 19 deletions.
diff --git a/docs/AvailableModels.md b/docs/AvailableModels.md
@@ -1,18 +1,21 @@
 # Available Models
 
-| Models          | FP16/FP32/BF16 | DP | FSDP | MP | FlashAttn | Gradient Checkpointing | 8/6/4Bit Interface and Training |
-|-----------------|:---------------|:---|------|----|-----------|------------------------|---------------------------------|
-| **_Llama_**     | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ✅                               |
-| **_Mistral_**   | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ✅                               |
-| **_Llama2_**    | ✅              | ✅  | ✅    | ✅  | ❌         | ✅                      | ✅                               |
-| **_GPT-J_**     | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ✅                               |
-| **_LT_**        | ✅              | ✅  | ✅    | ✅  | ❌         | ✅                      | ❌                               |
-| **_MosaicMPT_** | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ✅                               |
-| **_GPTNeoX-J_** | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ❌                               |
-| **_Falcon_**    | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | ✅                               |
-| **_Palm_**      | ✅              | ✅  | ✅    | ✅  | ✅         | ✅                      | 🌪️                             |
-| **_T5_**        | ✅              | ✅  | ✅    | ✅  | ❌         | ✅                      | 🌪️                             |
-| **_OPT_**       | ✅              | ✅  | ✅    | ✅  | ❌         | ✅                      | ❌                               |
+| Models          | FlashAttn | Gradient Checkpointing | 8/6/4Bit Interface and Training |
+|-----------------|:----------|------------------------|---------------------------------|
+| **_Llama_**     | ✅         | ✅                      | ✅                               |
+| **_Mistral_**   | ✅         | ✅                      | ✅                               |
+| **_Mixtral_**   | ✅         | ✅                      | ✅                               |
+| **_Llama2_**    | ❌         | ✅                      | ✅                               |
+| **_GPT-J_**     | ✅         | ✅                      | ✅                               |
+| **_GPT-2_**     | ❌         | ✅                      | ✅                               |
+| **_LT_**        | ❌         | ✅                      | ❌                               |
+| **_MosaicMPT_** | ✅         | ✅                      | ✅                               |
+| **_GPTNeoX-J_** | ✅         | ✅                      | ❌                               |
+| **_Falcon_**    | ✅         | ✅                      | ✅                               |
+| **_Palm_**      | ✅         | ✅                      | 🌪️                             |
+| **_T5_**        | ❌         | ✅                      | 🌪️                             |
+| **_OPT_**       | ❌         | ✅                      | ❌                               |
+| **_PHI_**       | ❌         | ❌                      | ✅                               |
 
 you can also tell me the model you want in Flax/Jax version and ill try my best to build it ;)
 

diff --git a/docs/lib-python-EasyDel-_rl_trainer-core.md b/docs/lib-python-EasyDel-_rl_trainer-core.md
diff --git a/docs/lib-python-EasyDel-_rl_trainer-models-modelling_base.md b/docs/lib-python-EasyDel-_rl_trainer-models-modelling_base.md
diff --git a/docs/lib-python-EasyDel-_rl_trainer-models-modelling_value_head.md b/docs/lib-python-EasyDel-_rl_trainer-models-modelling_value_head.md