You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CodeGen/README.md
+6-2Lines changed: 6 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -30,7 +30,7 @@ Currently we support two ways of deploying ChatQnA services with docker compose:
30
30
docker pull opea/codegen:latest
31
31
```
32
32
33
-
2. Start services using the docker images `built from source`: [Guide](./docker)
33
+
2. Start services using the docker images built from source. See the [Gaudi Guide](./docker/gaudi/README.md) or [Xeon Guide](./docker/xeon/README.md) for more information.
34
34
35
35
### Setup Environment Variable
36
36
@@ -55,6 +55,10 @@ To set up environment variables for deploying ChatQnA services, follow these ste
55
55
56
56
3. Set up other environment variables:
57
57
58
+
> Note: By default, the [`docker/set_env.sh`](docker/set_env.sh) file will configure your environment
59
+
> variables to use [meta-llama/CodeLlama-7b-hf](https://huggingface.co/meta-llama/CodeLlama-7b-hf). This
60
+
> is a gated model that requires submitting an access request through Hugging Face.
61
+
58
62
```bash
59
63
source ./docker/set_env.sh
60
64
```
@@ -70,7 +74,7 @@ cd GenAIExamples/CodeGen/docker/gaudi
70
74
docker compose up -d
71
75
```
72
76
73
-
> Notice: Currently only the **Habana Driver 1.16.xi** is supported for Gaudi.
77
+
> Notice: Currently only the **Habana Driver 1.16.x** is supported for Gaudi.
74
78
75
79
Refer to the [Gaudi Guide](./docker/gaudi/README.md) to build docker images from source.
0 commit comments