Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updated readme to mention that this library needs ollama service to be running and also snippet to run it if someone is using a jupyter notebook #130

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Updated readme to mention that this library needs ollama service to be running and also snippet to run it if someone is using a jupyter notebook #130

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
17 changes: 17 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,23 @@ response = ollama.chat(model='llama2', messages=[
print(response['message']['content'])
```

### Note
To start using this library, you need to have ollama running on your system. If you are running ollama on a jupyter notebook, then you can use the below code to fix the "connection refused" error

```python
import os
import threading
import subprocess

def ollama():
os.environ['OLLAMA_HOST'] = '0.0.0.0:11434'
os.environ['OLLAMA_ORIGINS'] = '*'
subprocess.Popen(["ollama", "serve"])

ollama_thread = threading.Thread(target=ollama)
ollama_thread.start()
```

## Streaming responses

Response streaming can be enabled by setting `stream=True`, modifying function calls to return a Python generator where each part is an object in the stream.
Expand Down