Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add one line quickstart #1813

Closed
wants to merge 2 commits into from
Closed

feat: add one line quickstart #1813

wants to merge 2 commits into from

Conversation

drbh
Copy link
Collaborator

@drbh drbh commented Apr 26, 2024

This PR adds a simple quickstart file that conditionally installs docker and nvidia-container-toolkit before fetching the TGI docker container and running it with HuggingFaceH4/zephyr-7b-beta

It can be run with

bash quickstart.sh

additional TGI can be installed without cloning the repo

# using this branch
curl --proto '=https' --tlsv1.2 -sSf \
    https://raw.githubusercontent.com/huggingface/text-generation-inference/add-quickstart-script/quickstart.sh \
    | bash

# if merged
curl --proto '=https' --tlsv1.2 -sSf \
    https://raw.githubusercontent.com/huggingface/text-generation-inference/quickstart.sh \
    | bash

@drbh drbh marked this pull request as ready for review April 26, 2024 00:46
# Install Docker based on the OS
if [[ "$OSTYPE" == "linux-gnu"* ]]; then
# Ubuntu/Debian-based systems
sudo apt-get update && sudo apt-get install -y docker.io
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not nearly enough to support all the linux variants I'm afraid :)

@Narsil
Copy link
Collaborator

Narsil commented Apr 30, 2024

I don't think we should go that route, I feel like the pip install thing is more what some users might desire, not necessarily 1 liner to run docker (which is going to be annoying to maintain anyway)

@Narsil Narsil closed this Apr 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants