Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document System Requirements #26

Open
jcuenod opened this issue Mar 13, 2023 · 3 comments
Open

Document System Requirements #26

jcuenod opened this issue Mar 13, 2023 · 3 comments

Comments

@jcuenod
Copy link

jcuenod commented Mar 13, 2023

Firstly, this looks super helpful, thank you :)

Given my limited compute (only a relatively dated CPU), could you document system requirements.

  • How much RAM is necessary? How much is recommended?
  • Is there a minimum CPU requirement (or architecture/GPU...)? (I assume this could work on x86, what about aarch64?)
  • At the minimum specs, what sort of speed token generation is to be expected?

Even a simple list of tokens per second on various metal configurations would be helpful. Thanks!

@lrvl
Copy link

lrvl commented Mar 13, 2023

Related, you also need the following requirements pre-installed

  • gcc
  • g++
  • pip
  • make
  • npm install node-gyp

@sylvain-reynaud
Copy link

I have personally successfully tested this solution for Fedora :
npm install -g node-gyp
sudo dnf install make automake gcc gcc-c++ kernel-devel (= build-essential for ubuntu)

@MentalGear
Copy link

Requirements would be great, maybe just put your token/sec speed with your reference system in the readme.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants