Initial design

[simonw]

Initially this tool will let you run things against ChatGPT and GPT-4 from the command-line.

Over time I want to introduce Pluggy plugins to allow you to hook it up to all sorts of other language models, including ones that run locally.

But for starters it will do this:

llm "Prompt goes here"

And a streaming variant:

llm "Ten ideas for cheesecakes" -s

Plus use -4 to run against GPT-4, or --model X to specify another model.

[simonw]

Need to solve API keys. I'm going to look for the OPENAI_API_KEY environment variable, but I'll also have it read from ~/.openai-api-key.txt if that's present because that's my own personal preference.

[simonw]

I need to rename to llm-cli - the PyPI llm name is not allowed:

https://github.com/simonw/llm-cli/actions/runs/4585299987/jobs/8097362394

Uploading llm-0.1-py3-none-any.whl
25l
  0% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/12.7 kB • --:-- • ?
  0% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/12.7 kB • --:-- • ?
100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.7/12.7 kB • 00:00 • 37.0 MB/s
100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.7/12.7 kB • 00:00 • 37.0 MB/s
100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.7/12.7 kB • 00:00 • 37.0 MB/s
25hWARNING  Error during upload. Retry with the --verbose option for more details. 
ERROR    HTTPError: 400 Bad Request from https://upload.pypi.org/legacy/        
         The name 'llm' is too similar to an existing project. See              
         https://pypi.org/help/#project-name for more information.              
Error: Process completed with exit code 1.

[simonw]

llm-cli failed too.

Turns out they were detected as clashing with https://pypi.org/project/lim/ and https://pypi.org/project/lim-cli/ - thanks to this code:

https://github.com/pypi/warehouse/blob/9738ebb2ffcee91a935a6a11b224575aaf02a878/warehouse/migrations/versions/d18d443f89f0_ultranormalize_name_function.py#L29-L42

[simonw]

Dustin Ingram helped me out on PyPI Slack - I have llm now: https://thepsf.slack.com/archives/C09FGMHD1/p1680385756056109

https://pypi.org/project/llm/