-
Notifications
You must be signed in to change notification settings - Fork 147
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Suggest New Models #188
Comments
I checked, definitely a nice site, however the requests are sent through websockets which is a completely different protocol, but I will see what I can do. |
@aandrew-me Have you heard about Horde AI? They provide quite a lots of APIs, for free. There is also this public end point which works quite nicely: https://koboldai-koboldcpp-tiefighter.hf.space/api # API docs. |
Great, they even provided docs for their APIs, if everything works fine, I will surely add. |
I had found a great site - https://codeium.com/live/general |
The responses are a bit strange, these look like text excerpts from books.
|
Check out my links to free LLM APIs. |
I checked all of them |
Yes, kobold is like that, but its what I like about it, it was trained on novels rather than wikipedia articles or the such, Kobold is very much experimental, but its a great addition given that its API is public, its a better alternative to scrapping other sites I think |
I see, well its definitely unique. Expect it in the next update |
Okay, thank you for all the hard work! |
Here I leave the link to horde, a community based project, decentralized AI but with a centralized end point, the API documentation is there too, there are a few python clients based on it too for reference, https://stablehorde.net/ They offer a lot of models, each for a different purpose, to get an API key you only need to supply an OATH account. They also provide Image Generation models, Text Generation models and others |
This may not be fully on topic, but in terms of models has anyone had success using GPT-4 in tgpt? I get errors every time I try, but per my API key on OpenAI's website it is being successfully queried and the "last accessed" field updates to present day. I am trying the following without success: I either get errors about authentication, or when I get results and ask which model is being used the AI answers with some flavor of GPT 3. |
@calibers16 Are you using a free api key or a paid one? Gpt4 will only work with a paid one |
A paid API key (I have $5 in my account). I pay for GPT-4 as well. |
https://help.openai.com/en/articles/7102672-how-can-i-access-gpt-4
|
Those 5 dollars were already present, weren't they? |
When I first tried I think I had a dollar the account? I added $5 yesterday and created a new API key for CLI, which I can confirm is getting pinged but I'm not getting GPT-4 responses in tgpt. |
What are you getting then? |
Why do you think so? It just does not know it's name.
Answer from 3.5:
From 4:
|
Yes, GPT-4 always says its using GPT-3 |
It also makes sense to set not just generic BTW, |
Ahhhhhh, you guys are the best. I was assuming from my previous experience with ChatGPT's website that it would correctly identify itself. Thanks for the tip @johnd0e to utilize GPT-4 Turbo! |
I don't have much knowledge about this project, but I'm curious if it's possible to run models locally. I came across an interesting article on uncensored local models that discusses the ethics and necessity of having uncensored models. However, I believe it could also be a nice to have the possibility to run local models that are somewhat censored. Edit: The article also includes 4 models that are uncensored. |
This is what you're looking for - https://gpt4all.io |
What are the main differences between a project like gpt4all and this one? Thank you by the way for sending me that link, it looks quite interesting, I might give it a try. |
@Myrdincx This project doesn't use local models |
Fair enough, thank you for the quick responses. Ill make sure to check both projects out :) |
Hi @aandrew-me, I have seen 2 interesting api to generate images. Pollinators Does not require a key but shows watermarks on the images. https://image.pollinations.ai/prompt/{prompt} Prodia Requires key and does not have watermarks. |
GeminiProChat |
Why'd we want a useless AI? |
what? |
Haven't you seen the Gemini drama? Also, Gemini refuses to produce code, so for developing its not very useful. Neither for writing or generating images since its TOO biased. |
Weird, I wanted it to help me with Regex and it told me it would be "unethical" because of copyright, etc etc etc. |
I'm not a fan of Gemini, but making code does it. Now for 3 days you can edit and run code snippets directly in the Gemini UI. |
Did you think about providing support for Perplexity AI - perplexity.ai as a option ? It's free on the browser, uses ChatGPT 3.5 and might be a backup option but I don't know if it works via terminal. |
I had tried, but I couldn't. Probably because it uses websockets or because of cloudflare, cant exactly remember |
|
well, it doesn't use gemini-pro. very likely gpt-3.5 |
What makes you think so? |
hmmm... looks like google made gemini-pro API free for everyone (upto 60q/min & no privacy). we can make direct api call. curl -X POST "https://generativelanguage.googleapis.com/v1beta/models/gemini-1.0-pro:generateContent?key=${API_KEY}" -H 'Content-Type: application/json' -d '{"contents":[{"parts":[{"text":"what is the meaning of life?\n\n\n"}]}],"generationConfig":{"temperature":0.9,"topK":1,"topP":1,"maxOutputTokens":2048,"stopSequences":[]},"safetySettings":[{"category":"HARM_CATEGORY_HARASSMENT","threshold":"BLOCK_ONLY_HIGH"},{"category":"HARM_CATEGORY_HATE_SPEECH","threshold":"BLOCK_ONLY_HIGH"},{"category":"HARM_CATEGORY_SEXUALLY_EXPLICIT","threshold":"BLOCK_ONLY_HIGH"},{"category":"HARM_CATEGORY_DANGEROUS_CONTENT","threshold":"BLOCK_ONLY_HIGH"}]}'
|
@aandrew-me Sorry to bother, but could you add HuggingChat? It seems simple, and it works excellently, they provide lots of models and users can even make custom assitants, it'd be great if you provided support for it, since it can even do math, image generation and etc using the c4ai model. Also, support for adding "personalities"/"assistants" like these? https://hf.co/chat/assistant/65bead914b6dff9202988a88 |
No need to apologize, the whole purpose - of this issue is to propose new providers. I will try to add |
Here's a reversed API for HugginChat, sadly, its JS. But you can implement this in Go: https://github.com/erucix/Huggingface-API |
@xplshn I don't like the process of needing cookies. How long do they last? Also the site keeps throwing errors on random occasions |
That's weird, I use huggingchat regularly and it doesn't give me errors. You can also use HuggingChat without logging in, so I guess that could be exploited too? Their default model changes constantly (for the better), for now it is c4a, which is pretty good, its the first model to rival GPT-4o |
There are other APIs in GO that use the Email and Password too, if you dislike using cookies. And there's this library too for using the inference endpoints: |
I found that duckduckgo launched their "Chat" - there are gpt4omini, claude, llama and mixtral: |
@aandrew-me is there a plan to add gemini? it seems to work fine with free API_KEY |
I recently tried chat.lmsys.org. They have a lot of models. They are collecting large chat datasets for research purposes. You can try to integrate it if you can. You can even get in touch with the team as they need more users.
The text was updated successfully, but these errors were encountered: