Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Broadcast token results throughout the network #24

Closed
AlexCheema opened this issue Jul 17, 2024 · 1 comment
Closed

Broadcast token results throughout the network #24

AlexCheema opened this issue Jul 17, 2024 · 1 comment

Comments

@AlexCheema
Copy link
Contributor

AlexCheema commented Jul 17, 2024 •
edited
Loading

Because of exo's architecture, currently only tail nodes support the ChatGPT API endpoint. This is frustrating for users (see e.g. #23) because the tail node changes dynamically (unless you force a node-id but this is non obvious). This would also be more in line with exo's node equality philosophy.

We already support receiving requests to generate from any node. We can support the ChatGPT API endpoint from any node as long as we support retrieving the response. This should be fairly straightforward - we just need to propagate results.

  • ✅ Initially, we will just support broadcasting the final response to degree 1 neighbours
AlexCheema added a commit that referenced this issue Jul 17, 2024
@AlexCheema
support chatgpt api endpoint fron any node #24
8a35fd8
@AlexCheema AlexCheema changed the title Add an option to broadcast token results throughout the network Broadcast token results throughout the network Jul 17, 2024
This was referenced Jul 17, 2024
Open
Closed
@AlexCheema
Copy link
Contributor Author

Made separate issues. This one is solved already.

@AlexCheema AlexCheema mentioned this issue Jul 23, 2024
Closed
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
support chatgpt api endpoint fron any node exo-explore#24
03aad2f
lipere123 pushed a commit to lipere123/exo that referenced this issue Oct 13, 2024
@risingsunomi
Merge pull request exo-explore#24 from risingsunomi/pr139-dev-oct24
b35224c 
Pr139 dev oct24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AlexCheema