feat(rnd): add FastAPI support to existing project outline

[majdyz]

Background

Project Outline

Currently, the project mainly consists of these components:

agent_api
A component that will expose API endpoints for the creation & execution of agents.
This component will make connections to the database to persist and read the agents.
It will also trigger the agent execution by pushing its execution request to the ExecutionQueue.

agent_executor
A component that will execute the agents.
This component will be a pool of processes/threads that will consume the ExecutionQueue and execute the agent accordingly.
The result and progress of its execution will be persisted in the database.

How to test

Execute poetry run app.
Access the swagger page http://localhost:8000/docs, there is one API to trigger an execution of one dummy slow task, you fire the API a couple of times and see the agent_executor executes the multiple slow tasks concurrently by the pool of Python processes.
The pool size is currently set to 5 (hardcoded in app.py, the code entry point).

Changes 🏗️

• Initialize FastAPI for the AutoGPT server project.
• Reduced number of queues to 1 and abstracted into ExecutionQueue class.
• Reduced the number of main components into two api and executor.

PR Quality Scorecard ✨

• Have you used the PR description template?   +2 pts
• Is your pull request atomic, focusing on a single change?   +5 pts
• Have you linked the GitHub issue(s) that this PR addresses?   +5 pts
• Have you documented your changes clearly and comprehensively?   +5 pts
• Have you changed or added a feature?   -4 pts
  • Have you added/updated corresponding documentation?   +4 pts
  • Have you added/updated corresponding integration tests?   +5 pts
• Have you changed the behavior of AutoGPT?   -5 pts
  • Have you also run agbenchmark to verify that these changes do not regress performance?   +10 pts

[netlify]

✅ Deploy Preview for auto-gpt-docs ready!

Name	Link
🔨 Latest commit	9d880ca
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs/deploys/665d40c60d216200081a569a
😎 Deploy Preview	https://deploy-preview-7165--auto-gpt-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[Swiftyos]

Reduced the number of main components into two api and executor.

Why the change of heart in the need for the Manager?

I thought you where quiet certain of the need for it in our previous discussion. Is this now an exploration in a different direction?

[majdyz]

agent_executor is the manager, I'm happy to rename it with anything. It runs the pool of process/threads that will execute the agent. I started with thread, if you want to use process we can simply change ThreadExecutorPool into ProcessExecutorPool and everything still work fine because we are not sharing any variable except ExecutionQueue

[Swiftyos]

out of sync with update

out of sync with updates