Miscellaneous

我在想如果有人力物力的话也许backend应该可以是一个在云上的server端，这样release也不会泄漏代码

Having a real backend would make many features more convenient. If deployed on cloud servers, which would prevent code leakage during publishing. Having a stable and user-friendly backend (including prompt caching, automatically adjusting requests per minute based on keys, and even batch API) might also be convenient for future research.

About parallel or queue execution. If all use remote backend server API keys, it would indeed involve queue issues, such as maximizing requests per minute on the server.

Batch API:

• https://www.anthropic.com/news/message-batches-api
• https://platform.openai.com/docs/guides/batch

跑server的话 （比如直接改成flask)后端代码也不会泄露

Currently, streaming isn't used, but it would be quite suitable for CoT/Scrachpad sections.

vscode UI上returned message/conversation要怎么放倒是个问题 progress bar应该可以做一个点击就expand的小窗口