科大讯飞星火模型 API && API 重构

[hotip]

LLMProvider api 设计不太适合当前 LLM 模型需求。

/**
 * LLMProvider provide only session-free interfaces
 *
 * It's LLMProvider's responsibility to maintain the network connection
 * But the chat session is maintained by the client
 *
 * The implementations should provide a way to convert the response to a ChatSession
 */
abstract class LLMProvider<M : ChatMessage> {

    // observe response
    abstract val response: Flow<ChatSession<M>>
    // send request
    abstract fun textComplete(session: ChatSession<ChatMessage>)
    // send image request
    abstract fun imageGenerate(prompt: String): Flow<ChatSession<M>>
    // response json to ChatSession Data transformer
    protected abstract fun responseToChatSession(sendingSession: ChatSession<M>, responseBody: String): ChatSession<M>
}

https://gist.github.com/hotip/0514521ffee37c3b49cef52dbad96f16

[phodal]

能直接来个 PR 吗？我这里没有 API，没法测试。

需要修改：

1. 添加新的 AI Engine

auto-dev/src/main/kotlin/cc/unitmesh/devti/settings/Constants.kt

Line 4 in acae8ea

val AI_ENGINES = arrayOf("OpenAI", "Custom", "Azure")

2. 配置新的 provider:

auto-dev/src/main/kotlin/cc/unitmesh/devti/llms/LLMProviderFactory.kt

Lines 12 to 23 in acae8ea

	class LLMProviderFactory {
	private val aiEngine: String = AutoDevSettingsState.getInstance().aiEngine ?: DEFAULT_AI_ENGINE
	fun connector(project: Project): LLMProvider {
	return when (aiEngine) {
	"OpenAI" -> project.getService(OpenAIProvider::class.java)
	"Custom" -> project.getService(CustomLLMProvider::class.java)
	"Azure" -> project.getService(AzureOpenAIProvider::class.java)
	else -> project.getService(OpenAIProvider::class.java)
	}
	}
	}

不过，看他的代码，感觉还需要一个新的配置窗口才行？

[hotip]

是要添加新的配置项，有三个配置。
改动有点大，涉及到 data class，我晚点看看怎么加上去

[phodal]

可以把配置项列出来吗？我看要不要加一个新的配置页

[hotip]

都在这了

    data class AuthConfig(
        val appId: String,
        val apiKey: String,
        val apiSecret: String,
    )

[phodal]

666，那等你加完，我再看看会不会太长

[hotip]

可以考虑只出当前选中的模型的参数。并把输入也 sheme 化

[phodal]

嗯，嗯，方法挺好的

[hotip]

重构起 issue 吧