OpenAI Compatible API (together.xyz) gives status: 404 after upgrading mods.

[ezynda3]

I recently added together's OpenAI compatible API to my mods config

together:
    api-key:
    api-key-env: TOGETHER_API_KEY
    base-url: https://api.together.xyz/v1
    models:
      mistralai/Mixtral-8x7B-Instruct-v0.1:
        aliases: ["mixtral"]
        max-input-chars: 12250
        fallback:
      snorkelai/Snorkel-Mistral-PairRM-DPO:
        aliases: ["snorkel"]
        max-input-chars: 12250
        fallback:

It was working just fine until I upgraded mods to v1.2.1.

Now whenever I try to run one of those models e.g. mods -m mixtral hello I get the following error.

   ERROR  There was a problem with the together API request.

  error, status code: 400, message: %!s(<nil>)

[sedlund]

same.

e085c99 broke it. works in 2daa873

@caarlos0

togetherai api doesn't support a ResponseFormat so commenting this out:

mods/mods.go

Lines 402 to 404 in e085c99

	ResponseFormat: &openai.ChatCompletionResponseFormat{
	Type: responseType(cfg),
	},

resolves.

It is omitempty

https://github.com/sashabaranov/go-openai/blob/6d9c3a6365643d02692ecc6f0b34a5fa3e7fea45/chat.go#L94

[caarlos0]

can you try #213?

[sedlund]

can you try #213?

works for me! thanks.