[Bug] WARNING: Parameter temperature does not exist for Bedrock

[austinmw]

Hi,

I noticed that generation.py does the following in several places:

with llm_params(llm, temperature=self.config.lowest_temperature):

However it seems that for temperature to be passed to bedrock it would need to be:

with llm_params(llm, model_kwargs={'temperature': self.config.lowest_temperature}):

I'm not sure of the cleanest way to make it compatible with both, but just wanted to alert you to this issue. Thanks!

[rgstephens]

I think this is related:

models:
  - type: main
    engine: deepinfra
    model: mistralai/Mixtral-8x7B-Instruct-v0.1
    parameters:
      model_kwargs:
        temperature: 0.5

Results in: Parameter temperature does not exist for DeepInfra

But, temperature is required for DeepInfra and results in the following error if not provided: Parameter temperature does not exist for DeepInfra

[drazvan]

We should be able to do some inspection of the pydantic model to figure out the right way to pass it. Let me record this tentatively for 0.10.0.