Azure API does not support functions in chat?

[Billijk]

Describe the bug

New functions parameter in ChatCompletion is not recognized when calling MS Azure endpoints. I got this error when I pass in my functions:

  File "call_chatgpt.py", line 52, in chatgpt
    chat_completion = openai.ChatCompletion.create(
  File "/root/anaconda3/lib/python3.8/site-packages/openai/api_resources/chat_completion.py", line 25, in create
    return super().create(*args, **kwargs)
  File "/root/anaconda3/lib/python3.8/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/root/anaconda3/lib/python3.8/site-packages/openai/api_requestor.py", line 298, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/root/anaconda3/lib/python3.8/site-packages/openai/api_requestor.py", line 700, in _interpret_response
    self._interpret_response_line(
  File "/root/anaconda3/lib/python3.8/site-packages/openai/api_requestor.py", line 763, in _interpret_response_line
    raise self.handle_error_response(
openai.error.InvalidRequestError: Unrecognized request argument supplied: functions

To Reproduce

1. run the code snippet
2. get the error

Code snippets

import openai

AZURE_KEY = "<key here>"
AZURE_ENDPOINT = "<endpoint here>"

messages = [{"role": "user", "content": "What's the weather like in Boston?"}]
functions = [
    {
        "name": "get_current_weather",
        "description": "Get the current weather in a given location",
        "parameters": {
            "type": "object",
            "properties": {
                "location": {
                    "type": "string",
                    "description": "The city and state, e.g. San Francisco, CA",
                },
                "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]},
            },
            "required": ["location"],
        },
    }
]
openai.api_type = "azure"
openai.api_key = AZURE_KEY
openai.api_base = AZURE_ENDPOINT
openai.api_version = "2023-05-15"

chat_completion = openai.ChatCompletion.create(
    engine="gpt-35-turbo",
    messages=messages,
    functions=functions
)

OS

linux

Python version

python 3.8

Library version

v0.27.8

[Billijk]

Found same issue here: https://stackoverflow.com/questions/76543136/how-to-do-function-calling-using-azure-openai

[luc-vocab]

is there a known workaround ? or we need to wait for azure to support functions ?

[yippp]

https://learn.microsoft.com/en-us/answers/questions/1323694/error-calling-function-when-using-model-gpt-35-tur
Seems Azure has known this problem and is tring to fix it.

[kristapratico]

Function support with Azure API will be supported soon, but there is not an ETA quite yet.

See this comment for more details: Azure/azure-rest-api-specs#24534 (comment)

[kristapratico]

Functions are now supported with the Azure API. You can see more details here: https://learn.microsoft.com/azure/ai-services/openai/how-to/function-calling

[amanoooo]

remember update this config
openai.api_version = "2023-07-01-preview"

[aiakubovich]

here what is working for me:

openai.api_version = "2023-07-01-preview"
response = openai.ChatCompletion.create(
    engine="gpt-35-turbo-0613",
    messages=[{"role": "user", "content": "Efficient operations on the ground and friendly, attentive employees everywhere."}],
    functions=functions,
    function_call="auto",
)

[qkxie]

remember update this config openai.api_version = "2023-07-01-preview"

You save me.

[Billijk]

Thanks a lot for the efforts to make this work!

[linchpinlin]

The question came up again.

[kristapratico]

The question came up again.

@linchpinlin can you share the error and an example of the code that reproduces it?

[linchpinlin]

The question came up again.

@linchpinlin can you share the error and an example of the code that reproduces it?
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/function-calling
Running the official demo also gives this error

File "text2sql.py", line 36, in gpt3_main
response = openai.ChatCompletion.create(
File "/home/lixaoyun/.local/lib/python3.8/site-packages/openai/api_resources/chat_completion.py", line 25, in create
return super().create(*args, **kwargs)
File "/home/lixaoyun/.local/lib/python3.8/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
response, _, api_key = requestor.request(
File "/home/lixaoyun/.local/lib/python3.8/site-packages/openai/api_requestor.py", line 298, in request
resp, got_stream = self._interpret_response(result, stream)
File "/home/lixaoyun/.local/lib/python3.8/site-packages/openai/api_requestor.py", line 700, in _interpret_response
self._interpret_response_line(
File "/home/lixaoyun/.local/lib/python3.8/site-packages/openai/api_requestor.py", line 765, in _interpret_response_line
raise self.handle_error_response(
openai.error.InvalidRequestError: Unrecognized request argument supplied: functions