openai.error.AuthenticationError: Incorrect API key provided: cmdftp@e******.com if .netrc file is present

[WolfgangFahl]

Describe the bug

I am trying the example code from https://github.com/openai/openai-python

openai.api_key = os.getenv("OPENAI_API_KEY")
        # list models
        models = openai.Model.list()
        
        # print the first model's id
        print(models.data[0].id)
        
        # create a chat completion
        chat_completion = openai.ChatCompletion.create(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello world"}])
        
        # print the chat completion
        print(chat_completion.choices[0].message.content)

I have checked my API key with:

curl https://api.openai.com/v1/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $OPENAI_API_KEY" \
    -d '{
       "model": "gpt-3.5-turbo",
       "messages": [{"role": "user", "content": "Say this is a test!"}],
       "temperature": 0.7
     }'

which returns:

{
  "id": "chatcmpl-7TsXvCYItiGrF46Ljo26yS9BgsZWt",
  "object": "chat.completion",
  "created": 1687355543,
  "model": "gpt-3.5-turbo-0301",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "This is a test!"
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 5,
    "total_tokens": 19
  }
}

To Reproduce

macOS Big Sur 11.6.2
Darwin Kernel Version 20.6.0
python --version
Python 3.10.8

create a .netrc file

default
login anonymous
password cmdftp@example.com

save the codesnippet below as testopenai and run

./testopenai

which gives the error message:

openai.error.AuthenticationError: Incorrect API key provided: cmdftp@e******.com. You can find your API key at https://platform.openai.com/account/api-keys.

The payment plan has been setup, the key has been created after setting the plan and the curl command works - so why doesn't the python one? See also https://stackoverflow.com/a/76523513/1497139

Code snippets

#!/bin/bash
# WF 2023-06-21
if [ "$OPENAI_API_KEY" == "" ]
then
  echo "OPENAI_API_KEY env variable needs to be set to a key see https://platform.openai.com/account/api-keys"
  echo "export OPENAI_API_KEY="
  exit 1
fi
#if [ "$OPENAI_API_ORG" == "" ]
# then
#  echo "OPENAI_API_ORG env variable needs to be set  see https://platform.openai.com/account/org-settings"
#  echo "export OPENAI_API_ORG="
#  exit 1
#fi

#
# test via curl
#
viacurl() {
  curl https://api.openai.com/v1/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $OPENAI_API_KEY" \
    -d '{
       "model": "gpt-3.5-turbo",
       "messages": [{"role": "user", "content": "Say this is a test!"}],
       "temperature": 0.7
     }'
}

#
# test via python
#
viapython() {
  code="/tmp/testopenai.py"
cat << EOF > $code
import openai
import os
openai.api_key = os.getenv('OPENAI_API_KEY')

# list models
models = openai.Model.list()

# print the first model's id
print(models.data[0].id)

# create a chat completion
chat_completion = openai.ChatCompletion.create(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello world"}])

# print the chat completion
print(chat_completion.choices[0].message.content)
EOF
python $code
}

viacurl
viapython

OS

macOS

Python version

Python 3.10

Library version

openai-python 0.27.8

[WolfgangFahl]

On two of my ubuntu machines the testopenai script works

whisper-1
Hello there! How may I assist you today?

[WolfgangFahl]

On another MacOS machine it also works

Darwin Kernel Version 17.7.0
python --version
Python 3.9.15

and on another one:

MacOS 10.13.6
Darwin Kernel Version 17.7.0
python --version
Python 3.10.8

[WolfgangFahl]

A test with a docker environment also works:
Dockerfile

# openai python library test environment
FROM python:3.10.0-alpine
RUN pip install openai
RUN apk add bash curl

#!/bin/bash
# WF 2023-06-21
tag="python/openai"
name="python"
docker build --tag $tag .
docker stop $name
docker rm $name
docker run -d -v "$(pwd):/opt/scripts" --name $name $tag tail -f /dev/null
docker exec -it python /bin/bash

[WolfgangFahl]

Installing and testing in a venv environment fails

[WolfgangFahl]

a brand new key gives the exact same error

[WolfgangFahl]

when debugging i see that at some point basic auth settings

<class 'tuple'>: ('anonymous', 'cmdftp@example.com')

are created out of blue air which contain part of the error message's content - why would this happen and spoil the request which seems to loose the original api-key header information while at it ...

[WolfgangFahl]

The reason for the behavior seems to be the existence of a .netrc file

default
login anonymous
password cmdftp@example.com

the openai library relies on the request library which will override the authentication header with an attempt for basic auth.
IMHO this behavior is surprising and should be changed. Since the .netrc entry was created for heroku which i do not use any more i could workaround the problem by simply moving the .netrc file so that it's not active any more

[sotlampr]

+1 I can confirm this bug. It also manifests when doing a manual HTTP API call using the requests library.

Using the standard library's urllib.request works.

[grumpyp]

Hi there, is there any fix?

Have the issue using the whisper API too.

[rattrayalex]

This should be fixed in v1; please upgrade to the latest version of the library and reopen if the problem persists.