Repeated deprecation errors

[syleedandekar]

I am repeatedly getting this error when I try to run the pairwise annotator. How do I fix this? The problem seems to be from Alpaca Eval.

INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/completions "HTTP/1.1 404 Not Found"
WARNING:root:OpenAIError: Error code: 404 - {'error': {'message': 'The model text-davinci-003 has been deprecated, learn more here: https://platform.openai.com/docs/deprecations', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...

Here is the full traceback:
Traceback (most recent call last):
File "/alpaca_farm/test_autoannotations.py", line 19, in
annotated = annotator.annotate_pairs(outputs_pairs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/pairwise_evaluator.py", line 263, in annotate_pairs
return self.call(to_annotate, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 188, in call
df_annotated = self._annotate(curr_df_to_annotate, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 295, in _annotate
curr_annotated = self.annotators[annotator](
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 665, in call
completions = self.fn_completions(prompts=prompts, **self.completions_kwargs, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/decoders/openai.py", line 152, in openai_completions
completions = list(
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/tqdm/std.py", line 1181, in iter
for obj in iterable:
File "/anaconda3/envs/llm-pref/lib/python3.10/multiprocessing/pool.py", line 861, in next
self._cond.wait(timeout)
File "/anaconda3/envs/llm-pref/lib/python3.10/threading.py", line 320, in wait
waiter.acquire()
KeyboardInterrupt

[syleedandekar]

This error happens even if I change out text-davinci-003 for gpt-4-0314

[YannDubs]

There's, unfortunately, nothing we can do about depreciated endpoints, we keep them in AlpacaEval for documentation purposes. But if you switch to gpt-4 it will work.