How to use generate_responses.py? (References non-existing utilities module)

[mattmazzola]

I am trying to run the MathVista evaluation pipeline using the instructions and 3 step process here: https://github.com/lupantech/MathVista?tab=readme-ov-file#evaluation-pipelines

However, when I attempt to run generate_response.py it fails with:

    from utilities import *
ModuleNotFoundError: No module named 'utilities'

MathVista/evaluation/generate_response.py

Line 10 in 1c9b5da

from utilities import *

How do I use generate responses?

[mattmazzola]

Ah, I notice it is because the sys.path.append('../') relies on the script being run from a certain location.

This should be called out in the README as I assume it would be similar issue for others that wouldn't expect this.

Also, there are some other minor issues or things to clarify:

• The README says installation of openai, anthropic, bardapi is Optional, yet the file attempt to import all 3

MathVista/evaluation/generate_response.py

Line 12 in 1c9b5da

from models import claude, gpt, bard

and without having them installed it can fail. Example for claude/anthropic

    from anthropic import Anthropic, HUMAN_PROMPT, AI_PROMPT
ModuleNotFoundError: No module named 'anthropic'

• There are other modules required in utilities, but the README doesn't declare these installation steps (Or at least I didn't see)

pip install opencv-python
pip install word2number

• The use of old openai methods

You tried to access openai.ChatCompletion, but this is no longer supported in openai>=1.0.0

Given the original issues was about how to use the file and utilities I will resolve.
I think can manually update the openai code to use the 1+ version