Issue with default mii_cache location

[xiang-deng]

The default mii_cache location is hardcoded as /tmp/cache, and we run into issues in a cluster environment when multi-users are trying to submit jobs and write on that directory. Maybe it is better to make the default cache location respect the environment variable set in the system.

DeepSpeed-MII/mii/constants.py

Line 98 in 81aca4d

MII_CACHE_PATH_DEFAULT = "/tmp/mii_cache"

[mrwyattii]

Hi @xiang-deng you can modify the cache path by setting the MII_CACHE_PATH environment variable. This will take precedence over the default path:

DeepSpeed-MII/mii/utils.py

Line 146 in e31b3e2

cache_path = os.environ.get(MII_CACHE_PATH, MII_CACHE_PATH_DEFAULT)

Does this address the issue you are seeing?

[xiang-deng]

Oh yeah, thanks! That resolves the issue. It was a little bit hard to locate where the path was specified in the beginning as we thought it was inherited somewhere.