Unable to find hparam file for a custom model

[me-manikanta]

🐛 Bug

When I am passing a custom model for generating the score, the command fails with the following error.

Exception: hparams.yaml file is missing!

I tried copying a hparams.yaml file to the same directory as the model but the score command fails with the same error.

I've then looked at the code to understand where it is checking for the path and tried to have a similar directory structure that is expected.

COMET/comet/models/__init__.py

Line 61 in 0d58039

hparams_file = "/".join(checkpoint_path.split("/")[:-2] + ["hparams.yaml"])

This fixed the issue for me.

To Reproduce

Run comet-score command with a custom model, but no hparams file in the parent directory.

Expected behaviour

Generate the comet-score with custom models, with(or may be without specifying) hparams.yaml

Possible Solutions

• [Not sure if possible] Pass default hparams if hparams.yaml file is not found
• Update the docs to specify that there should be a hparams.yaml file in the parent directory of the custom model
• Ability to specify hparams.yaml file as a param to command line

[ricardorei]

which version are you using? and what is the pytorch lightning version you have installed?