Submission keeps failing on Codalab!

[Marjanz69]

Hi everyone,
All my submission files keep failing on Codalab. I am not sure why – the .zip contains submission.py and the weight files, but it still doesn’t get accepted. Could anyone advise on the possible cause?

[PierreGtch]

Hi @Marjanz69, I will try to help. Could you provide your submission number and precise which command you used to create the zip archive?

[Marjanz69]

Hi @PierreGtch, thanks for your reply.
My submission number is 379219.
To create the zip archive, I used Python’s zipfile module with the following code:

zip_path = "/content/submission.zip"
with zipfile.ZipFile(zip_path, "w", zipfile.ZIP_DEFLATED) as zipf:
zipf.write(weights1_dst, "weights_challenge1.pt")
zipf.write(weights2_dst, "weights_challenge2.pt")
zipf.write(submission_dst, "submission.py")

But Codabench keeps failing to import the Submission class from submission.py.

Also, I noticed that one of my submissions (379305) has been stuck in the Running status since last night.

[Marjanz69]

Hello @PierreGtch ,
My submission is still in the Running state for a long time. Could you please let me know how long it usually takes to be evaluated? Should I re-submit, or just wait?

Thank you.

[PierreGtch]

Submission 379219 was successful but you were not its author. I think you were talking about 379319.

In general, a submission should take around 15 minutes to run. If it takes longer, it is probably stuck and you should (1) cancel the submission, and (2) re-submit.

We are aware this is a recurring issue on the Codabench platform, and we are working with them on trying to resolve it. Sorry for the inconvenience