Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sample submission files #3

Open
qmaruf opened this issue Jun 10, 2018 · 6 comments
Open

Sample submission files #3

qmaruf opened this issue Jun 10, 2018 · 6 comments

Comments

@qmaruf
Copy link

qmaruf commented Jun 10, 2018

Could you please provide a sample submission file? I am not sure how are you calculating the classification accuracy and writing those accuracy in files.

@MInner
Copy link
Collaborator

MInner commented Jun 10, 2018

Hi. Are you talking about openset or detection problem?

@qmaruf
Copy link
Author

qmaruf commented Jun 11, 2018

openset.
Besides, I am getting the following error though I have put source_results.txt and adaptation_results.txt in a zip file named ExMachina_submission.zip.

Traceback (most recent call last):
  File "/tmp/codalab/tmpot65Db/run/program/evaluate.py", line 130, in 
    classification_evaluation(truth_file, source_file, adaptation_file, output_file)
  File "/tmp/codalab/tmpot65Db/run/program/evaluate.py", line 42, in classification_evaluation
    with open(source_file) as f:
IOError: [Errno 2] No such file or directory: '/tmp/codalab/tmpot65Db/run/input/res/source_results.txt'

@neelakaushik
Copy link
Collaborator

Hi, we have uploaded a sample submission file here. I believe the submission error might have been because the submitted files were empty (or they appeared to be so when downloading from the server). Please try submitting again following this format and let us know if you have any issues!

@qmaruf
Copy link
Author

qmaruf commented Jun 13, 2018

Same error. Could you please provide a standalone zip folder as an example?
Here is my submission file.

@neelakaushik
Copy link
Collaborator

I think I see the issue -- if you move the two files out of the subfolder in the zip file and delete the subfolder that should work!

@krumo
Copy link

krumo commented Jun 21, 2018

Could you consider to provide a sample submission file for detection problem? Thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants