About submissions #10
sadit
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Dear team members @cole-foster @dohnal @eth42 @flopper123 @zeraph6 @VladimirMic @matsui528 @kondounagi
We hope you are doing well. We would like to remind you that the submission deadline is quickly approaching (July 10th).
To submit your work, please comment on your "pre-registration issue" with the following information: your repository and the precise commit hash that needs to be evaluated. We will clone your repository and reproduce your results on our evaluation workstation. If we encounter any issues, we will reach out to you for assistance. It is important to note that we require a working test in GitHub Actions with clearly marked entry points for all tasks. These functions should be able to work with a smaller subset of the dataset, and we anticipate changing the input file or providing clear instructions to use other subsets. For instructions on the expected datasets and groups, as well as working examples (Python and Julia), please refer to the website.
Your script should include the necessary hyperparameters for construction, but you can also provide multiple searching hyperparameters (varying some hyperparameters without requiring a rebuild) within our allotted wall time. We will select the best-performing configuration.
All teams are expected to prepare a brief report in SISAP's short paper format. The acceptance or rejection of the report will be based on its contribution and originality. The final rankings will be computed and shared before the camera-ready deadline, allowing you to make any necessary adjustments to your manuscript.
Please note that the final ranking will be determined using a different query set. Additionally, we will carefully discard query objects with numerous zero-distance neighbors, meaning that queries with near-duplicates as neighbors will be removed.
We are currently working on improving the evaluation workstation. We will inform you of the final specifications, which may include support for avx512 instructions.
If you have any questions or doubts, please don't hesitate to contact us.
Best,
SISAP'23 LAION challenge organizers
@maumueller @zevahcle @sadit
Beta Was this translation helpful? Give feedback.
All reactions