Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

When is the benchmark evaluation system expected to come out? #29

Open
ckLibra opened this issue Apr 7, 2023 · 2 comments
Open

When is the benchmark evaluation system expected to come out? #29

ckLibra opened this issue Apr 7, 2023 · 2 comments

Comments

@ckLibra
Copy link

ckLibra commented Apr 7, 2023

Thanks for ur amazing work and datasets!
May I know when your online evaluation and full raw data will be available? It will be more convenient to use LaMAR to do further research.
@sarlinpe
Copy link
Collaborator

sarlinpe commented May 9, 2023

Hello! We're still planning to the release the full raw data, but I sadly can't give an ETA for now. The evaluation server will follow, but for now we can manually evaluate predictions - feel free to send us prediction files.

@sarlinpe
Copy link
Collaborator

Apologies for the late reply. The raw data has now been released (cd182f1) and can be accessed at the same link as previously or by filling in the form linked on our website. Feel free to open a new issue in case you face trouble using the data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sarlinpe @ckLibra