Hello Everyone,
You will be able to submit to the Task 1 Leaderboard beginning on Monday, September 30th.
Here are the details you need to know:
- Each leaderboard submission must contain a correctly formatted JSONL file with the output for only the subset of the data used in leaderboard testing, you can download the subset of data for the leaderboard here.
- Submitted JSONL files will be compared against the ground truth labels and scored according to the rules in Task 1 Scoring found in the Challenge Guidelines.
- If you receive a -1 score on your leaderboard submission, your submission did not run properly. Please comment in the forum if you need debugging support.
- Competitors can submit to the leaderboard daily and results will be updated daily.
- Please review the Task 1 File Format in the Challenge Guidelines and download the ZIP file of resources if you have not already.
We're looking forward to kicking off the Task 1 Leaderboard submissions!
If you have any questions or run into any errors, please comment in the Challenge Forum.