Hello Everyone,

You will be able to submit to the Task 1 Leaderboard beginning on Monday, September 30th. 

Here are the details you need to know:

  • Each leaderboard submission must contain a correctly formatted JSONL file with the output for only the subset of the data used in leaderboard testing, you can download the subset of data for the leaderboard here. 
  • Submitted JSONL files will be compared against the ground truth labels and scored according to the rules in Task 1 Scoring found in the Challenge Guidelines.
  • If you receive a -1 score on your leaderboard submission, your submission did not run properly. Please comment in the forum if you need debugging support.
  • Competitors can submit to the leaderboard daily and results will be updated daily.
  • Please review the Task 1 File Format in the Challenge Guidelines and download the ZIP file of resources if you have not already.

We're looking forward to kicking off the Task 1 Leaderboard submissions! 

If you have any questions or run into any errors, please comment in the Challenge Forum.