We will keep updating this page as questions come.

Q1. Do the participants reserve the rights to decide whether to show their results on the results page or by submitting they are automatically waiving these rights?¶

A1. Participants waive the rights to decide whether to show their results on the results page. Every time new predictions are submitted for an algorithm, the last and the best scores for that algorithm will be displayed on the results page.

Q2. How different must submissions from the same team be?

A2. Differences between two submissions must be significant: typically, there must be algorithmic differences. Simply changing the value of a few parameters is not enough: this would be considered training on the test set.

Q3. Am I allowed to collect new annotations for the dataset?

A3. Yes. But if you plan to share these new annotations, you must do it through the CATARACTS website.