Hi, A few questions about the challenge submission process: 1. How many submissions is each team allowed to make per track over the course of the challenge? Is there a cap on total submissions before the September 4 deadline, or a per-day/per-week limit? 2. Will teams be able to see a leaderboard after making a submission, and if so, is it updated live or only at fixed intervals? 3. During the validation period (May 30 - Aug 20), can we submit multiple times to check our ranking, and then submit our final entry separately before the September 4 deadline? Thanks in advance for the clarification!

Created by Mayank Anand Anand_Mayank
Hi, To clarify broadly: for the 2026 challenge we intend the validation phase to be used as a verification that your model runs without any crashes or surprise errors. Accuracy results will not be posted, but we will notify you if your method is worse than a sanity-check control method. This is so that we do not have invalid submissions on the challenge deadline, for the benefit of both the organizers and participants. We recommend users to test on the small validation case, or to also look at data from prior years for designing the best method. 1. We will be able to test models on a weekly basis. 2. There will not be a leaderboard for this year's challenge. 3. Same as above, but your final entry can be submitted separately up until the final due date (September 4).

Questions on submission limits, leaderboard visibility, and validation phase page is loading…