Hi, I have two issues: 1. Incomplete scoring: My submission (id: 9771043) shows cases_evaluated: 219 but not all predictions were scored and same disk space issue reported in the other thread (id: 9771038). The scores/logs files also disappeared shortly after scoring. 2. Cannot resubmit: When I try to submit a new prediction file I get "The specified Team is ineligible to submit to the specified Evaluation at this time." My team is registered and this was a successful submission previously. Project SynID: syn76207735 Could you fix the scoring for submission 9771043 and restore my ability to submit? Thanks

Created by Isuri Amalsha Ranawaka Liyanage Amalsha27
Hi @vchung, Thank you for the update! Best regards, Amalsha
Hi @Amalsha27 , Apologies for the confusion there! You received that error because your team already had two submissions in the queue that day, which is the daily limit for this challenge. We are currently experiencing a backlog due to a rush of recent submissions from many teams, but rest assured yours will be evaluated. I've also gone ahead and reset your submission 9771043 so it is back in the queue to be processed. As a reminder, daily submission limits reset at 00:00 UTC. Feel free to submit again once the reset happens!
Hi Amalsha, I see - thanks for letting us know! We will look into this as soon as possible and get back to you once we have a clearer idea of what is going on. I am hoping we can resolve this issue soon. Best Paula
Hi Paula, Thank you for the quick response! Unfortunately, I am still getting the same error: "The specified Team is ineligible to submit to the specified Evaluation at this time." Project SynID: syn76207735 Submission IDs: syn76312800 / syn76312812 Thanks,
Amalsha
Dear Amalsha, thank you very much for your participation in the challenge and bringing your issues to our attention! 1. You are correct in your observation that the validation results were not complete! We had to implement some changes in the evaluation pipeline for the leaderboard, which caused some issues on the side of participants. These issues should, however, be resolved by now and validation **should yield valid results for all cases**. We also do not expect there to be any problems regarding disk space anymore. 2. It is possible, that while we were updating the pipeline, no submissions could be uploaded. I would therefore **kindly ask you to try and re-submit again today and/or tomorrow to see if the issue with your team being ineligible persist.** My hope would be that the issue resolves itself now that the leaderboard is running again. If the issue is not resolved, then please send us a message here again in the forum and we will try our best to open the submission for your team as soon as possible! Feel free to reach out anytime if you have additional questions or run into any related or new problems! We are here to help :) Best Paula

Team ineligible to submit + incomplete scoring on previous submission - Task 4 page is loading…