Hello,
I have some confusion regarding test phase submission.
1. In the validation phase we created a project named LISA2025. Now for test phase, will we create another project named "LISA 2025 Draft " given in this link https://www.synapse.org/Synapse:syn68633106/wiki/633398 ? Or we will use the previous project created for validation phase to submit test phase result?
2. For test phase how many times we can submit the result? It seems like there are no time limit. Am i right saying? "For each queue, we will take your last submission run against the unseen testing data as the model chosen for final rankings." I found it in the wiki page.
Thanks for your time and consideration.
Sincerly
Created by Tasnim Jahan Tasnim_Jahan Thnak you so much! Great help. Hi @Ano-ny-mas,
Thanks for your questions. Please see the clarifications below:
1. Do we need to create a new Synapse Project for the test phase?
No. Please continue using your existing team project (e.g., LISA2025 ). Test-phase evaluation is done by submitting your Docker image to the Testing Phase – Docker Image evaluation queue; the project name does not affect scoring.
Note: The wiki reference to “LISA 2025 Draft ” is optional for your own workspace and is not required for test submissions.
2. How many times can we submit in the test phase? How is it counted?
You may resubmit. We count only ACCEPTED runs toward the limit; RECEIVED / PROCESSING / INVALID do not count.
We will consider up to two (2) ACCEPTED submissions per testing queue, and for final ranking we will use your last ACCEPTED submission before the deadline.
Reminder:
Validation phase = .zip predictions (closed)
Test phase = Docker submission only to the testing queue
If anything is unclear or you need help with the Docker submission, please let us know.
Best regards,
The LISA 2025 Challenge Organizers