I have some questions about this dream challenge.
1. Since we need to submit execution scripts for each challenge, should
I also add all training data inside the image that we submitted? Are
these training data in /evaluation_data/* ?
2. About sub challenge 1, we need to predict the missing value of the
matrix. However, the submission of predictions files should be a G rows
and N columns matrix. Is that means these matrices should includes all
imputed and all values that are not missing? To calculate the prediction
scoring metrics, will you only use the imputed values and corresponds
truth values or, use all values?
3. Before the final submission, we don't need to submit any files
describe our algorithm, right? And should I calculate the prediction
scoring matrices in my execution scripts?
4. I cannot submit my image to docker.synapse.org could, anyone can help me?
I generate a test image about for my submission:
REPOSITORY TAG IMAGE ID CREATED SIZE
docker.synapse.org/syn10797187/test1 version1 69039832d265 22 hours ago 120MB
And I login by
docker login docker.synapse.org
then I type:
docker push docker.synapse.org/syn10797187/test1:version1
and it shows:
denied: requested access to the resource is denied
So, I failed. "syn10797187" is the id of my test project.
Created by Yiyi Li Stargazer gtarex Dear Yiyi,
You must be a certified Synapse user to be able to upload data onto Synapse: http://docs.synapse.org/articles/getting_started.html#becoming-a-certified-user .
You will be able to push your docker image after you take the certification quiz. Sorry for the inconvenience.
Best,
Tom Hi Dr. Yu
My docker is:
Client:
Version: 17.06.2-ce
API version: 1.30
Go version: go1.8.3
Git commit: cec0b72
Built: Tue Sep 5 20:00:17 2017
OS/Arch: linux/amd64
Server:
Version: 17.06.2-ce
API version: 1.30 (minimum version 1.12)
Go version: go1.8.3
Git commit: cec0b72
Built: Tue Sep 5 19:59:11 2017
OS/Arch: linux/amd64
Experimental: false
I think it is the one required, right? Dear Yiyi,
1. There should be no training done in the docker images, so model states are definitely allowed to be saved in the docker image. It is preferred not to have the training data in your docker container.
4. Ahh. Sorry about that. What version of docker do you have on your machine? Please make sure you at least have this version:
`Docker version 17.06.2-ce, build cec0b72`
Best,
Tom
Thanks for everyone's answer
As for question 1, as Dr Yu said, I should put trained models instead of raw training data. In this case, model states should save in the root documents, right? If my model requires all training data, can I still submit the training data?
Question 4, in fact, I already create a project with syn ID: syn10797187, and I still cannot upload my image. So, do you know why? For question 2.
You shall submit a matrix with the same dimension of the observed data. All prediction of missing values have to appear in the corresponding position of the matrix, and we are only using those spot were missing in the observed data to calculate scoring matrices.
Dear Yiyi,
Sorry for the delay in response. I will forward questions 2 and 3 to our other collaborators.
1. You should be submitting trained models, so model states should be uploaded into your docker images (not the training data)
4. Thanks Jeremy for helping to answer the question! Are you still having issues with this Yiyi?
shell script inputs:
Your docker image MUST have the correct corresponding execution bash script (`score_sc1.sh`, `score_sc2.sh`...) and this shell script can call other chunks of code that will the test data from `/evaluation_data` Does this make sense?
Best,
Tom Hi Yiyi,
I had the same issue as you had in #4. Under the wiki page: https://www.synapse.org/#!Synapse:syn8228304/wiki/448388, look closely at step two. "Before building the docker image, one must create a synapse project. View here for a tutorial on how to create a project. Every project/entity in Synapse has its own unique Synapse Id. You can also build your image with a specific tag." Basically you need to create a project folder server side before you can submit the image. Otherwise you'll get the non-specific error you mentioned. Oh, there is one more question about submission.
I found the website described:
The input of these scripts are the following:
/evaluation_data/*
/score_sc1.sh and/or /score_sc2.sh and/or /score_sc3.sh
Is that means the script require user to input 2 arguments:
/evaluation_data/* and /score_sc1.sh ?
Drop files to upload
Question about submission of this challenge. page is loading…