Hi, When I download with the command 'synapse get-download-list' it keep failing after downloaded a few MB data. The messages are as follows: ``` Downloading [--------------------]1.18% 8.0MB/676.7MB (98.5kB/s) D19-13164.frDownloading [--------------------]1.18% 8.0MB/676.7MB (97.1kB/s) D19-13164.frDownloading [--------------------]1.18% 8.0MB/676.7MB (99.9kB/s) D19-13164.frDownloading [--------------------]1.18% 8.0MB/676.7MB (85.3kB/s) D19-13164.frDownloading [--------------------]2.36% 16.0MB/676.7MB (166.0kB/s) D19-13164.Downloading [#-------------------]3.55% 24.0MB/676.7MB (243.9kB/s) D19-13164.Downloading [#-------------------]4.73% 32.0MB/676.7MB (320.2kB/s) D19-13164.Downloading [#-------------------]5.91% 40.0MB/676.7MB (395.3kB/s) D19-13164.fragments.tsv.gz.synapse_download_128417995 [ERROR] Unable to download file ``` I read some of the posts with similar problems. Most are asked to try with debug mode, yet it does not provide any info I could tell to help solve this problem.
Output for command: synapse --debug get-download-list synapse --debug get-download-list ``` Synapse username (leave blank if using an auth token): minminluo Password, api key, or auth token for user minminluo: 2024-01-05 11:23:43,794 [credential_provider:59 - WARNING]: Logging into Synapse via passwords will be deprecated by early 2024. This message will disappear if you use a Synapse Personal Access Token to login. Welcome, minminluo! 2024-01-05 11:23:44,655 [client:510 - INFO]: Welcome, minminluo! [####################]100.00% 1/1 Done... 2024-01-05 11:23:48,009 [client:2734 - DEBUG]: Downloading from https://data.prod.sagebase.org/3488881/7d241b3c-640c-4357-9873-60e0cb78ce86/manifest.csv?response-content-disposition=attachment%3B%20filename%3D%22manifest.csv%22%3B%20filename%2A%3Dutf-8%27%27manifest.csv&response-content-type=text%2Fcsv&X-Amz-Date=20240105T032707Z&X-Amz-Expires=30&Expires=1704425257&Signature=EAFp2eqb1AHeWv9ZhRvnHXKXhwspLy1eViP~EMJsDpQIXsTw8PAUlDXwV9YfoZhxs3Pe-zbZwVM1E6nCIjrM7FFdseXq3v-VWCAkcioXltDzaJhnDfW~DqMTgMHYRaP4XVhHTQI5nzFL-XOgW--VGcJTa3JS-DK4WjgFyD-t~QRW0hqGPARnYzXBySU6LFrypye~atn22WJlLWbdAf7unw~dHffEzg640HcmLjMpMz65CdF5yYqAE0fd5Wt5Y2BELlvdiMitnjAj95Qh4TjTtOMEbdAXpqFW2PiXLmyQzZACJzvGPXXrsBxagb5ltFJBo96iG0Tu0puZq-B9V1Vzbg__&Key-Pair-Id=K1ODM3BLJ5L7YV to /storage/minminluo/tmp Downloading [####################]100.00% 88.0kB/88.0kB (271.9kB/s) manifest.csv Done... Downloading [--------------------]0.06% 8.0MB/12.3GB (49.3kB/s) D19-12513.posDownloading [--------------------]0.13% 16.0MB/12.3GB (97.9kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 2024-01-05 11:27:26,630 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/tmp/D19-12513.possorted_bam.bam.synapse_download_128421089 ```
Also in those posts, some environment parameters are asked. So I run these to help judge what is going on here:
Environment Parameters ``` (base) minminluo@Victor ~/DATA/tmp $ conda env export name: base channels: - defaults dependencies: - _anaconda_depends=2023.07=py311_0 - _libgcc_mutex=0.1=main - _openmp_mutex=5.1=1_gnu - abseil-cpp=20211102.0=hd4dd3e8_0 - aiobotocore=2.5.0=py311h06a4308_0 - aiofiles=22.1.0=py311h06a4308_0 - aiohttp=3.8.3=py311h5eee18b_0 - aioitertools=0.7.1=pyhd3eb1b0_0 - aiosignal=1.2.0=pyhd3eb1b0_0 - aiosqlite=0.18.0=py311h06a4308_0 - alabaster=0.7.12=pyhd3eb1b0_0 - anaconda-catalogs=0.2.0=py311h06a4308_0 - anaconda-client=1.11.3=py311h06a4308_0 - anaconda-navigator=2.4.2=py311h06a4308_0 - anaconda-project=0.11.1=py311h06a4308_0 - anyio=3.5.0=py311h06a4308_0 - appdirs=1.4.4=pyhd3eb1b0_0 - argon2-cffi=21.3.0=pyhd3eb1b0_0 - argon2-cffi-bindings=21.2.0=py311h5eee18b_0 - arrow=1.2.3=py311h06a4308_1 - arrow-cpp=11.0.0=py311ha0d4687_0 - astroid=2.14.2=py311h06a4308_0 - astropy=5.1=py311hbed6279_0 - asttokens=2.0.5=pyhd3eb1b0_0 - async-timeout=4.0.2=py311h06a4308_0 - atomicwrites=1.4.0=py_0 - attrs=22.1.0=py311h06a4308_0 - automat=20.2.0=py_0 - autopep8=1.6.0=pyhd3eb1b0_1 - aws-c-common=0.4.57=he6710b0_1 - aws-c-event-stream=0.1.6=h2531618_5 - aws-checksums=0.1.9=he6710b0_0 - aws-sdk-cpp=1.8.185=hce553d0_0 - babel=2.11.0=py311h06a4308_0 - backcall=0.2.0=pyhd3eb1b0_0 - backports=1.1=pyhd3eb1b0_0 - backports.functools_lru_cache=1.6.4=pyhd3eb1b0_0 - backports.tempfile=1.0=pyhd3eb1b0_1 - backports.weakref=1.0.post1=py_1 - bcrypt=3.2.0=py311h5eee18b_1 - beautifulsoup4=4.12.2=py311h06a4308_0 - binaryornot=0.4.4=pyhd3eb1b0_1 - black=23.3.0=py311h06a4308_0 - blas=1.0=mkl - bleach=4.1.0=pyhd3eb1b0_0 - blosc=1.21.3=h6a678d5_0 - bokeh=3.1.1=py311h92b7b1e_0 - boltons=23.0.0=py311h06a4308_0 - boost-cpp=1.73.0=h7f8727e_12 - botocore=1.29.76=py311h06a4308_0 - bottleneck=1.3.5=py311hbed6279_0 - brotli=1.0.9=h5eee18b_7 - brotli-bin=1.0.9=h5eee18b_7 - brotlipy=0.7.0=py311h5eee18b_1002 - brunsli=0.1=h2531618_0 - bzip2=1.0.8=h7b6447c_0 - c-ares=1.19.0=h5eee18b_0 - c-blosc2=2.8.0=h6a678d5_0 - ca-certificates=2023.05.30=h06a4308_0 - certifi=2023.5.7=py311h06a4308_0 - cffi=1.15.1=py311h5eee18b_3 - cfitsio=3.470=h5893167_7 - chardet=4.0.0=py311h06a4308_1003 - charls=2.2.0=h2531618_0 - charset-normalizer=2.0.4=pyhd3eb1b0_0 - click=8.0.4=py311h06a4308_0 - cloudpickle=2.2.1=py311h06a4308_0 - clyent=1.2.2=py311h06a4308_1 - colorama=0.4.6=py311h06a4308_0 - colorcet=3.0.1=py311h06a4308_0 - comm=0.1.2=py311h06a4308_0 - conda=23.5.2=py311h06a4308_0 - conda-build=3.25.0=py311h06a4308_0 - conda-content-trust=0.1.3=py311h06a4308_0 - conda-index=0.2.3=py311h06a4308_0 - conda-libmamba-solver=23.5.0=py311h06a4308_0 - conda-pack=0.6.0=pyhd3eb1b0_0 - conda-package-handling=2.1.0=py311h06a4308_0 - conda-package-streaming=0.8.0=py311h06a4308_0 - conda-repo-cli=1.0.41=py311h06a4308_0 - conda-token=0.4.0=pyhd3eb1b0_0 - conda-verify=3.4.2=py_1 - constantly=15.1.0=py311h06a4308_0 - contourpy=1.0.5=py311hdb19cb5_0 - cookiecutter=1.7.3=pyhd3eb1b0_0 - cryptography=39.0.1=py311h9ce1e76_0 - cssselect=1.1.0=pyhd3eb1b0_0 - curl=8.1.1=h5eee18b_1 - cycler=0.11.0=pyhd3eb1b0_0 - cytoolz=0.12.0=py311h5eee18b_0 - daal4py=2023.1.1=py311h4cb112f_0 - dal=2023.1.1=hdb19cb5_48679 - dask=2023.6.0=py311h06a4308_0 - dask-core=2023.6.0=py311h06a4308_0 - datasets=2.12.0=py311h06a4308_0 - datashader=0.15.0=py311h06a4308_0 - datashape=0.5.4=py311h06a4308_1 - dbus=1.13.18=hb2f20db_0 - debugpy=1.5.1=py311h6a678d5_0 - decorator=5.1.1=pyhd3eb1b0_0 - defusedxml=0.7.1=pyhd3eb1b0_0 - diff-match-patch=20200713=pyhd3eb1b0_0 - dill=0.3.6=py311h06a4308_0 - distributed=2023.6.0=py311h06a4308_0 - docstring-to-markdown=0.11=py311h06a4308_0 - docutils=0.18.1=py311h06a4308_3 - entrypoints=0.4=py311h06a4308_0 - et_xmlfile=1.1.0=py311h06a4308_0 - executing=0.8.3=pyhd3eb1b0_0 - expat=2.4.9=h6a678d5_0 - filelock=3.9.0=py311h06a4308_0 - flake8=6.0.0=py311h06a4308_0 - flask=2.2.2=py311h06a4308_0 - fmt=9.1.0=hdb19cb5_0 - fontconfig=2.14.1=h52c9d5c_1 - fonttools=4.25.0=pyhd3eb1b0_0 - freetype=2.12.1=h4a9f257_0 - frozenlist=1.3.3=py311h5eee18b_0 - fsspec=2023.4.0=py311h06a4308_0 - future=0.18.3=py311h06a4308_0 - gensim=4.3.0=py311hba01205_1 - gflags=2.2.2=he6710b0_0 - giflib=5.2.1=h5eee18b_3 - glib=2.69.1=he621ea3_2 - glob2=0.7=pyhd3eb1b0_0 - glog=0.5.0=h2531618_0 - gmp=6.2.1=h295c915_3 - gmpy2=2.1.2=py311hc9b5ff0_0 - greenlet=2.0.1=py311h6a678d5_0 - grpc-cpp=1.46.1=h33aed49_1 - gst-plugins-base=1.14.1=h6a678d5_1 - gstreamer=1.14.1=h5eee18b_1 - h5py=3.7.0=py311h021c08c_0 - hdf5=1.10.6=h3ffc7dd_1 - heapdict=1.0.1=pyhd3eb1b0_0 - holoviews=1.16.2=py311h06a4308_0 - huggingface_hub=0.15.1=py311h06a4308_0 - hvplot=0.8.4=py311h06a4308_0 - hyperlink=21.0.0=pyhd3eb1b0_0 - icu=58.2=he6710b0_3 - idna=3.4=py311h06a4308_0 - imagecodecs=2021.8.26=py311hb63acbb_2 - imageio=2.31.1=py311h06a4308_0 - imagesize=1.4.1=py311h06a4308_0 - imbalanced-learn=0.10.1=py311h06a4308_1 - importlib-metadata=6.0.0=py311h06a4308_0 - importlib_metadata=6.0.0=hd3eb1b0_0 - incremental=21.3.0=pyhd3eb1b0_0 - inflection=0.5.1=py311h06a4308_0 - iniconfig=1.1.1=pyhd3eb1b0_0 - intake=0.6.8=py311h06a4308_0 - intel-openmp=2023.1.0=hdb19cb5_46305 - intervaltree=3.1.0=pyhd3eb1b0_0 - ipykernel=6.19.2=py311h6410fe4_0 - ipython=8.12.0=py311h06a4308_0 - ipython_genutils=0.2.0=pyhd3eb1b0_1 - ipywidgets=8.0.4=py311h06a4308_0 - isort=5.9.3=pyhd3eb1b0_0 - itemadapter=0.3.0=pyhd3eb1b0_0 - itemloaders=1.0.4=pyhd3eb1b0_1 - itsdangerous=2.0.1=pyhd3eb1b0_0 - jaraco.classes=3.2.1=pyhd3eb1b0_0 - jedi=0.18.1=py311h06a4308_1 - jeepney=0.7.1=pyhd3eb1b0_0 - jellyfish=0.9.0=py311h5eee18b_0 - jinja2=3.1.2=py311h06a4308_0 - jinja2-time=0.2.0=pyhd3eb1b0_3 - jmespath=0.10.0=pyhd3eb1b0_0 - joblib=1.2.0=py311h06a4308_0 - jpeg=9e=h5eee18b_1 - jq=1.6=h27cfd23_1000 - json5=0.9.6=pyhd3eb1b0_0 - jsonpatch=1.32=pyhd3eb1b0_0 - jsonpointer=2.1=pyhd3eb1b0_0 - jsonschema=4.17.3=py311h06a4308_0 - jupyter=1.0.0=py311h06a4308_8 - jupyter_client=8.1.0=py311h06a4308_0 - jupyter_console=6.6.3=py311h06a4308_0 - jupyter_core=5.3.0=py311h06a4308_0 - jupyter_events=0.6.3=py311h06a4308_0 - jupyter_server=2.5.0=py311h06a4308_0 - jupyter_server_fileid=0.9.0=py311h06a4308_0 - jupyter_server_terminals=0.4.4=py311h06a4308_1 - jupyter_server_ydoc=0.8.0=py311h06a4308_1 - jupyter_ydoc=0.2.4=py311h06a4308_0 - jupyterlab=3.6.3=py311h06a4308_0 - jupyterlab_pygments=0.1.2=py_0 - jupyterlab_server=2.22.0=py311h06a4308_0 - jupyterlab_widgets=3.0.5=py311h06a4308_0 - jxrlib=1.1=h7b6447c_2 - kiwisolver=1.4.4=py311h6a678d5_0 - krb5=1.20.1=h568e23c_1 - lazy-object-proxy=1.6.0=py311h5eee18b_0 - lazy_loader=0.2=py311h06a4308_0 - lcms2=2.12=h3be6417_0 - ld_impl_linux-64=2.38=h1181459_1 - lerc=3.0=h295c915_0 - libaec=1.0.4=he6710b0_1 - libarchive=3.6.2=hab531cd_0 - libboost=1.73.0=h28710b8_12 - libbrotlicommon=1.0.9=h5eee18b_7 - libbrotlidec=1.0.9=h5eee18b_7 - libbrotlienc=1.0.9=h5eee18b_7 - libclang=10.0.1=default_hb85057a_2 - libcurl=8.1.1=h91b91d3_1 - libdeflate=1.17=h5eee18b_0 - libedit=3.1.20221030=h5eee18b_0 - libev=4.33=h7f8727e_1 - libevent=2.1.12=h8f2d780_0 - libffi=3.4.4=h6a678d5_0 - libgcc-ng=11.2.0=h1234567_1 - libgfortran-ng=11.2.0=h00389a5_1 - libgfortran5=11.2.0=h1234567_1 - libgomp=11.2.0=h1234567_1 - liblief=0.12.3=h6a678d5_0 - libllvm10=10.0.1=hbcb73fb_5 - libllvm14=14.0.6=hdb19cb5_3 - libmamba=1.4.1=hdb19cb5_0 - libmambapy=1.4.1=py311hdb19cb5_0 - libnghttp2=1.52.0=ha637b67_1 - libpng=1.6.39=h5eee18b_0 - libpq=12.15=h37d81fd_1 - libprotobuf=3.20.3=he621ea3_0 - libsodium=1.0.18=h7b6447c_0 - libsolv=0.7.22=he621ea3_0 - libspatialindex=1.9.3=h2531618_0 - libssh2=1.10.0=h37d81fd_2 - libstdcxx-ng=11.2.0=h1234567_1 - libthrift=0.15.0=h0d84882_2 - libtiff=4.5.0=h6a678d5_2 - libuuid=1.41.5=h5eee18b_0 - libwebp=1.2.4=h11a3e52_1 - libwebp-base=1.2.4=h5eee18b_1 - libxcb=1.15=h7f8727e_0 - libxkbcommon=1.0.1=hfa300c1_0 - libxml2=2.9.14=h74e7548_0 - libxslt=1.1.35=h4e12654_0 - libzopfli=1.0.3=he6710b0_0 - linkify-it-py=2.0.0=py311h06a4308_0 - llvmlite=0.40.0=py311he621ea3_0 - locket=1.0.0=py311h06a4308_0 - lxml=4.9.1=py311h1edc446_0 - lz4=4.3.2=py311h5eee18b_0 - lz4-c=1.9.4=h6a678d5_0 - lzo=2.10=h7b6447c_2 - markdown=3.4.1=py311h06a4308_0 - markdown-it-py=2.2.0=py311h06a4308_1 - markupsafe=2.1.1=py311h5eee18b_0 - matplotlib=3.7.1=py311h06a4308_1 - matplotlib-base=3.7.1=py311ha02d727_1 - matplotlib-inline=0.1.6=py311h06a4308_0 - mccabe=0.7.0=pyhd3eb1b0_0 - mdit-py-plugins=0.3.0=py311h06a4308_0 - mdurl=0.1.0=py311h06a4308_0 - mistune=0.8.4=py311h5eee18b_1000 - mkl=2023.1.0=h6d00ec8_46342 - mkl-service=2.4.0=py311h5eee18b_1 - mkl_fft=1.3.6=py311ha02d727_1 - mkl_random=1.2.2=py311ha02d727_1 - more-itertools=8.12.0=pyhd3eb1b0_0 - mpc=1.1.0=h10f8cd9_1 - mpfr=4.0.2=hb69a4c5_1 - mpi=1.0=mpich - mpich=4.1.1=hbae89fd_0 - mpmath=1.2.1=py311h06a4308_0 - msgpack-python=1.0.3=py311hdb19cb5_0 - multidict=6.0.2=py311h5eee18b_0 - multipledispatch=0.6.0=py311h06a4308_0 - multiprocess=0.70.14=py311h06a4308_0 - munkres=1.1.4=py_0 - mypy_extensions=0.4.3=py311h06a4308_1 - navigator-updater=0.4.0=py311h06a4308_0 - nbclassic=0.5.5=py311h06a4308_0 - nbclient=0.5.13=py311h06a4308_0 - nbconvert=6.5.4=py311h06a4308_0 - nbformat=5.7.0=py311h06a4308_0 - ncurses=6.4=h6a678d5_0 - nest-asyncio=1.5.6=py311h06a4308_0 - networkx=2.8.4=py311h06a4308_1 - ninja=1.10.2=h06a4308_5 - ninja-base=1.10.2=hd09550d_5 - nltk=3.7=pyhd3eb1b0_0 - notebook=6.5.4=py311h06a4308_0 - notebook-shim=0.2.2=py311h06a4308_0 - nspr=4.35=h6a678d5_0 - nss=3.89.1=h6a678d5_0 - numba=0.57.0=py311ha02d727_0 - numexpr=2.8.4=py311h65dcdc2_1 - numpy=1.24.3=py311h08b1b3b_1 - numpy-base=1.24.3=py311hf175353_1 - numpydoc=1.5.0=py311h06a4308_0 - oniguruma=6.9.7.1=h27cfd23_0 - openjpeg=2.4.0=h3ad879b_0 - openpyxl=3.0.10=py311h5eee18b_0 - openssl=1.1.1u=h7f8727e_0 - orc=1.7.4=hb3bc3d3_1 - packaging=23.0=py311h06a4308_0 - pandas=1.5.3=py311hba01205_0 - pandocfilters=1.5.0=pyhd3eb1b0_0 - panel=1.1.0=py311h06a4308_0 - param=1.13.0=py311h06a4308_0 - parsel=1.6.0=py311h06a4308_0 - parso=0.8.3=pyhd3eb1b0_0 - partd=1.2.0=pyhd3eb1b0_1 - patch=2.7.6=h7b6447c_1001 - patchelf=0.17.2=h6a678d5_0 - pathlib=1.0.1=pyhd3eb1b0_1 - pathspec=0.10.3=py311h06a4308_0 - patsy=0.5.3=py311h06a4308_0 - pcre=8.45=h295c915_0 - pcre2=10.37=he7ceb23_1 - pep8=1.7.1=py311h06a4308_1 - pexpect=4.8.0=pyhd3eb1b0_3 - pickleshare=0.7.5=pyhd3eb1b0_1003 - pillow=9.4.0=py311h6a678d5_0 - pip=23.1.2=py311h06a4308_0 - pkginfo=1.9.6=py311h06a4308_0 - platformdirs=2.5.2=py311h06a4308_0 - plotly=5.9.0=py311h06a4308_0 - pluggy=1.0.0=py311h06a4308_1 - ply=3.11=py311h06a4308_0 - pooch=1.4.0=pyhd3eb1b0_0 - poyo=0.5.0=pyhd3eb1b0_0 - prometheus_client=0.14.1=py311h06a4308_0 - prompt-toolkit=3.0.36=py311h06a4308_0 - prompt_toolkit=3.0.36=hd3eb1b0_0 - protego=0.1.16=py_0 - psutil=5.9.0=py311h5eee18b_0 - ptyprocess=0.7.0=pyhd3eb1b0_2 - pure_eval=0.2.2=pyhd3eb1b0_0 - py-cpuinfo=8.0.0=pyhd3eb1b0_1 - py-lief=0.12.3=py311h6a678d5_0 - pyarrow=11.0.0=py311hd8e8d9b_0 - pyasn1=0.4.8=pyhd3eb1b0_0 - pyasn1-modules=0.2.8=py_0 - pybind11-abi=4=hd3eb1b0_1 - pycodestyle=2.10.0=py311h06a4308_0 - pycosat=0.6.4=py311h5eee18b_0 - pycparser=2.21=pyhd3eb1b0_0 - pyct=0.5.0=py311h06a4308_0 - pycurl=7.45.2=py311h37d81fd_0 - pydispatcher=2.0.5=py311h06a4308_2 - pydocstyle=6.3.0=py311h06a4308_0 - pyerfa=2.0.0=py311h5eee18b_0 - pyflakes=3.0.1=py311h06a4308_0 - pygments=2.15.1=py311h06a4308_1 - pyjwt=2.4.0=py311h06a4308_0 - pylint=2.16.2=py311h06a4308_0 - pylint-venv=2.3.0=py311h06a4308_0 - pyls-spyder=0.4.0=pyhd3eb1b0_0 - pyodbc=4.0.34=py311h6a678d5_0 - pyopenssl=23.0.0=py311h06a4308_0 - pyparsing=3.0.9=py311h06a4308_0 - pyqt=5.15.7=py311h6a678d5_0 - pyqt5-sip=12.11.0=py311h6a678d5_0 - pyqtwebengine=5.15.7=py311h6a678d5_0 - pyrsistent=0.18.0=py311h5eee18b_0 - pysocks=1.7.1=py311h06a4308_0 - pytables=3.8.0=py311h43249b6_2 - pytest=7.3.1=py311h06a4308_0 - python=3.11.3=h7a1cb2a_0 - python-dateutil=2.8.2=pyhd3eb1b0_0 - python-fastjsonschema=2.16.2=py311h06a4308_0 - python-json-logger=2.0.7=py311h06a4308_0 - python-libarchive-c=2.9=pyhd3eb1b0_1 - python-lmdb=1.4.1=py311h6a678d5_0 - python-lsp-black=1.2.1=py311h06a4308_0 - python-lsp-jsonrpc=1.0.0=pyhd3eb1b0_0 - python-lsp-server=1.7.2=py311h06a4308_0 - python-slugify=5.0.2=pyhd3eb1b0_0 - python-snappy=0.6.1=py311h6a678d5_0 - python-xxhash=2.0.2=py311h5eee18b_1 - pytoolconfig=1.2.5=py311h06a4308_1 - pytorch=2.0.1=cpu_py311h6d93b4c_0 - pytz=2022.7=py311h06a4308_0 - pyviz_comms=2.3.0=py311h06a4308_0 - pywavelets=1.4.1=py311h5eee18b_0 - pyxdg=0.27=pyhd3eb1b0_0 - pyyaml=6.0=py311h5eee18b_1 - pyzmq=25.1.0=py311h6a678d5_0 - qdarkstyle=3.0.2=pyhd3eb1b0_0 - qstylizer=0.2.2=py311h06a4308_0 - qt-main=5.15.2=h327a75a_7 - qt-webengine=5.15.9=hd2b0992_4 - qtawesome=1.2.2=py311h06a4308_0 - qtconsole=5.4.2=py311h06a4308_0 - qtpy=2.2.0=py311h06a4308_0 - qtwebkit=5.212=h4eab89a_4 - queuelib=1.5.0=py311h06a4308_0 - re2=2022.04.01=h295c915_0 - readline=8.2=h5eee18b_0 - regex=2022.7.9=py311h5eee18b_0 - reproc=14.2.4=h295c915_1 - reproc-cpp=14.2.4=h295c915_1 - requests=2.29.0=py311h06a4308_0 - requests-file=1.5.1=pyhd3eb1b0_0 - requests-toolbelt=0.9.1=pyhd3eb1b0_0 - responses=0.13.3=pyhd3eb1b0_0 - rfc3339-validator=0.1.4=py311h06a4308_0 - rfc3986-validator=0.1.1=py311h06a4308_0 - rope=1.7.0=py311h06a4308_0 - rtree=1.0.1=py311h06a4308_0 - ruamel.yaml=0.17.21=py311h5eee18b_0 - ruamel_yaml=0.17.21=py311h5eee18b_0 - s3fs=2023.4.0=py311h06a4308_0 - sacremoses=0.0.43=pyhd3eb1b0_0 - scikit-image=0.20.0=py311h6a678d5_0 - scikit-learn=1.2.2=py311h6a678d5_1 - scikit-learn-intelex=2023.1.1=py311h06a4308_0 - scipy=1.10.1=py311h08b1b3b_1 - scrapy=2.8.0=py311h06a4308_0 - seaborn=0.12.2=py311h06a4308_0 - secretstorage=3.3.1=py311h06a4308_1 - send2trash=1.8.0=pyhd3eb1b0_1 - service_identity=18.1.0=pyhd3eb1b0_1 - setuptools=67.8.0=py311h06a4308_0 - sip=6.6.2=py311h6a678d5_0 - six=1.16.0=pyhd3eb1b0_1 - smart_open=5.2.1=py311h06a4308_0 - snappy=1.1.9=h295c915_0 - sniffio=1.2.0=py311h06a4308_1 - snowballstemmer=2.2.0=pyhd3eb1b0_0 - sortedcontainers=2.4.0=pyhd3eb1b0_0 - soupsieve=2.4=py311h06a4308_0 - sphinx=5.0.2=py311h06a4308_0 - sphinxcontrib-applehelp=1.0.2=pyhd3eb1b0_0 - sphinxcontrib-devhelp=1.0.2=pyhd3eb1b0_0 - sphinxcontrib-htmlhelp=2.0.0=pyhd3eb1b0_0 - sphinxcontrib-jsmath=1.0.1=pyhd3eb1b0_0 - sphinxcontrib-qthelp=1.0.3=pyhd3eb1b0_0 - sphinxcontrib-serializinghtml=1.1.5=pyhd3eb1b0_0 - spyder=5.4.3=py311h06a4308_1 - spyder-kernels=2.4.3=py311h06a4308_0 - sqlalchemy=1.4.39=py311h5eee18b_0 - sqlite=3.41.2=h5eee18b_0 - stack_data=0.2.0=pyhd3eb1b0_0 - statsmodels=0.13.5=py311h5eee18b_1 - sympy=1.11.1=py311h06a4308_0 - tabulate=0.8.10=py311h06a4308_0 - tbb=2021.8.0=hdb19cb5_0 - tbb4py=2021.8.0=py311hdb19cb5_0 - tblib=1.7.0=pyhd3eb1b0_0 - tenacity=8.2.2=py311h06a4308_0 - terminado=0.17.1=py311h06a4308_0 - text-unidecode=1.3=pyhd3eb1b0_0 - textdistance=4.2.1=pyhd3eb1b0_0 - threadpoolctl=2.2.0=pyh0d69192_0 - three-merge=0.1.1=pyhd3eb1b0_0 - tifffile=2021.7.2=pyhd3eb1b0_2 - tinycss2=1.2.1=py311h06a4308_0 - tk=8.6.12=h1ccaba5_0 - tldextract=3.2.0=pyhd3eb1b0_0 - tokenizers=0.13.2=py311he7d60b5_1 - toml=0.10.2=pyhd3eb1b0_0 - tomli=2.0.1=py311h06a4308_0 - tomlkit=0.11.1=py311h06a4308_0 - toolz=0.12.0=py311h06a4308_0 - tornado=6.2=py311h5eee18b_0 - tqdm=4.65.0=py311h92b7b1e_0 - traitlets=5.7.1=py311h06a4308_0 - transformers=4.29.2=py311h06a4308_0 - twisted=22.10.0=py311h5eee18b_0 - typing-extensions=4.6.3=py311h06a4308_0 - typing_extensions=4.6.3=py311h06a4308_0 - tzdata=2023c=h04d1e81_0 - uc-micro-py=1.0.1=py311h06a4308_0 - ujson=5.4.0=py311h6a678d5_0 - unidecode=1.2.0=pyhd3eb1b0_0 - unixodbc=2.3.11=h5eee18b_0 - utf8proc=2.6.1=h27cfd23_0 - w3lib=1.21.0=pyhd3eb1b0_0 - watchdog=2.1.6=py311h06a4308_0 - wcwidth=0.2.5=pyhd3eb1b0_0 - webencodings=0.5.1=py311h06a4308_1 - websocket-client=0.58.0=py311h06a4308_4 - werkzeug=2.2.3=py311h06a4308_0 - whatthepatch=1.0.2=py311h06a4308_0 - wheel=0.38.4=py311h06a4308_0 - widgetsnbextension=4.0.5=py311h06a4308_0 - wrapt=1.14.1=py311h5eee18b_0 - wurlitzer=3.0.2=py311h06a4308_0 - xarray=2022.11.0=py311h06a4308_0 - xxhash=0.8.0=h7f8727e_3 - xyzservices=2022.9.0=py311h06a4308_1 - xz=5.4.2=h5eee18b_0 - y-py=0.5.9=py311h52d8a92_0 - yaml=0.2.5=h7b6447c_0 - yaml-cpp=0.7.0=h295c915_1 - yapf=0.31.0=pyhd3eb1b0_0 - yarl=1.8.1=py311h5eee18b_0 - ypy-websocket=0.8.2=py311h06a4308_0 - zeromq=4.3.4=h2531618_0 - zfp=0.5.5=h295c915_6 - zict=2.2.0=py311h06a4308_0 - zipp=3.11.0=py311h06a4308_0 - zlib=1.2.13=h5eee18b_0 - zlib-ng=2.0.7=h5eee18b_0 - zope=1.0=py311h06a4308_1 - zope.interface=5.4.0=py311h5eee18b_0 - zstandard=0.19.0=py311h5eee18b_0 - zstd=1.5.5=hc292b87_0 - pip: - backoff==2.2.1 - deprecated==1.2.14 - googleapis-common-protos==1.62.0 - keyring==23.4.1 - keyrings-alt==3.1 - opentelemetry-api==1.21.0 - opentelemetry-exporter-otlp-proto-common==1.21.0 - opentelemetry-exporter-otlp-proto-http==1.21.0 - opentelemetry-proto==1.21.0 - opentelemetry-sdk==1.21.0 - opentelemetry-semantic-conventions==0.42b0 - protobuf==4.25.1 - synapseclient==3.2.0 - urllib3==1.26.18 prefix: /storage/minminluo/software/anaconda3 (base) minminluo@Victor ~/DATA/tmp $ pip list Package Version ---------------------------------------- --------------- aiobotocore 2.5.0 aiofiles 22.1.0 aiohttp 3.8.3 aioitertools 0.7.1 aiosignal 1.2.0 aiosqlite 0.18.0 alabaster 0.7.12 anaconda-catalogs 0.2.0 anaconda-client 1.11.3 anaconda-navigator 2.4.2 anaconda-project 0.11.1 anyio 3.5.0 appdirs 1.4.4 argon2-cffi 21.3.0 argon2-cffi-bindings 21.2.0 arrow 1.2.3 astroid 2.14.2 astropy 5.1 asttokens 2.0.5 async-timeout 4.0.2 atomicwrites 1.4.0 attrs 22.1.0 Automat 20.2.0 autopep8 1.6.0 Babel 2.11.0 backcall 0.2.0 backoff 2.2.1 backports.functools-lru-cache 1.6.4 backports.tempfile 1.0 backports.weakref 1.0.post1 bcrypt 3.2.0 beautifulsoup4 4.12.2 binaryornot 0.4.4 black 0.0 bleach 4.1.0 bokeh 3.1.1 boltons 23.0.0 botocore 1.29.76 Bottleneck 1.3.5 brotlipy 0.7.0 certifi 2023.5.7 cffi 1.15.1 chardet 4.0.0 charset-normalizer 2.0.4 click 8.0.4 cloudpickle 2.2.1 clyent 1.2.2 colorama 0.4.6 colorcet 3.0.1 comm 0.1.2 conda 23.5.2 conda-build 3.25.0 conda-content-trust 0.1.3 conda_index 0.2.3 conda-libmamba-solver 23.5.0 conda-pack 0.6.0 conda-package-handling 2.1.0 conda_package_streaming 0.8.0 conda-repo-cli 1.0.41 conda-token 0.4.0 conda-verify 3.4.2 constantly 15.1.0 contourpy 1.0.5 cookiecutter 1.7.3 cryptography 39.0.1 cssselect 1.1.0 cycler 0.11.0 cytoolz 0.12.0 daal4py 2023.1.1 dask 2023.6.0 datasets 2.12.0 datashader 0.15.0 datashape 0.5.4 debugpy 1.5.1 decorator 5.1.1 defusedxml 0.7.1 Deprecated 1.2.14 diff-match-patch 20200713 dill 0.3.6 distributed 2023.6.0 docstring-to-markdown 0.11 docutils 0.18.1 entrypoints 0.4 et-xmlfile 1.1.0 executing 0.8.3 fastjsonschema 2.16.2 filelock 3.9.0 flake8 6.0.0 Flask 2.2.2 fonttools 4.25.0 frozenlist 1.3.3 fsspec 2023.4.0 future 0.18.3 gensim 4.3.0 glob2 0.7 gmpy2 2.1.2 googleapis-common-protos 1.62.0 greenlet 2.0.1 h5py 3.7.0 HeapDict 1.0.1 holoviews 1.16.2 huggingface-hub 0.15.1 hvplot 0.8.4 hyperlink 21.0.0 idna 3.4 imagecodecs 2021.8.26 imageio 2.31.1 imagesize 1.4.1 imbalanced-learn 0.10.1 importlib-metadata 6.0.0 incremental 21.3.0 inflection 0.5.1 iniconfig 1.1.1 intake 0.6.8 intervaltree 3.1.0 ipykernel 6.19.2 ipython 8.12.0 ipython-genutils 0.2.0 ipywidgets 8.0.4 isort 5.9.3 itemadapter 0.3.0 itemloaders 1.0.4 itsdangerous 2.0.1 jaraco.classes 3.2.1 jedi 0.18.1 jeepney 0.7.1 jellyfish 0.9.0 Jinja2 3.1.2 jinja2-time 0.2.0 jmespath 0.10.0 joblib 1.2.0 json5 0.9.6 jsonpatch 1.32 jsonpointer 2.1 jsonschema 4.17.3 jupyter 1.0.0 jupyter_client 8.1.0 jupyter-console 6.6.3 jupyter_core 5.3.0 jupyter-events 0.6.3 jupyter_server 2.5.0 jupyter_server_fileid 0.9.0 jupyter_server_terminals 0.4.4 jupyter_server_ydoc 0.8.0 jupyter-ydoc 0.2.4 jupyterlab 3.6.3 jupyterlab-pygments 0.1.2 jupyterlab_server 2.22.0 jupyterlab-widgets 3.0.5 keyring 23.4.1 keyrings.alt 3.1 kiwisolver 1.4.4 lazy_loader 0.2 lazy-object-proxy 1.6.0 libarchive-c 2.9 libmambapy 1.4.1 linkify-it-py 2.0.0 llvmlite 0.40.0 lmdb 1.4.1 locket 1.0.0 lxml 4.9.1 lz4 4.3.2 Markdown 3.4.1 markdown-it-py 2.2.0 MarkupSafe 2.1.1 matplotlib 3.7.1 matplotlib-inline 0.1.6 mccabe 0.7.0 mdit-py-plugins 0.3.0 mdurl 0.1.0 mistune 0.8.4 mkl-fft 1.3.6 mkl-random 1.2.2 mkl-service 2.4.0 more-itertools 8.12.0 mpmath 1.2.1 msgpack 1.0.3 multidict 6.0.2 multipledispatch 0.6.0 multiprocess 0.70.14 munkres 1.1.4 mypy-extensions 0.4.3 navigator-updater 0.4.0 nbclassic 0.5.5 nbclient 0.5.13 nbconvert 6.5.4 nbformat 5.7.0 nest-asyncio 1.5.6 networkx 2.8.4 nltk 3.7 notebook 6.5.4 notebook_shim 0.2.2 numba 0.57.0 numexpr 2.8.4 numpy 1.24.3 numpydoc 1.5.0 openpyxl 3.0.10 opentelemetry-api 1.21.0 opentelemetry-exporter-otlp-proto-common 1.21.0 opentelemetry-exporter-otlp-proto-http 1.21.0 opentelemetry-proto 1.21.0 opentelemetry-sdk 1.21.0 opentelemetry-semantic-conventions 0.42b0 packaging 23.0 pandas 1.5.3 pandocfilters 1.5.0 panel 1.1.0 param 1.13.0 parsel 1.6.0 parso 0.8.3 partd 1.2.0 pathlib 1.0.1 pathspec 0.10.3 patsy 0.5.3 pep8 1.7.1 pexpect 4.8.0 pickleshare 0.7.5 Pillow 9.4.0 pip 23.1.2 pkginfo 1.9.6 platformdirs 2.5.2 plotly 5.9.0 pluggy 1.0.0 ply 3.11 pooch 1.4.0 poyo 0.5.0 prometheus-client 0.14.1 prompt-toolkit 3.0.36 Protego 0.1.16 protobuf 4.25.1 psutil 5.9.0 ptyprocess 0.7.0 pure-eval 0.2.2 py-cpuinfo 8.0.0 pyarrow 11.0.0 pyasn1 0.4.8 pyasn1-modules 0.2.8 pycodestyle 2.10.0 pycosat 0.6.4 pycparser 2.21 pyct 0.5.0 pycurl 7.45.2 PyDispatcher 2.0.5 pydocstyle 6.3.0 pyerfa 2.0.0 pyflakes 3.0.1 Pygments 2.15.1 PyJWT 2.4.0 pylint 2.16.2 pylint-venv 2.3.0 pyls-spyder 0.4.0 pyodbc 4.0.34 pyOpenSSL 23.0.0 pyparsing 3.0.9 PyQt5-sip 12.11.0 pyrsistent 0.18.0 PySocks 1.7.1 pytest 7.3.1 python-dateutil 2.8.2 python-json-logger 2.0.7 python-lsp-black 1.2.1 python-lsp-jsonrpc 1.0.0 python-lsp-server 1.7.2 python-slugify 5.0.2 python-snappy 0.6.1 pytoolconfig 1.2.5 pytz 2022.7 pyviz-comms 2.3.0 PyWavelets 1.4.1 pyxdg 0.27 PyYAML 6.0 pyzmq 25.1.0 QDarkStyle 3.0.2 qstylizer 0.2.2 QtAwesome 1.2.2 qtconsole 5.4.2 QtPy 2.2.0 queuelib 1.5.0 regex 2022.7.9 requests 2.29.0 requests-file 1.5.1 requests-toolbelt 0.9.1 responses 0.13.3 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rope 1.7.0 Rtree 1.0.1 ruamel.yaml 0.17.21 ruamel-yaml-conda 0.17.21 s3fs 2023.4.0 sacremoses 0.0.43 scikit-image 0.20.0 scikit-learn 1.2.2 scikit-learn-intelex 20230426.111612 scipy 1.10.1 Scrapy 2.8.0 seaborn 0.12.2 SecretStorage 3.3.1 Send2Trash 1.8.0 service-identity 18.1.0 setuptools 67.8.0 sip 6.6.2 six 1.16.0 smart-open 5.2.1 sniffio 1.2.0 snowballstemmer 2.2.0 sortedcontainers 2.4.0 soupsieve 2.4 Sphinx 5.0.2 sphinxcontrib-applehelp 1.0.2 sphinxcontrib-devhelp 1.0.2 sphinxcontrib-htmlhelp 2.0.0 sphinxcontrib-jsmath 1.0.1 sphinxcontrib-qthelp 1.0.3 sphinxcontrib-serializinghtml 1.1.5 spyder 5.4.3 spyder-kernels 2.4.3 SQLAlchemy 1.4.39 stack-data 0.2.0 statsmodels 0.13.5 sympy 1.11.1 synapseclient 3.2.0 tables 3.8.0 tabulate 0.8.10 TBB 0.2 tblib 1.7.0 tenacity 8.2.2 terminado 0.17.1 text-unidecode 1.3 textdistance 4.2.1 threadpoolctl 2.2.0 three-merge 0.1.1 tifffile 2021.7.2 tinycss2 1.2.1 tldextract 3.2.0 tokenizers 0.13.2 toml 0.10.2 tomli 2.0.1 tomlkit 0.11.1 toolz 0.12.0 torch 2.0.1 tornado 6.2 tqdm 4.65.0 traitlets 5.7.1 transformers 4.29.2 Twisted 22.10.0 typing_extensions 4.6.3 uc-micro-py 1.0.1 ujson 5.4.0 Unidecode 1.2.0 urllib3 1.26.18 w3lib 1.21.0 watchdog 2.1.6 wcwidth 0.2.5 webencodings 0.5.1 websocket-client 0.58.0 Werkzeug 2.2.3 whatthepatch 1.0.2 wheel 0.38.4 widgetsnbextension 4.0.5 wrapt 1.14.1 wurlitzer 3.0.2 xarray 2022.11.0 xxhash 2.0.2 xyzservices 2022.9.0 y-py 0.5.9 yapf 0.31.0 yarl 1.8.1 ypy-websocket 0.8.2 zict 2.2.0 zipp 3.11.0 zope.interface 5.4.0 zstandard 0.19.0 (base) minminluo@Victor ~/DATA/tmp $ openssl version OpenSSL 1.1.1u 30 May 2023 (base) minminluo@Victor ~/DATA/yufengting $ df -k . Filesystem 1K-blocks Used Available Use% Mounted on /dev/sdb1 38910957764 33522024844 3435542384 91% /storage (base) minminluo@Victor ~/DATA/yufengting $ df -kh . Filesystem Size Used Avail Use% Mounted on /dev/sdb1 37T 32T 3.2T 91% /storage (base) minminluo@Victor ~/DATA/yufengting $ cat /proc/cpuinfo | grep processor | wc -l 52 (base) minminluo@Victor ~/DATA/yufengting $ python3 --version Python 3.11.3 (base) minminluo@Victor ~/DATA/yufengting $ synapse --version Synapse Client 3.2.0 ```
Please help!

Created by minmin luo minminluo
Hi, Thank you for your aid. However, I consulted our network office, they said they have NOT blocked any of the IP in the list. Anyway, they set another channel specificly for these IPs, and we are trying again. I was wondering is there any parameter I could use to resume the download once it failed. Just like when I use wget, there is -c or --continue, which could resume getting a partially-downloaded file. Or should I retype 'synapse get syn52404044' in the same folder and it will automatically resume the download? thanks.
Hi @minminluo , Thanks for the information. I ran the command on my computer and was able to download the file. That rules out the file being corrupted on Synapse. May I ask if you are on an institution network? If so, is it possible that one of these IP addressed are blocked by your institution? https://help.synapse.org/docs/Synapse-Infrastructure.2835382273.html. Sorry for the inconvenience! Best, Tom
Hi, I tried the new parameter 'get syn52404044'. But still failed.
first try with 'synapse get syn52404044' (base) minminluo@Victor ~/DATA/yufengting $ synapse get syn52404044 Downloading [--------------------]0.06% 8.0MB/12.3GB (107.1kB/s) D19-12513.po Downloading [--------------------]0.06% 8.0MB/12.3GB (108.8kB/s) D19-12513.po Downloading [--------------------]0.13% 16.0MB/12.3GB (202.3kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (299.7kB/s) D19-12513.p Downloading [--------------------]0.06% 8.0MB/12.3GB (112.8kB/s) D19-12513.po Downloading [--------------------]0.13% 16.0MB/12.3GB (215.5kB/s) D19-12513.p Downloading [--------------------]0.06% 8.0MB/12.3GB (97.3kB/s) D19-12513.pos Downloading [--------------------]0.13% 16.0MB/12.3GB (180.3kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (267.8kB/s) D19-12513.p Downloading [--------------------]0.06% 8.0MB/12.3GB (103.9kB/s) D19-12513.po Downloading [--------------------]0.13% 16.0MB/12.3GB (206.3kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (297.8kB/s) D19-12513.p Downloading [--------------------]0.25% 32.0MB/12.3GB (388.7kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 caused by SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again.
Because it says 'please try again', so I tried again.
Second try with ' synapse get syn52404044 ' (base) minminluo@Victor ~/DATA/yufengting $ synapse get syn52404044 Downloading [--------------------]0.06% 8.0MB/12.3GB (121.4kB/s) D19-12513.po Downloading [--------------------]0.06% 8.0MB/12.3GB (86.9kB/s) D19-12513.pos Downloading [--------------------]0.13% 16.0MB/12.3GB (173.4kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (250.5kB/s) D19-12513.p Downloading [--------------------]0.25% 32.0MB/12.3GB (324.4kB/s) D19-12513.p Downloading [--------------------]0.06% 8.0MB/12.3GB (102.8kB/s) D19-12513.po Downloading [--------------------]0.13% 16.0MB/12.3GB (197.8kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (281.9kB/s) D19-12513.p Downloading [--------------------]0.06% 8.0MB/12.3GB (92.5kB/s) D19-12513.pos Downloading [--------------------]0.06% 8.0MB/12.3GB (81.0kB/s) D19-12513.pos Downloading [--------------------]0.13% 16.0MB/12.3GB (159.1kB/s) D19-12513.p Downloading [--------------------]0.19% 24.0MB/12.3GB (233.7kB/s) D19-12513.p Downloading [--------------------]0.25% 32.0MB/12.3GB (310.0kB/s) D19-12513.p Downloading [--------------------]0.32% 40.0MB/12.3GB (382.4kB/s) D19-12513.p Downloading [--------------------]0.38% 48.0MB/12.3GB (455.2kB/s) D19-12513.p Downloading [--------------------]0.44% 56.0MB/12.3GB (527.2kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 caused by SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again.
This failed again. So I tried with '--debug'
result from 'synapse --debug get syn52404044' Downloading [--------------------]0.06% 8.0MB/12.3GB (91.8kB/s) D19-12513.posDownloading [--------------------]0.1 3% 16.0MB/12.3GB (175.2kB/s) D19-12513.pDownloading [--------------------]0.19% 24.0MB/12.3GB (262.5kB/s) D19-125 13.pDownloading [--------------------]0.25% 32.0MB/12.3GB (348.5kB/s) D19-12513.possorted_bam.bam.synapse_download_ 128421089 2024-01-09 17:35:23,402 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/downloa d_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again . The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 Downloading [--------------------]0.06% 8.0MB/12.3GB (97.8kB/s) D19-12513.posDownloading [--------------------]0.13% 16.0MB/12.3GB (188.5kB/s) D19-12513.pDownloading [--------------------]0.19% 24.0MB/12.3GB (280.1kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 2024-01-09 17:37:37,845 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 Downloading [--------------------]0.06% 8.0MB/12.3GB (90.5kB/s) D19-12513.posDownloading [--------------------]0.13% 16.0MB/12.3GB (173.6kB/s) D19-12513.pDownloading [--------------------]0.19% 24.0MB/12.3GB (253.8kB/s) D19-12513.pDownloading [--------------------]0.25% 32.0MB/12.3GB (336.7kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 2024-01-09 17:41:46,080 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 Downloading [--------------------]0.06% 8.0MB/12.3GB (100.0kB/s) D19-12513.poDownloading [--------------------]0.13% 16.0MB/12.3GB (190.8kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 2024-01-09 17:43:56,527 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 Downloading [--------------------]0.06% 8.0MB/12.3GB (116.9kB/s) D19-12513.possorted_bam.bam.synapse_download_128421089 2024-01-09 17:46:12,383 [client:2655 - DEBUG]: Retrying download on error: [] after progressing 0 bytes Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089 Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 366, in _get_response_with_retry raise SynapseError( synapseclient.core.exceptions.SynapseError: Could not download the file: D19-12513.possorted_bam.bam, please try again. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/storage/minminluo/software/anaconda3/bin/synapse", line 8, in sys.exit(main()) ^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/__main__.py", line 1889, in main perform_main(args, syn) File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/__main__.py", line 1754, in perform_main args.func(args, syn) File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/__main__.py", line 147, in get entity = syn.get( ^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 977, in get return_data = self._getWithEntityBundle( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 1136, in _getWithEntityBundle self._download_file_entity( File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 1232, in _download_file_entity downloadPath = self._downloadFileHandle( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2631, in _downloadFileHandle downloaded_path = self._download_from_url_multi_threaded( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/contextlib.py", line 81, in inner return func(*args, **kwds) ^^^^^^^^^^^^^^^^^^^ File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/client.py", line 2682, in _download_from_url_multi_threaded multithread_download.download_file(self, request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 247, in download_file downloader.download_file(download_request) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 323, in download_file self._check_for_errors(request, completed_futures) File "/storage/minminluo/software/anaconda3/lib/python3.11/site-packages/synapseclient/core/multithread_download/download_threads.py", line 426, in _check_for_errors raise ValueError( ValueError: Failed downloading syn52404044 to /storage/minminluo/yufengting/D19-12513.possorted_bam.bam.synapse_download_128421089
it is kind of the same like before. Just telling 'Could not download the file'. Please let me know what i can do to fix this.
Hello @minminluo , Sorry for the trouble! Could you try and download one file and let me know the results? ``` synapse get syn52404044 ``` Similarly, I notice that you are using your password to login still, please follow instructions [here](https://python-docs.synapse.org/tutorials/authentication/) to leverage a personal access token. Using your password will stop your download after a small period of time (~12 hours) as your session will expire. Best, Tom

Synapse client keep failing download page is loading…