I was wondering if there is a way to download a specific file of the trees directory. The comand suggested for downloading the Sublink tree files in te example scripts is:
wget -nd -nc -nv -e robots=off -l 1 -r -A hdf5 --content-disposition --header="API-Key: KEY_HERE" "http://www.illustris-project.org/api/Illustris-3/files/sublink/?format=api"
For some reason, one of the tree files that i have downloaded, tree_extended.36.hdf5, is "truncated" ( IOError: Unable to open file (Truncated file: eof = 2048556, sblock->base_addr = 0, stored_eoa = 131671404). I started downloading again the full set of files again, because is the Ilustris-3 simulation. If this happens with the Illustris-1 could be more problematic. Is there a comand to download only the tree_extended.36.hdf5 file? changing the link : "http://www.illustris-project.org/api/Illustris-3/files/sublink/tree_extended.36.hdf5?format=api" doesn't work for me.
Many thanks in advance!
If you just click on the first link in your post, it shows you a page with individual links to each file. You could just click on one and download it, in your browser.
Or, you could do a wget like
wget --content-disposition --header="API-Key: KEY_HERE" http://www.illustris-project.org/api/Illustris-3/files/sublink.36.hdf5
Sorry for my late answer! But thanks! I didn't realize about the link! :/ .
Hi Dylan, Ignacio,
I have a related question: I'm trying to download individual snapshot files with:
wget --content-disposition --header="API-Key: f19b52bd8297b0cbb986b89efe99a378" "http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5"
As suggested on the page listing all individual files, but instead of initiating the download I'm stuck waiting for response:
Karen% wget --content-disposition --header="API-Key: f19b52bd8297b0cbb986b89efe99a378" "http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5"
--2016-07-29 10:27:02-- http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5
Resolving www.illustris-project.org (www.illustris-project.org)... 126.96.36.199
Connecting to www.illustris-project.org (www.illustris-project.org)|188.8.131.52|:80... connected.
HTTP request sent, awaiting response... 302 FOUND
Location: http://data.illustris-project.org/app/file/snapshot/L75n455FP/45/29/?token=5cd8962924f8a75ffe2e [following]
--2016-07-29 10:27:02-- http://data.illustris-project.org/app/file/snapshot/L75n455FP/45/29/?token=5cd8962924f8a75ffe2e
Resolving data.illustris-project.org (data.illustris-project.org)... 184.108.40.206
Connecting to data.illustris-project.org (data.illustris-project.org)|220.127.116.11|:80... connected.
HTTP request sent, awaiting response...
Am I doing something wrong or is there a connection problem at the moment?
Just a temporary hiccup on the server, should be working again now.
Please limit scripts to downloading 1 at a time (don't run 10 in parallel), it's going to cause more trouble than benefit.
Thanks - it's downloading now!