...
At present M100 login nodes are offline, so you need to resort to the sftp command to explore M100 filesystem. For instance:
$ sftp fcola000@data.m100.cineca.it:/m100_scratch/userinternal/fcola000/
Connected to data.m100.cineca.it.
Changing to: /m100_scratch/userinternal/fcola000/
sftp> cd cuda
sftp> ls -l
drwxr-xr-x 3 fcola000 interactive 4096 Feb 11 2021 targets
sftp> pwd
Remote working directory: /m100_scratch/userinternal/fcola000/cuda
sftp> sftp>
Available transfer tools
rsync
...
Sometimes, the 10-minute CPU time limit or the 4-hour wall time limit on the serial queue are is not enough to download a large dataset for ML. In this case, you can use wget from the datamover. Here you can find a simple example
...
Sometimes, the 10-minute CPU time limit or the 4-hour wall time limit on the serial queue are is not enough to download a large dataset for ML. In this case, you can use curl from the datamover. Here you can find a simple example
...
Please note that authentication via ssh certificate is not available on Globus online