Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

We remind again that, on CINECA's cluster, the maximum cpu time available via the command line is 10 min. If your rsync connection will be killed after this time (i.e for big file >10 GB) and your transfer has not been completed execute again the same rsync command until the data transfer will be completed.

Dedicated node for Marconi100 and Galileo100

For Marconi100 and Galileo100 in order to avoid the 10 minutes limit we set up a dedicated VM accessible with a dedicated alias.
Login via ssh to this VM is not allowed. As a consequence you always have to explicitate the complete path to the files you need to copy. Environment variables as $HOME or $WORK are not recognized.
In this case you can use the command:

rsync -PravzHS </data_path_from/file> <your_username>@data.m100<cluster>.cineca.it:<complete_data_path_to>

where <cluster> can be m100 as Marconi100 or g100 as Galileo100.

In similar ways you can use also scp and sftp commands if you prefer them.

You can also use the data VM from M100 login nodes to move data from M100 or G100 to another location with public IP.

ssh -xt data.m100<cluster>.cineca.it rsync -PravzHS <complete_data_path_from/file> </data_path_to> 

...