Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Transfer data between 2 CINECA HPC clusters


  $ globus-url-copy -vb -cd -r sshftp://<username>@gftp.<cluster_name_1>.cineca.it:22/absolute/path/from/directory/directory   sshftp://<username>@gftp.<cluster_name_2>.cineca.it:22/absolute/path/to/
  $ globus-url-copy -vb -cd -r gsiftp://<username>@gftp.<cluster_name_1>.cineca.it:2811/absolute/path/from/directory/directory   gsiftp://<username>@gftp.<cluster_name_2>.cineca.it:2811/absolute/path/to/

...

Transfer data FROM/TO local machine TO/FROM a CINECA HPC cluster


   $ globus-url-copy -vb -cd -r /absolute/path/from/directory directory/  sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/to/
$ globus-url-copy -vb -cd -r /absolute/path/from/directory/directory   gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/to/

$ globus-url-copy -vb -cd -r sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/from/directory/ /absolute/path/to/
$ globus-url-copy -vb -cd -r gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/from/directory/ /absolute/path/to/

It is also possible to use globus-url-copy to transfer data FROM/TO another HPC site TO/FORM an HPC CINECA cluster. Here you can find the complete list of all the possibilities. You can use both protocols, gsiftp or sshftp, it depends on the cluster/site configuration. For example, it is not possible to use gsiftp protocol on Leonardo.

    $ globus-url-copy -vb -cd -r gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/from/directory/   gsiftp://<username>@<other cluter endpoint>:2811/absolute/path/to/directory/
$
globus-url-copy -vb -cd -r sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/from/directory/ gsiftp://<username>@<other cluter endpoint>:2811/absolute/path/to/directory/
$ globus-url-copy -vb -cd -r sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/from/directory/ sshftp://<username>@<other cluter endpoint>:22/absolute/path/to/directory/
$ globus-url-copy -vb -cd -r gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/from/directory/ sshftp://<username>@<other cluter endpoint>:22/absolute/path/to/directory/

$ globus-url-copy -vb -cd -r gsiftp://<username>@<other cluter endpoint>:2811/absolute/path/from/directory/ gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/to/directory/
$ globus-url-copy -vb -cd -r sshftp://<username>@<other cluter endpoint>:22/absolute/path/from/directory/   gsiftp://<username>@gftp.<cluster_name>.cineca.it:2811/absolute/path/to/directory/
$ globus-url-copy -vb -cd -r sshftp://<username>@<other cluter endpoint>:22/absolute/path/from/directory/     sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/to/directory/
$ globus-url-copy -vb -cd -r gsiftp://<username>@<other cluter endpoint>:2811/absolute/path/from/directory/ sshftp://<username>@gftp.<cluster_name>.cineca.it:22/absolute/path/to/directory/

...