...
First of all, on datamovers, there is no CPU time limit, that allows long data transfers. Unlike, on login nodes, there is a 10-minute of CPU time limit that usually interrupts the transfer of a large amount of data.
By construction, the shell is not available, so it is not possible to open interactive sessions. In other words you cannot connect directly to the datamover via SSH. The only available commands are scp, rsync, sftp, wget, and curl. For security reasons, the shell is not available, and it is not possible to open interactive sessions.
Like the login nodes
However, the authentication is still based on SSH protocol. There are only 2 possible authentication methods:
- publickey: it only accepts valid SSH certificates, obtained via 2-Factor Authentication. No private/public keys generated in other ways are accepted.
- hostbased: if you are already logged into a CINECA HPC cluster and try to use a datamover from a login node, the SSH daemon on the datamover recognizes you are already authenticated on a CINECA HPC cluster and that is enough.
Remark: The host-based authentication does is not work enabled inside a job batch. If you want to use a datamover inside a job batch you have to copy a valid 2FA SSH certificate inside your ~/.ssh directory .on the cluster where you are submitting the job batch.
Important: When you are authenticated Finally, when you authenticate yourself on a datamover, you will land on a fake home directory, /home, which is not your true $HOME directory. You can check using sftp, e.g. "sftp <username>@data.leonardo.cineca.it: "
This behavior the environment variables $HOME, $WORK and $CINECA_SCRATCH (as well as ~ ) are not defined.
This property has 2 side effects:
- if you want to transfer files FROM/TO your $HOME directory cluster personal areas, you have to specify the absolute path, the same is true for your $WORK, $CINECA_SCRATCH filesystems of them.
- You cannot make use of the SSH configuration files stored in your remote ~/.ssh/ directory (~such as $HOME/.ssh/config).
Listing Directory via sftp
...