Springe direkt zu Inhalt

Data transfer

SCP

Data can be copied to and from the HPC system via the Secure Copy Protocol (SCP).

In general you will run scp from your a terminal on your own computer.  To copy from there to the HPC system run

scp <source file/directory> <username@curta.zedat.fu.berlin.de>:<target directory>

e.g.

scp submit.sh xyz123@curta.zedat.fu.berlin.de:~/scripts

Similarly you can copy in the other direction, from the HPC system to your compuer, e.g.

scp xzy123@curta.zedat.fu.berlin.de:/scratch/xyz123/results/out.txt ./results

You run the command above on your own computer.

SSHFS

SSHFS allows files which are on a remote computre to be connected to your computer in such a way that they appear to be local files. For that to function, the same conditions for logging in via Secure Shell (SSH) must be met, e.g. you must be in the FU network, directly or via VPN.

Linux and MacOS

If SSHFS is not already available, install the package as normal. On MacOS and many Linux  variants the packate is simply called sshfs, whereas on RedHat-based distributions, such as Fedora or CentOS, the package is called fuse-sshfs.

Create a directory on your computer in which you wish to access the data, say hpc_home. In a terminal window, also on your computer, mount your home-directory on the HPC system with the following command:

  sshfs YOUR_FU-ACCOUNTNAME@curta.zedat.fu-berlin.de:/home/YOUR_FU-ACCOUNTNAME hpc_home

Instead of YOUR_FU-ACCOUNTNAME please use your FU account name, which you also use for SSH connections.  Analogously you can create a further directory, say hpc_scratch, for the file system /scratch, and then mount the corresponding directory on the HPC system with 

  sshfs YOUR_FU-ACCOUNTNAME@curta.zedat.fu-berlin.de:/scratch/YOUR_FU-ACCOUNTNAME hpc_scratch

Windows

Follow the instructions for SSHFS-Win and install the packages winfsp and sshfs-win. You computuer must be directly in the FU network or connected via the FU VPN Software.  Via the file explorer under "This computer" you can select "Map Network Drives", enter the address

  \\sshfs\YOUR_FU-ACCOUNTNAME@curta.zedat.fu-berlin.de

and mount the directory locally by selecting an unused drive letter. Instead of YOUR_FU-ACCOUNTNAME please use your FU account name, which you also use for SSH connections. In the Windows shell you can also write, say

  net use U: \\sshfs\YOUR_FU-ACCOUNTNAME@curta.zedat.fu-berlin.de

if you want to use "U" as the drive letter.

Keywords