--- title: Transferring Data #tags: #keywords: last_updated: 9 July 2019 #summary: "" sidebar: merlin6_sidebar permalink: /merlin6/transfer-data.html --- ## Transferring Data from the PSI Network to/from Merlin6 ### Rsync Rsync is the preferred method to transfer data from Linux/MacOS. It allows transfers to be easily resumed if they get interrupted. The general syntax is: ``` rsync -avAHXS ``` For example, to transfer files from your local computer to a merlin project directory: ``` rsync -avAHXS ~/localdata user@merlin-l-01.psi.ch:/data/project/general/myproject/ ``` You can resume interrupted transfers by simply rerunning the command. Previously transferred files will be skipped. ### WinSCP The WinSCP tool can be used for remote file transfer on Windows. It is available from the Software Kiosk on PSI machines. Add `merlin-l-01.psi.ch` as a host and connect with your PSI credentials. You can then drag-and-drop files between your local computer and merlin. ## Transferring Data to/from outside PSI Two servers are enabled for exporting data from Merlin to outside PSI. These Remote Access Merlin servers are the following: * **'ra-merlin-01.psi.ch'** * **'ra-merlin-02.psi.ch'** Due to security reasons, currently only ``/data/user`` directories are exported in Read-Only mode. This policy will change in the future but in the meantime we allow users to export their files in an easy way. {{site.data.alerts.warning}}Please, ensure proper secured permissions in your '/data/user' directory. By default, when directory is created, the system applies the most restrictive permissions. However, this does not prevent users for changing permissions if they wish. At this point, users become responsible of those changes. {{site.data.alerts.end}} Transferring big amounts of data from outside PSI to Merlin is not possible yet, unless this is done from PSI (i.e. transferring files from CSCS to Merlin is possible by using `scp` / `rsync` commands from the Merlin6 login nodes). ### Accepted protocols Accepted protocols for Remote Access Merlin servers are the following: * **sftp**: **``sftp``** command or similar X11/Windows/MacOS based programs. * **ssh**: **`scp`** command (as well as **WinSCP** and similar programs) or **`rsync`** command * **~~Globus Online~~**: ***not available yet.*** ### About Remote Access Servers SSH is one of the allowed protocols. * Please, **absolutely never** use this servers as a login node. * Please avoid copying files to the *home* directories. Only ``/data/user`` should be used on these nodes, and exclusively for transferring data to outside PSI. ## Connecting to Merlin6 from outside PSI Merlin6 is fully accessible from within the PSI network. To connect from outside you can use: - [VPN](https://www.psi.ch/en/computing/vpn) ([alternate instructions](https://intranet.psi.ch/BIO/ComputingVPN)) - [SSH hop](https://www.psi.ch/en/computing/ssh-hop) * Please avoid transferring big amount data through **hop** - [No Machine](nomachine.md) * Remote Interactive Access through [**'rem-acc.psi.ch'**](https://www.psi.ch/en/photon-science-data-services/remote-interactive-access) * Please avoid transferring big amount of data through **NoMachine**