Data Transfer/All Data Transfer Routes

All Data Transfer Routes

The following tables provide a full overview on the various transfer options depending on the system that you are coming from and the system you want to transfer your data to. The recommended options are marked in the table with W(indows)/M(acOS)/L(inux) added next to the '✓' sign.
'[✓]' means that this option is possible but might be the worst choice of the given ones.

Copy and Sync via commandline

Protocol/Tool	Underlying network protocol	Description/When to use	Executable on					Transfer from/to
			Linux	MacOS	Windows	bwUni Cluster	bwFor Cluster	bwHPC Cluster	SDS@hd
Rclone + <protocol>	sftp, smb, WebDAV, ...	A tool that can be used with various protocols. It needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data. Please refer to the marked recommendations when deciding on a network protocol to use with Rclone.	✓	✓	✓	✓	✓	only on BinAC	✓
WebDAV	http(s)	Fast with small data, not suitable for big data.	✓	✓	✓	✓	✓	☓	✓
rsync	ssh	Synchronization of data. One side must be a local drive. Can spot differences in files and transfer only the changes. Can resume partial transfers.	✓	✓	[✓]	✓	✓	✓	☓
sftp	ssh	Interactive shell for copying data	✓	[✓]	✓	✓	✓	✓	✓
scp	ssh	For copying data. Outdated according to: https://www.openssh.com/txt/release-8.0	[✓]	[✓]	[✓]	[✓]	[✓]	[✓]	☓

Mounting via commandline

Protocol/Tool	Underlying network protocol	Description & Use Cases	Executable on				Transfer from/to
			Linux	MacOS	Windows	bwHPC	bwHPC	SDS@hd
Rclone mount + <protocol>	sftp, smb, WebDAV, ...	See previous table	✓	✓	✓	✓	☓	✓
sshfs	see sftp	File system using sftp, simple usage, needs stable connections, can't resume partial transfers	✓	[✓]	✓	☓	✓ ( L, M )	✓
smb	none	Mapping of a network drive. Multiuser possible. Good fit for big data.	✓	✓	✓	☓	☓	✓ (M, W, L)
NFSv4	none	One-time installation effort (Kerberos, ID mapping). For servers, microscopes, multi-user environments, ...	✓	☓	☓	☓	☓	✓

Graphical User Interfaces (GUIs)

GUIs	Underlying network protocols	Description & Use Cases	Executable on				Transfer from/to
			Linux	MacOS	Windows	bwHPC	bwHPC	SDS@hd
JupyterLab	ssh	Development Environment	✓	✓	✓	✓	✓	✓
VS Code	ssh	Development Environment	✓	✓	✓	✓	✓	✓
RStudio	ssh	Development Environment	✓	✓	✓	✓	✓	✓
MobaXterm	ssh, RSync, sftp		☓	☓	✓	☓	✓ ( W )	✓
WinSCP	sftp, WebDAV, scp		☓	☓	✓	☓	✓	✓
Filezilla	sftp		✓	✓	✓	☓	✓	✓
Cyberduck	sftp, WebDAV, S3		☓	✓	✓	☓	✓	✓
WebDAV via browser	WebDAV	download single files	✓	✓	✓	☓	☓	✓