Data Transfer/All Data Transfer Routes - Revision history

H Schumacher: Hinted that sshfs on Windows doesn't really work

2026-02-26T18:29:48Z

Hinted that sshfs on Windows doesn't really work

← Older revision		Revision as of 20:29, 26 February 2026
Line 113:		Line 113:
	\| ✓		\| ✓
	\| [✓]		\| [✓]
	\| ✓		\| [✓]
	\| ☓		\| ☓
	\| ✓ [[Data_Transfer/SSHFS#MacOS_&_Linux\|( L, M )]]		\| ✓ [[Data_Transfer/SSHFS#MacOS_&_Linux\|(only L, M )]]
	\| ✓		\| ✓
	\|-		\|-
Line 138:		Line 138:
	\| ✓		\| ✓
	\|}		\|}

	== Graphical User Interfaces (GUIs) ==		== Graphical User Interfaces (GUIs) ==

H Schumacher: format correction

2025-03-20T17:08:02Z

format correction

← Older revision		Revision as of 19:08, 20 March 2025
Line 6:		Line 6:
	== Copy and Sync via commandline ==		== Copy and Sync via commandline ==

	{\| class="wikitable"		{\| class="wikitable" style="vertical-align:middle;"
	\|- style="font-weight:bold; text-align:center~~; vertical-align:middle~~;"		\|- style="font-weight:bold; text-align:center;"
	! Protocol/Tool		! Protocol/Tool
	! Underlying network protocol		! Underlying network protocol
	! Description/When to use		! Description/When to use
	! Executable on		! Executable on
	!
	!		!
	!		!
Line 18:		Line 17:
	! Transfer from/to		! Transfer from/to
	!		!
			\|-
	\|- style="vertical-align:middle;"
	\|		\|
	\|		\|
Line 25:		Line 24:
	\| MacOS		\| MacOS
	\| Windows		\| Windows
		⚫	\| bwHPC
	\| bwUni Cluster
			\| bwHPC
	\| bwFor Cluster
⚫	\| bwHPC ~~Cluster~~
	\| [[SDS@hd\|SDS@hd]]		\| [[SDS@hd\|SDS@hd]]
	\|-		\|-
	\| [[Data_Transfer/Rclone\|Rclone]] + <protocol>		\| [[Data_Transfer/Rclone\|Rclone]] + <protocol>
	\| sftp, smb, WebDAV, ...		\| sftp, smb, WebDAV, ...
	\| A tool that can be used with various protocols. It needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data. Please refer to the marked recommendations when deciding on a network protocol to use with Rclone.		\| A tool that can be used with various protocols. It needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data. Please refer to the marked recommendations when deciding on a network protocol to use with Rclone.
Line 37:		Line 35:
	\| ✓		\| ✓
	\| ✓		\| ✓
			\| ☓
	\| ✓		\| ✓
			\|-
	\| only on BinAC
	\| ✓
	\|- style="vertical-align:middle;"
	\| [[Data_Transfer/WebDAV\|WebDAV]]		\| [[Data_Transfer/WebDAV\|WebDAV]]
	\| http(s)		\| http(s)
	\| Fast with small data, not suitable for big data.		\| Fast with small data, not suitable for big data.
	\| ✓
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 51:		Line 47:
	\| ☓		\| ☓
	\| ✓		\| ✓
			\|-
	\|- style="vertical-align:middle;"
	\| [[Data_Transfer/Rsync\|rsync]]		\| [[Data_Transfer/Rsync\|rsync]]
	\| ssh		\| ssh
Line 58:		Line 54:
	\| ✓		\| ✓
	\| [✓]		\| [✓]
	\| ✓
	\| ✓		\| ✓
	\| ✓		\| ✓
	\| ☓		\| ☓
			\|-
	\|- style="vertical-align:middle;"
	\| [[Data_Transfer/SFTP\|sftp]]		\| [[Data_Transfer/SFTP\|sftp]]
	\| ssh		\| ssh
Line 69:		Line 64:
	\| [[Data_Transfer/SFTP#MacOS_&_Linux\|[✓]]]		\| [[Data_Transfer/SFTP#MacOS_&_Linux\|[✓]]]
	\| [[Data_Transfer/SFTP#Windows\|✓]]		\| [[Data_Transfer/SFTP#Windows\|✓]]
	\| ✓
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 76:		Line 70:
	\| [[Data_Transfer/SCP\|scp]]		\| [[Data_Transfer/SCP\|scp]]
	\| ssh		\| ssh
	\| For copying data~~. Outdated according to: https://www.openssh.com/txt/release-8.0~~		\| For copying data
	\| [✓]
	\| [✓]		\| [✓]
	\| [✓]		\| [✓]

H Schumacher: Clarifying Rclone entries

2025-03-12T22:51:59Z

Clarifying Rclone entries

← Older revision		Revision as of 00:51, 13 March 2025
Line 1:		Line 1:
	= All Data Transfer Routes =		= All Data Transfer Routes =

	The following tables provide a full overview on the various transfer options depending on the system that you are coming from and the system you want to transfer your data to. The recommended options are marked in the table with '''W'''(indows)/'''M'''(acOS)/'''L'''(inux) added next to the '✓' sign.<br />		The following tables provide a full overview on the various transfer options depending on the system that you are coming from and the system you want to transfer your data to. <u>The recommended options are marked</u> in the table with '''W'''(indows)/'''M'''(acOS)/'''L'''(inux) added next to the '✓' sign.<br />
	'[✓]' means that this option is possible but might be the worst choice of the given ones.		'[✓]' means that this option is possible but might be the worst choice of the given ones.

Line 30:		Line 30:
	\| [[SDS@hd\|SDS@hd]]		\| [[SDS@hd\|SDS@hd]]
	\|-		\|-
	\| [[Data_Transfer/Rclone\|Rclone]]		\| [[Data_Transfer/Rclone\|Rclone]] + <protocol>
	\| ~~Depending on setup:~~ sftp~~(ssh)~~, smb, WebDAV~~(https)~~, ...		\| sftp, smb, WebDAV, ...
	\| A tool that needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data ~~(please~~ refer to the ~~information~~ ~~about~~ ~~the~~ ~~specific~~ ~~protocol~~ ~~that~~ ~~you~~ ~~are going~~ to use).		\| A tool that can be used with various protocols. It needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data. Please refer to the marked recommendations when deciding on a network protocol to use with Rclone.
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 41:		Line 41:
	\| ✓		\| ✓
	\|- style="vertical-align:middle;"		\|- style="vertical-align:middle;"
	\| [[Data_Transfer/WebDAV\|~~WebDav~~]] ~~(optimally used via [[Data_Transfer/Rclone\|Rclone]])~~		\| [[Data_Transfer/WebDAV\|WebDAV]]
	\| http(s)		\| http(s)
	\| Fast with small data, not suitable for big data.		\| Fast with small data, not suitable for big data.
Line 105:		Line 105:
	\| SDS@hd		\| SDS@hd
	\|-		\|-
	\| [[Data_Transfer/Rclone#Usage_Rclone_Mount\|Rclone mount]]		\| [[Data_Transfer/Rclone#Usage_Rclone_Mount\|Rclone mount]] + <protocol>
	\| sftp ~~(ssh)~~, smb, WebDAV ~~(https)~~, ...		\| sftp, smb, WebDAV, ...
	\| See previous table		\| See previous table
	\| ✓		\| ✓
Line 127:		Line 127:
	\| [[SDS@hd/Access/SMB\|smb]]		\| [[SDS@hd/Access/SMB\|smb]]
	\| none		\| none
	\| Mapping of a network drive, ~~multiuser~~ possible		\| Mapping of a network drive. Multiuser possible. Good fit for big data.
	\| ✓		\| ✓
	\| ✓		\| ✓

H Schumacher: Clarifying rclone information

2025-03-12T16:38:11Z

Clarifying rclone information

← Older revision		Revision as of 18:38, 12 March 2025
Line 8:		Line 8:
	{\| class="wikitable"		{\| class="wikitable"
	\|- style="font-weight:bold; text-align:center; vertical-align:middle;"		\|- style="font-weight:bold; text-align:center; vertical-align:middle;"
			! Protocol/Tool
	! Network protocol
	! Underlying network protocol		! Underlying network protocol
	! Description/When to use		! Description/When to use
Line 31:		Line 31:
	\|-		\|-
	\| [[Data_Transfer/Rclone\|Rclone]]		\| [[Data_Transfer/Rclone\|Rclone]]
	\| sftp(ssh), smb, WebDAV(https), ...		\| Depending on setup: sftp(ssh), smb, WebDAV(https), ...
	\| ~~Needs~~ ~~installation~~. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. ~~Suitable~~ for big data.		\| A tool that needs to be installed. Multithreaded. Works on two completely remote locations as well. Transfers whole files. No 2FA possible. Usually suitable for big data (please refer to the information about the specific protocol that you are going to use).
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 41:		Line 41:
	\| ✓		\| ✓
	\|- style="vertical-align:middle;"		\|- style="vertical-align:middle;"
	\| [[Data_Transfer/WebDAV\|WebDav]] via [[Data_Transfer/Rclone\|Rclone]]		\| [[Data_Transfer/WebDAV\|WebDav]] (optimally used via [[Data_Transfer/Rclone\|Rclone]])
	\| http(s)		\| http(s)
	\| Fast with small data, not suitable for big data.		\| Fast with small data, not suitable for big data.
Line 85:		Line 85:
	\| ☓		\| ☓
	\|}		\|}

	== Mounting via commandline ==		== Mounting via commandline ==
	{\| class="wikitable" style="vertical-align:middle;"		{\| class="wikitable" style="vertical-align:middle;"

S Braun: /* Graphical User Interfaces (GUIs) */

2025-02-25T09:18:48Z

Graphical User Interfaces (GUIs)

← Older revision		Revision as of 11:18, 25 February 2025
Line 174:		Line 174:
	\| ✓		\| ✓
	\|-		\|-
			\| [[Development/VS_Code\|VS Code]]
	\| VSCode
	\| ssh		\| ssh
	\| Development Environment		\| Development Environment

H Schumacher: content changes

2025-02-25T09:07:29Z

content changes

Show changes

H Schumacher: corrected links

2024-12-03T00:33:48Z

corrected links

← Older revision		Revision as of 02:33, 3 December 2024
Line 81:		Line 81:
	\| ssh		\| ssh
	\| Interactive shell for copying data		\| Interactive shell for copying data
		⚫	\| [[Data_Transfer/SFTP#MacOS_&_Linux\|✓]]
	\| [✓](sftp-linux-mac)
		⚫	\| [[Data_Transfer/SFTP#MacOS_&_Linux\|✓]]
	\| [✓](sftp-linux-mac)
		⚫	\| [[Data_Transfer/SFTP#Windows\|✓]]
	\| [[✓]](sftp-windows)
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 140:		Line 140:
	\| none		\| none
	\| Mapping of a network drive		\| Mapping of a network drive
			\| [[SDS@hd/Access/SMB#Linux\|L]]
	\| [[✓]](smb-linux)
	\| ✓		\| ✓
	\| ✓		\| ✓
Line 146:		Line 146:
	\| ☓		\| ☓
	\| ☓		\| ☓
			\| ✓ ([[SDS@hd/Access/SMB#Mac\|M]], [[SDS@hd/Access/SMB#Windows\|W]])
	\| ✓ ([M](smb-mac), [W](smb-windows))
	\|-		\|-
	\| [[SDS@hd/Access/NFS#Using_NFSv4_for_UNIX_client\|~~nfs~~]]		\| [[SDS@hd/Access/NFS#Using_NFSv4_for_UNIX_client\|NFSv4]]
	\| none		\| none
	\| One-time installation effort (Kerberos, ID mapping). For servers, microscopes, multi-user environments, ...		\| One-time installation effort (Kerberos, ID mapping). For servers, microscopes, multi-user environments, ...
Line 157:		Line 157:
	\| ☓		\| ☓
	\| ☓		\| ☓
	\| ✓
	\|-
	\| [[Data_Transfer/SFTP\|sftp]]
	\| ssh
	\| Interactive shell for copying data
⚫	\| [[Data_Transfer/SFTP#MacOS_&_Linux\|✓]]
⚫	\| [[Data_Transfer/SFTP#MacOS_&_Linux\|✓]]
⚫	\| [[Data_Transfer/SFTP#Windows\|✓]]
	\| ✓
	\| ✓
	\| ✓
	\| ✓		\| ✓
	\|}		\|}
Line 196:		Line 185:
	\| SDS@hd		\| SDS@hd
	\|-		\|-
	\| [[Data_Transfer/MobaXterm\|MobaXterm]]		\| [[Data_Transfer/Graphical_Clients#MobaXterm\|MobaXterm]]
	\| SSH, RSync, SFTP		\| SSH, RSync, SFTP
	\|		\|
Line 204:		Line 193:
	\| ☓		\| ☓
	\| ☓		\| ☓
	\| ✓ [[Data_Transfer/MobaXterm\|( W )]]		\| ✓ [[Data_Transfer/Graphical_Clients#MobaXterm\|( W )]]
	\| ✓		\| ✓
	\|-		\|-
	\| [[Data_Transfer/WinSCP\|WinSCP]]		\| [[Data_Transfer/Graphical_Clients#WinSCP\|WinSCP]]
	\| SFTP, WebDAV, SCP		\| SFTP, WebDAV, SCP
	\|		\|
Line 218:		Line 207:
	\| ✓		\| ✓
	\|-		\|-
	\| [[Data_Transfer/Filezilla\|Filezilla]]		\| [[Data_Transfer/Graphical_Clients#Filezilla\|Filezilla]]
	\| SFTP		\| SFTP
	\|		\|
Line 229:		Line 218:
	\| ✓		\| ✓
	\|-		\|-
	\| Cyberduck		\| [https://cyberduck.io/ Cyberduck]
	\| SFTP, WebDAV		\| SFTP, WebDAV
	\|		\|

H Schumacher: created page

2024-11-25T16:35:19Z

created page

New page

{| style=" background:#FEF4AB; width:100%;"
| style="padding:6px; font-size:100%;text-align:left" | This page is work in progress. To discover more relevant subpages, please come back at a later timepoint.
|-
|}
= All Data Transfer Routes =

The following tables provide a full overview on the various transfer options depending on the system that you are coming from and the system you want to transfer your data to. The recommended options are marked in the table with '''W'''(indows)/'''M'''(acOS)/'''L'''(inux) added next to the '✓' sign.<br />
'[✓]' means that this option is possible but might be the worst choice of the given ones.

== Copy and Sync via commandline ==

{| class="wikitable" style="vertical-align:middle;"
|- style="font-weight:bold;"
! Network protocol
! Underlying network protocol
! Description/When to use
! Executable on
!
!
!
!
! Transfer from/to
!
|-
|
|
|
| Linux
| Mac
| Windows
| bwUni Cluster
| bwFor Cluster
| bwHPC Cluster
| [[SDS@hd|SDS@hd]]
|-
| [[Data_Transfer/WebDAV|WebDav]] via [[Data_Transfer/Rclone|Rclone]]
| http(s)
| Needs installation. Multithreaded. Works on two completely remote locations as well. Transfers whole files.
| ✓
| ✓
| ✓
| ☓
| ☓
| ☓
| ✓
|-
| sftp via [[Data_Transfer/Rclone|Rclone]]
| ssh
| see above
| ✓
| ✓
| ✓
| ✓
| ✓
| ✓
| [✓]
|-
| [[Data_Transfer/Rsync|rsync]]
| ssh
| Synchronization of data. One side must be a local drive. Can spot differences in files and transfer only the changes.
| ✓
| ✓
| [✓]
| ✓
| ✓
| ✓
| ☓
|-
| [[Data_Transfer/SCP|scp]]
| ssh
| For copying data
| ✓
| ✓
| [✓]
| ✓
| ✓
| ✓
| ☓
|-
| [[Data_Transfer/SFTP|sftp]]
| ssh
| Interactive shell for copying data
| [✓](sftp-linux-mac)
| [✓](sftp-linux-mac)
| [[✓]](sftp-windows)
| ✓
| ✓
| ✓
| ✓
|}
== Mounting via commandline ==

{| class="wikitable" style="vertical-align:middle;"
|- style="font-weight:bold;"
! Network protocol
! Underlying protocol
! Description/When to use
! Executable on
!
!
!
!
! Transfer from/to
!
|-
|
|
|
| Linux
| Mac
| Windows
| bwUniCluster
| bwForCluster
| bwHPC cluster
| SDS@hd
|-
| WebDAV via [[Data_Transfer/Rclone#Usage_Rclone_Mount|Rclone mount]]
| http(s)
| Needs installation
| ✓
| ✓
| ✓
| ☓
| ☓
| ☓
| ✓
|-
| [[Data_Transfer/SSHFS|sshfs]]
| see sftp
|
| ✓
| ✓
| ✓
| ✓
| ✓
| ✓ [[Data_Transfer/SSHFS#MacOS_&_Linux|( L, M )]]
| ✓
|-
| [[SDS@hd/Access/SMB|smb]]
| none
| Mapping of a network drive
| [[✓]](smb-linux)
| ✓
| ✓
| ☓
| ☓
| ☓
| ✓ ([M](smb-mac), [W](smb-windows))
|-
| [[SDS@hd/Access/NFS#Using_NFSv4_for_UNIX_client|nfs]]
| none
| One-time installation effort (Kerberos, ID mapping). For servers, microscopes, multi-user environments, ...
| ✓
| ☓
| ☓
| ☓
| ☓
| ☓
| ✓
|-
| [[Data_Transfer/SFTP|sftp]]
| ssh
| Interactive shell for copying data
| [[Data_Transfer/SFTP#MacOS_&_Linux|✓]]
| [[Data_Transfer/SFTP#MacOS_&_Linux|✓]]
| [[Data_Transfer/SFTP#Windows|✓]]
| ✓
| ✓
| ✓
| ✓
|}
== Graphical User Interfaces (GUIs) ==

{| class="wikitable" style="vertical-align:middle;"
|- style="font-weight:bold;"
! GUIs
! Underlying protocols
! Description/When to use
! Executable on
!
!
!
!
! Transfer from/to
!
|-
|
|
|
| Linux
| Mac
| Windows
| bwUniCluster
| bwForCluster
| bwHPC cluster
| SDS@hd
|-
| [[Data_Transfer/MobaXterm|MobaXterm]]
| SSH, RSync, SFTP
|
| ☓
| ☓
| ✓
| ☓
| ☓
| ✓ [[Data_Transfer/MobaXterm|( W )]]
| ✓
|-
| [[Data_Transfer/WinSCP|WinSCP]]
| SFTP, WebDAV, SCP
|
| ☓
| ☓
| ✓
| ☓
| ☓
| ✓
| ✓
|-
| [[Data_Transfer/Filezilla|Filezilla]]
| SFTP
|
| ✓
| ✓
| ✓
| ☓
| ☓
| ✓
| ✓
|-
| Cyberduck
| SFTP, WebDAV
|
| ☓
| ✓
| ✓
| ☓
| ☓
| ✓
| ✓
|-
| WebDAV via browser
| WebDAV
| download single files
| ✓
| ✓
| ✓
| ☓
| ☓
| ☓
| [[SDS@hd/Access/WebdavBrowser|✓]]
|}