SDS@hd/Access

From bwHPC Wiki
Jump to navigation Jump to search

This page provides an overview on how to access data served by SDS@hd. To get an introduction to data transfer in general, see data transfer.

Prerequisites

  • You need to be registered.
  • You need to be in the belwue-Network. This means you have to use the VPN Service of your HomeOrganization, if you want to access SDS@hd from outside the bwHPC-Clusters (e.g. via eduroam or from your personal notebook).

Needed Information, independent of the chosen tool

Recommended Setup

The following graphic shows the recommended way for accessing SDS@hd via Windows/Mac/Linux. The table provides an overview of the most important access options and links to the related pages.
If you have various use cases, it is recommended to use Rclone. You can copy, sync and mount with it and it works not just for SDS@hd but also for the bwHPC clusters.
For an overview of all connection possibilities, please have a look at all data transfer routes.

Data transfer diagram simple.jpg

Figure 1: SDS@hd main transfer routes

Use Case Windows Mac Linux Possible Bandwith Firewall Ports
SMB mount as network drive in file explorer up to 40 Gbit/sec 139 (netbios), 135 (rpc), 445 (smb)
Rclone copy, sync and mount with WebDAV up to 100GBit/sec 80 (http), 443 (https)
MobaXterm Graphical User Interface (GUI) see sftp see sftp
NFS mount for multi-user environments up to 40 Gbit/sec -
SSHFS mount see sftp see sftp
SFTP not recommended up to 40 Gbit/sec 22 (ssh)

Table 1: SDS@hd transfer routes

Access from a bwHPC Cluster

bwForCluster Helix:
You can directly access your storage space under /mnt/sds-hd/ on all login and compute nodes.

bwForCluster BinAC
You can directly access your storage space on all login nodes.

Access via Webbrowser (read-only)

Visit lsdf02-webdav.urz.uni-heidelberg.de and login with your SDS@hd username and service password. Here you can get an overview of the data in your "Speichervorhaben" and download single files. To be able to do more, like moving data, uploading new files, or downloading complete folders, a suitable client is needed as described above.

Best Practices

  • Managing access rights with ACLs
    -> Please set ACLs either via the Windows terminal server or via bwForCluster Helix. ACL changes won't work when used locally on a mounted directory.
  • Multiuser environment -
    -> Use NFS