Sds-hd hpc access: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
mNo edit summary
(Redirected page to SDS@hd)
Tag: New redirect
 
(5 intermediate revisions by one other user not shown)
Line 1: Line 1:
#REDIRECT [[SDS@hd]]
{| style="width: 100%; border-spacing: 5px;"
| style="text-align:center; color:#000;vertical-align:middle;font-size:75%;" |
[[File:Sds-hd_hpc_connection.png|center|border|700px|SDS@hd University Heidelberg]]
|-
| style="text-align:center; color:#000;vertical-align:middle;" |<span style="font-size:100%">'''SDS@hd ScientificDataStorage © University Heidelberg''' </span>
|}

= Access to SDS@hd =

It is possible to access your storage space on [http://sds-hd.urz.uni-heidelberg.de SDS@hd] directly on the bwforCluster MLS&WISO.
You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes '''except standard nodes'''. Kerberos tickets are obtained and prolongated on the data mover nodes data1 and data2. Before a Kerberos ticket expires, notification is sent by e-mail.

== Direct access in compute jobs ==

* Login in to a datamover, i.e. ssh data1 (passwordless)
* Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password)
* Prepare your jobscript to use the directory ''/mnt/sds-hd/<your-sv-acronym>''
* submit your job from the login node

== Copying data on data mover node ==
Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on the data mover nodes data1 and data2:

* Login to a data mover node with command: ssh data1 (passwordless)
* Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password)
* Find your SDS@hd directory in /mnt/sds-hd/
* Copy data between your SDS@hd directory and your workspaces
* Destroy your Kerberos ticket with command: kdestroy
* Logout from data1 for further work on the cluster

<br>
-----
<br>
<br>
[[Category:Sds-hd]]
[[Category:bwForCluster_MLS&WISO_Production|File System]]

Latest revision as of 16:55, 19 August 2022

Redirect to: