Sds-hd hpc access: Difference between revisions
Jump to navigation
Jump to search
(Created page with "{| style="width: 100%; border-spacing: 5px;" | style="text-align:center; color:#000;vertical-align:middle;font-size:75%;" | [[File:Sds-hd_hpc_connection.png|center|border|700p...") |
No edit summary |
||
| Line 5: | Line 5: | ||
| style="text-align:center; color:#000;vertical-align:middle;" |<span style="font-size:100%">'''SDS@hd ScientificDataStorage © University Heidelberg''' </span> |
| style="text-align:center; color:#000;vertical-align:middle;" |<span style="font-size:100%">'''SDS@hd ScientificDataStorage © University Heidelberg''' </span> |
||
|} |
|} |
||
= Access to SDS@hd = |
|||
It is possible to access your storage space on [http://sds-hd.urz.uni-heidelberg.de SDS@hd] directly on the bwforCluster MLS&WISO. |
|||
You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes '''except standard nodes'''. Kerberos tickets are obtained and prolongated on the data mover nodes data1 and data2. Before a Kerberos ticket expires, notification is sent by e-mail. |
|||
== Direct access in compute jobs == |
|||
* Login in to a datamover, i.e. ssh data1 (passwordless) |
|||
* Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password) |
|||
* Prepare your jobscript to use the directory ''/mnt/sds-hd/<your-sv-acronym>'' |
|||
* submit your job from the login node |
|||
== Copying data on data mover node == |
|||
Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on the data mover nodes data1 and data2: |
|||
* Login to a data mover node with command: ssh data1 (passwordless) |
|||
* Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password) |
|||
* Find your SDS@hd directory in /mnt/sds-hd/ |
|||
* Copy data between your SDS@hd directory and your workspaces |
|||
* Logout from data1 for further work on the cluster |
|||
<br> |
|||
----- |
|||
<br> |
|||
<br> |
|||
[[Category:Sds-hd]] |
|||
[[Category:bwForCluster_MLS&WISO_Production|File System]] |
|||
Revision as of 12:20, 19 September 2017
 |
| SDS@hd ScientificDataStorage © University Heidelberg |
Access to SDS@hd
It is possible to access your storage space on SDS@hd directly on the bwforCluster MLS&WISO. You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes except standard nodes. Kerberos tickets are obtained and prolongated on the data mover nodes data1 and data2. Before a Kerberos ticket expires, notification is sent by e-mail.
Direct access in compute jobs
- Login in to a datamover, i.e. ssh data1 (passwordless)
- Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password)
- Prepare your jobscript to use the directory /mnt/sds-hd/<your-sv-acronym>
- submit your job from the login node
Copying data on data mover node
Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on the data mover nodes data1 and data2:
- Login to a data mover node with command: ssh data1 (passwordless)
- Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password)
- Find your SDS@hd directory in /mnt/sds-hd/
- Copy data between your SDS@hd directory and your workspaces
- Logout from data1 for further work on the cluster