Difference between revisions of "Sds-hd hpc access"
m (→Copying data on data mover node) |
S Richling (talk | contribs) (Redirected page to SDS@hd) (Tag: New redirect) |
||
| (2 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
| − | + | #REDIRECT [[SDS@hd]] |
|
| − | |||
| − | {| style="width: 100%; border-spacing: 5px;" |
||
| − | | style="text-align:center; color:#000;vertical-align:middle;font-size:75%;" | |
||
| − | [[File:Sds-hd_hpc_connection.png|center|border|700px|SDS@hd University Heidelberg]] |
||
| − | |- |
||
| − | | style="text-align:center; color:#000;vertical-align:middle;" |<span style="font-size:100%">'''SDS@hd ScientificDataStorage © University Heidelberg''' </span> |
||
| − | |} |
||
| − | |||
| − | It is possible to access your storage space on [http://sds-hd.urz.uni-heidelberg.de SDS@hd] directly on the bwforCluster MLS&WISO. |
||
| − | You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes '''except standard nodes'''. Kerberos tickets are obtained and prolongated on the data mover nodes data1 and data2. Before a Kerberos ticket expires, notification is sent by e-mail. |
||
| − | |||
| − | == Direct access in compute jobs == |
||
| − | |||
| − | * Login in to a datamover, i.e. "ssh data1" or "ssh data2" (passwordless) |
||
| − | * Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password) |
||
| − | * Prepare your jobscript to use the directory ''/mnt/sds-hd/<your-sv-acronym>'' |
||
| − | * submit your job |
||
| − | |||
| − | == Copying data on data mover node == |
||
| − | Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on the data mover nodes data1 and data2: |
||
| − | |||
| − | * Login to a data mover node with command: "ssh data1" or "ssh data2" (passwordless) |
||
| − | * Fetch a Kerberos ticket with command: kinit (use your SDS@hd service password) |
||
| − | * Find your SDS@hd directory in /mnt/sds-hd/ |
||
| − | * Copy data between your SDS@hd directory and your workspaces |
||
| − | * Destroy your Kerberos ticket with command: kdestroy |
||
| − | * Logout from data1 for further work on the cluster |
||
| − | |||
| − | <br> |
||
| − | ----- |
||
| − | <br> |
||
| − | <br> |
||
| − | [[Category:Sds-hd]] |
||
| − | [[Category:bwForCluster_MLS&WISO_Production|File System]] |
||
Latest revision as of 16:55, 19 August 2022
Redirect to:
