Difference between revisions of "Sds-hd hpc access"

From bwHPC Wiki
Jump to: navigation, search
m (Access to SDS@hd)
m (Access to SDS@hd)
Line 9: Line 9:
   
 
It is possible to access your storage space on [http://sds-hd.urz.uni-heidelberg.de SDS@hd] directly on the bwforCluster MLS&WISO.
 
It is possible to access your storage space on [http://sds-hd.urz.uni-heidelberg.de SDS@hd] directly on the bwforCluster MLS&WISO.
You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes '''except standard nodes'''. Kerberos tickets are obtained and prolongated on the data mover nodes data1 and data2. Before a Kerberos ticket expires, notification is sent by e-mail.
+
You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes. Kerberos tickets are obtained and prolongated on the login nodes. Before a Kerberos ticket expires, notification is sent by e-mail.
   
 
== Direct access in compute jobs ==
 
== Direct access in compute jobs ==
   
* Fetch a Kerberos ticket on any loginnode with command: kinit (use your SDS@hd service password)
+
* Fetch a Kerberos ticket on any login node with command: kinit (use your SDS@hd service password)
 
* Prepare your jobscript to use the directory ''/mnt/sds-hd/<your-sv-acronym>''
 
* Prepare your jobscript to use the directory ''/mnt/sds-hd/<your-sv-acronym>''
 
* submit your job
 
* submit your job
Line 20: Line 20:
 
Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on all login nodes:
 
Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on all login nodes:
   
* Fetch a Kerberos ticket on any loginnode with command: kinit (use your SDS@hd service password)
+
* Fetch a Kerberos ticket on any login node with command: kinit (use your SDS@hd service password)
 
* Find your SDS@hd directory in /mnt/sds-hd/
 
* Find your SDS@hd directory in /mnt/sds-hd/
 
* Copy data between your SDS@hd directory and your workspaces
 
* Copy data between your SDS@hd directory and your workspaces

Revision as of 16:18, 22 August 2018

1 Access to SDS@hd

SDS@hd University Heidelberg
SDS@hd ScientificDataStorage © University Heidelberg

It is possible to access your storage space on SDS@hd directly on the bwforCluster MLS&WISO. You can access your SDS@hd directory with a valid Kerberos ticket on all compute nodes. Kerberos tickets are obtained and prolongated on the login nodes. Before a Kerberos ticket expires, notification is sent by e-mail.

1.1 Direct access in compute jobs

  • Fetch a Kerberos ticket on any login node with command: kinit (use your SDS@hd service password)
  • Prepare your jobscript to use the directory /mnt/sds-hd/<your-sv-acronym>
  • submit your job

1.2 Copying data from SDS@hd to a cluster workspace

Certain workflows or I/O patterns may require the transfer of data from SDS@hd to a workspace on the cluster before submitting jobs. Data transfers are possible on all login nodes:

  • Fetch a Kerberos ticket on any login node with command: kinit (use your SDS@hd service password)
  • Find your SDS@hd directory in /mnt/sds-hd/
  • Copy data between your SDS@hd directory and your workspaces
  • Destroy your Kerberos ticket with command: kdestroy