BwForCluster User Access: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
Line 17: Line 17:


<br>
<br>
Step 1 and 2 are pre-steps and requirements of step 3. Moreover, steps 1 and 2 can be done in parallel. At which bwForCluster site you can do step 3 will be decided by the cluster assignment team (CAT) based on the data of step 1, i.e. at ZAS.
Step 1 and 2 are pre-steps and requirements of step 3. Moreover, steps 1 and 2 can be done in parallel. The question, at which bwForCluster site to do step 3, will be answered by the cluster assignment team (CAT) based on the data of step 1, i.e. at ZAS.




Line 31: Line 31:
== How to register? ==
== How to register? ==
=== Compute project ===
=== Compute project ===
Typically only the leader of a scientific work group or the senior scientific needs to login at
Typically only the leader of a scientific work group or the senior scientist of research group/collaboration needs to login at
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_proposal.php
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_proposal.php
and to fill in all mandatory fields of the given form. Please note that for your convenience you can also switch to the [https://www.bwhpc-c5.de/ZAS/bwforcluster_antrag.php german version] of the web form. The submitter of the project will be assigned the role '''project responsible'''.
and to fill in all mandatory fields of the given web form. Please note that for your convenience you can also switch to the [https://www.bwhpc-c5.de/ZAS/bwforcluster_antrag.php german version] of the web form. The submitter of the project will be assigned the role '''project responsible'''.


The web formular consists of the following '''fields''' to be filled:
The web formular consists of the following '''fields''' to be filled:
Line 48: Line 48:
|-
|-
!scope="column" {{Lightgray_small}}| Scientific field
!scope="column" {{Lightgray_small}}| Scientific field
|scope="column" {{Tab element}} | Tick one or several scientific fields. Once all bwForClusters are up and running the full list of given scientific fields are supported and hence for compute projects applicable. If your compute project does not match any given scientific field, please state your scientific field in the given text box. Grayed out scientific fields indicate that the corresponding bwForCluster is yet not operational.
|scope="column" {{Tab element}} | Tick one or several scientific fields. Once all bwForClusters are up and running the full list of given scientific fields are supported and hence for compute projects applicable. If your compute project does not match any given scientific field, please state your scientific field in the given text box. Grayed out scientific fields indicate that the corresponding bwForCluster(s) is/are not operational yet.
|-
|-
!scope="column" {{Lightgray_small}}| Field of activity
!scope="column" {{Lightgray_small}}| Field of activity
Line 60: Line 60:
|-
|-
!scope="column" {{Lightgray_small}}| Numerical methods
!scope="column" {{Lightgray_small}}| Numerical methods
|scope="column" {{Tab element}} | State the numerical or calculation methods your code or application utilises. If you do not know, write "unknown".
|scope="column" {{Tab element}} | State the numerical or "calculation" methods your code or application utilises. If you do not know, write "unknown".
|-
|-
!scope="column" {{Lightgray_small}}| Software packages
!scope="column" {{Lightgray_small}}| Software packages
|scope="column" {{Tab element}} | State all software package you will or want to use for compute project. Also include compiler, MPI and numerical packages (e.g. MKL, FFTW).
|scope="column" {{Tab element}} | State all software package you will or want to use for your compute project. Also include compiler, MPI and numerical packages (e.g. MKL, FFTW).
|-
|-
!scope="column" {{Lightgray_small}}| Estimated requested computing resources
!scope="column" {{Lightgray_small}}| Estimated requested computing resources
|scope="column" {{Tab element}} | Roughly estimate how many ''CPU hours'' are required to finish your compute project. To calculate ''CPU hours'' multiply "elapsed parallel computing time" with "number of CPU core" per job. Example: Your code uses 4 CPU cores and has a wall time of 1h. This makes 4 CPU hours.
|scope="column" {{Tab element}} | Roughly estimate how many CPU hours are required to finish your compute project. To calculate "CPU hours" multiply "elapsed parallel computing time" with "number of CPU core" per job.
''Example: Your code uses 4 CPU cores and has a wall time of 1h. This makes 4 CPU hours.''
|-
|-
!scope="column" {{Lightgray_small}}| Planned maximum number of parallel used CPU cores per job
!scope="column" {{Lightgray_small}}| Planned maximum number of parallel used CPU cores per job
|scope="column" {{Tab element}} | Give an upper threshold on how many CPU cores per job are required. Please cross-check with your statement about parallel paradigm. Obviously a sequential code can only use 1 CPU core per job.
|scope="column" {{Tab element}} | Give an upper limit of how many CPU cores per job are required. Please cross-check with your statement about parallel paradigm.
''Obviously, a sequential code can only use 1 CPU core per job.''
|-
|-
!scope="column" {{Lightgray_small}}| Estimated maximal memory requirements per CPU core
!scope="column" {{Lightgray_small}}| Estimated maximal memory requirements per CPU core
|scope="column" {{Tab element}} | Give an upper threshold on how much RAM per CPU core your jobs require. Please give a value in GigaBytes.
|scope="column" {{Tab element}} | Give an upper limit of how much RAM per CPU core your jobs require. Please give a value in GigaBytes.
|-
|-
!scope="column" {{Lightgray_small}}| Estimated requested persistent disk space for this project
!scope="column" {{Lightgray_small}}| Estimated requested persistent disk space for this project
|scope="column" {{Tab element}} | State how much disk space in total you need for your compute project. Please give a value in GigaBytes. Example: If your compute project has 4 more coworker and each of you produces until the end of your project 20 GigaByte of output, your maximum disk space is 100 GigaByte.
|scope="column" {{Tab element}} | State how much disk space in total you need for your compute project. Please give a value in GigaBytes.
''Example: If your compute project has 4 more coworker and each of you produces until the end of your project 20 GigaByte of output, your maximum disk space is 100 GigaByte.''
|-
|-
!scope="column" {{Lightgray_small}}| Estimated maximal temporary disk space per job
!scope="column" {{Lightgray_small}}| Estimated maximal temporary disk space per job
|scope="column" {{Tab element}} | State how much space your intermediate files require during a job run. Please give a value in GigaBytes. Example: Your final output of your job is 0.1 GigaByte, but during your job 10 temporary files, each with a size of 1 GigaByte, are written to disk, hence your correct answer is 10 GigaByte.
|scope="column" {{Tab element}} | State how much space your intermediate files require during a job run. Please give a value in GigaBytes.
''Example: Your final output of your job is 0.1 GigaByte, but during your job 10 temporary files, each with a size of 1 GigaByte, are written to disk, hence your correct answer is 10 GigaByte.''
|-
|-
!scope="column" {{Lightgray_small}}| Institute
!scope="column" {{Lightgray_small}}| Institute
Line 84: Line 88:
|-
|-
|}
|}
Note that the fields - name, firstname, organization, mail und EPPN - are auto-filled and can not be changed. These are your credentials as given by your home organization.
Note that the fields - name, firstname, organization, mail, und EPPN - are auto-filled and can not be changed. These are your credentials as given by your home organization.
<br><br>
<br><br>
<span style="font-weight:bold;font-size:115%;">Response</span>
<span style="font-weight:bold;font-size:115%;">Response</span>
# After submitting you will get an email from ZAS confirming your submission. With this email you are given an unique<br>* acronym<br>* password<br>Please keep the password enclosed. Only with both, acronym and password, [[BwForCluster_User_Access#Coworkers|coworkers]] can be added to your compute project.
# After submitting you will get an email from ZAS confirming your submission. With this email you are given an unique<br>* acronym<br>* password<br>Please keep the password enclosed. Only with both, acronym and password, [[BwForCluster_User_Access#Coworkers|coworkers]] can be added to your compute project.
# The cluster assignment team will be notified immediately about your submission.
# The cluster assignment team will be notified immediately about your submission.
# The cluster assignment team decides within 2 working days and based on your submitted data which bwForCluster most fits and submits its decision to ZAS.
# The cluster assignment team decides within 2 working days and based on your submitted data which bwForCluster most fits, and submits its decision to ZAS.
# ZAS notifies you in an email about your assigned bwForCluster and provides website details for [[BwForCluster_User_Access#Personal registration at bwForCluster|step 3]].
# ZAS notifies you in an email about your assigned bwForCluster and provides website details for [[BwForCluster_User_Access#Personal registration at bwForCluster|step 3]].
<br>
<br>


=== Coworkers ===
=== Coworkers ===
Important, each coworker must add herself/himself to compute project, since only via personal authentication the correctness of personal credentials (provided by your home organization) can be guaranteed. To become coworker of a compute project, please login at
Important, each coworker must add herself/himself to compute projects, since only via personal authentication the correctness of personal credentials (provided by your home organization) can be guaranteed. To become coworker of a compute project, please login at
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_collaboration.php
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_collaboration.php
and provide correct
and provide correct
* password
* password
* acronym
* acronym
of the compute project. The submitter will be assigned the role '''project member'''.
of the compute project. Your project responsible will provide you with that information. The submitter will be assigned the role '''project member'''.
<br><br>
<br><br>
<span style="font-weight:bold;font-size:115%;">Response</span>
<span style="font-weight:bold;font-size:115%;">Response</span>
# After submitting the request for participating a compute project, the coworker will receive an email from ZAS about the process. The membership status is set active.
# After submitting the request for participating a compute project, the coworker will receive an email from ZAS about the process. The membership status in the compute project is set active by default.
# Each person with the role '''project responsible''' and '''project manager''' will be notified. Any of these persons can crosscheck via https://www.bwhpc-c5.de/en/ZAS/info_compute_project.php and clicking on the correct project acronym the correctness of the process.
# Each person with the role '''project responsible''' and '''project manager''' will be notified. Any of these persons can crosscheck via https://www.bwhpc-c5.de/en/ZAS/info_compute_project.php and clicking on the correct project acronym the correctness of the process.
# The project responsible can set any '''project coworker''' to '''project manager''' and vice versa as well as deactivate any membership.
# The project responsible can set any '''project coworker''' to '''project manager''' and vice versa as well as deactivate/reactivate any '''project coworker''' or '''project manager'''.
# Any project manager can deactivate any membership.
# Any project manager can deactivate/reactivate any '''project coworker'''.
<br>
<br>


Line 147: Line 151:
Once you have registered your compute project at ZAS by filling a short online form, the cluster assignment team will provide you with information about your designated bwForCluster - basically providing your with the correct website to finally register yourself for the designated cluster.
Once you have registered your compute project at ZAS by filling a short online form, the cluster assignment team will provide you with information about your designated bwForCluster - basically providing your with the correct website to finally register yourself for the designated cluster.


Please note, this step is different to your registration at ZAS since here you do not register your compute project but yourself as a person. Only based on your personal credentials a user account can be generated. However, given resource requests for compute project at the ZAS will be crosschecked with the consumed resources by you and your coworkers of the compute project.
Please note, this step is different to your registration at ZAS since here you do not register your compute project but yourself as a person. Only based on your personal credentials a user account can be generated. However, defined resource requests (compare your compute project registration) will be cross-checked with the resources consumed by you and your coworkers of the compute project.





Revision as of 21:10, 3 December 2014

The usage of bwForCluster is free of charge. bwForClusters are customized to the requirements of particular research areas. Each bwForCluster is/will be financed by the DFG (German Research Foundation) and by the Ministry of Science, Research and Arts of Baden-Württemberg based on scientifc grant proposal (compare proposals guidelines as per Art. 91b GG).

Bwforreg.svg


Granting user access to a bwForCluster requires 3 steps:

  1. Registration of your compute project at "Zentrale Antragsseite (ZAS)",
  2. Application for bwForCluster entitlement issued by your university,
  3. Personal registration at assigned cluster site based on approved compute project Zas assignment icon.svg and issued bwForCluster entitlement Bwfor entitlement icon.svg.


Step 1 and 2 are pre-steps and requirements of step 3. Moreover, steps 1 and 2 can be done in parallel. The question, at which bwForCluster site to do step 3, will be answered by the cluster assignment team (CAT) based on the data of step 1, i.e. at ZAS.


Compute project registration at ZAS

A compute project registration at ZAS does NOT correspond to typical compute project proposals as for other HPC clusters, since:

  • there is no scientific reviewing process
  • the registration inquires only brief details
  • it covers a group of coworkers and
  • only the project responsible must submit it.


How to register?

Compute project

Typically only the leader of a scientific work group or the senior scientist of research group/collaboration needs to login at

and to fill in all mandatory fields of the given web form. Please note that for your convenience you can also switch to the german version of the web form. The submitter of the project will be assigned the role project responsible.

The web formular consists of the following fields to be filled:

Field Explanation
Title Define a short title of your compute project, maximum of 255 characters including spaces.
Description Write a short abstract about your compute project (maximum of 2048 characters including spaces). Research groups that contributed to the DFG grant proposal (Art. 91b GG) of the corresponding bwForCluster only need to give reference to that particular proposal.
Scientific field Tick one or several scientific fields. Once all bwForClusters are up and running the full list of given scientific fields are supported and hence for compute projects applicable. If your compute project does not match any given scientific field, please state your scientific field in the given text box. Grayed out scientific fields indicate that the corresponding bwForCluster(s) is/are not operational yet.
Field of activity Define if your compute project is primarily for research and/or teaching. If not applicable, use text box.
Parallel paradigm State what parallel paradigm your code or application uses. Multiple ticks are allowed. Further information can be provided via text box. If you are not sure about it, please state the software you are using.
Programming language State the programming language(s) of your code or application.
Numerical methods State the numerical or "calculation" methods your code or application utilises. If you do not know, write "unknown".
Software packages State all software package you will or want to use for your compute project. Also include compiler, MPI and numerical packages (e.g. MKL, FFTW).
Estimated requested computing resources Roughly estimate how many CPU hours are required to finish your compute project. To calculate "CPU hours" multiply "elapsed parallel computing time" with "number of CPU core" per job.

Example: Your code uses 4 CPU cores and has a wall time of 1h. This makes 4 CPU hours.

Planned maximum number of parallel used CPU cores per job Give an upper limit of how many CPU cores per job are required. Please cross-check with your statement about parallel paradigm.

Obviously, a sequential code can only use 1 CPU core per job.

Estimated maximal memory requirements per CPU core Give an upper limit of how much RAM per CPU core your jobs require. Please give a value in GigaBytes.
Estimated requested persistent disk space for this project State how much disk space in total you need for your compute project. Please give a value in GigaBytes.

Example: If your compute project has 4 more coworker and each of you produces until the end of your project 20 GigaByte of output, your maximum disk space is 100 GigaByte.

Estimated maximal temporary disk space per job State how much space your intermediate files require during a job run. Please give a value in GigaBytes.

Example: Your final output of your job is 0.1 GigaByte, but during your job 10 temporary files, each with a size of 1 GigaByte, are written to disk, hence your correct answer is 10 GigaByte.

Institute State the full name of your Institute.

Note that the fields - name, firstname, organization, mail, und EPPN - are auto-filled and can not be changed. These are your credentials as given by your home organization.

Response

  1. After submitting you will get an email from ZAS confirming your submission. With this email you are given an unique
    * acronym
    * password
    Please keep the password enclosed. Only with both, acronym and password, coworkers can be added to your compute project.
  2. The cluster assignment team will be notified immediately about your submission.
  3. The cluster assignment team decides within 2 working days and based on your submitted data which bwForCluster most fits, and submits its decision to ZAS.
  4. ZAS notifies you in an email about your assigned bwForCluster and provides website details for step 3.


Coworkers

Important, each coworker must add herself/himself to compute projects, since only via personal authentication the correctness of personal credentials (provided by your home organization) can be guaranteed. To become coworker of a compute project, please login at

and provide correct

  • password
  • acronym

of the compute project. Your project responsible will provide you with that information. The submitter will be assigned the role project member.

Response

  1. After submitting the request for participating a compute project, the coworker will receive an email from ZAS about the process. The membership status in the compute project is set active by default.
  2. Each person with the role project responsible and project manager will be notified. Any of these persons can crosscheck via https://www.bwhpc-c5.de/en/ZAS/info_compute_project.php and clicking on the correct project acronym the correctness of the process.
  3. The project responsible can set any project coworker to project manager and vice versa as well as deactivate/reactivate any project coworker or project manager.
  4. Any project manager can deactivate/reactivate any project coworker.



Roles in a compute project

Role Explanation
Project responsible Registers compute projects. Can deactivate but also reactivate project managers and coworkers. Can promote coworkers to mangers and vice versa.
Project manager Defines a project coworker with rights to deactivate and reactivate project coworkers.
Project coworker Registers her/his membership via compute project acronym and password.



Issueing bwForCluster entitlement

Each university issues the bwForCluster entitlement only for their own members.

The following unversities have already established a process to issue the bwForCluster entitlement:

If you do not find your university in the list above, please contact your local service desk.


Personal registration at bwForCluster

Once you have registered your compute project at ZAS by filling a short online form, the cluster assignment team will provide you with information about your designated bwForCluster - basically providing your with the correct website to finally register yourself for the designated cluster.

Please note, this step is different to your registration at ZAS since here you do not register your compute project but yourself as a person. Only based on your personal credentials a user account can be generated. However, defined resource requests (compare your compute project registration) will be cross-checked with the resources consumed by you and your coworkers of the compute project.


After step 1 and 2, i.e., approval of your compute project and issued bwForCluster entitlement, please visit:

  • Cluster registration website (details given by CAT)
    1. Select your home organization from the list and click Proceed
    2. You will be directed to the Identity Provider of your home organisation
    3. Enter your home-organisational user ID / username and your home-organisational password and click Login button
    4. You will be redirected back to the cluster registration website
    5. Select bwForCluster Service Description (on the left hand side)
    6. Click Register
    7. Finally
      • optionally set a service password for authentication on bwForCluster