bwHPC Wiki - User contributions [en]

Main Page

2025-07-16T14:56:14Z

B Wellenkamp:

'''Welcome to the bwHPC Wiki.'''

bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').

The main bwHPC web page is at '''[https://www.bwhpc.de/ https://www.bwhpc.de/]'''.

Many topics depend on the cluster system you use.
First choose the cluster you use, then select the correct topic.

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
|-
|
* [[When to use a HPC Cluster]]
* [[Running Calculations]]
* [[Registration]]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[BwUniCluster3.0|bwUniCluster 3.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
|-
| style="padding:5px; width:30%" | [[NEMO2|bwForCluster NEMO 2]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[BinAC|bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics
|-
| style="padding:5px; width:30%" | [[BinAC2|bwForCluster BinAC 2]]
| style="padding-left:20px;" | Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
|}
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
Further Compute Clusters in Baden-Württemberg (separate access policies):
* Datenanalyse Cluster der Hochschulen (DACHS): [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}

{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Development| Software Development and Parallel Programming]]
* [[Energy Efficient Cluster Usage]]
* [[HPC Glossary]]

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
|-
|
For user guides of the scientific data storage services:
* [[SDS@hd]]
* [https://www.rda.kit.edu/english bwDataArchive]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://www.bwhpc.de/supportportal.php Submit a Ticket]
* [[BwSupportPortal|Visual Guide]]
|}
{| style=" background:#e6e9eb; width:100%;"
| style="padding:8px; background:#d1dadf; font-size:120%; font-weight:bold; text-align:left" | Acknowledgement
|-
|
* Please [[Acknowledgement|acknowledge]] our resources in your publications.
|}

Main Page

2024-03-26T14:20:04Z

B Wellenkamp:

'''Welcome to the bwHPC Wiki.'''

bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').

The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].

Many topics depend on the cluster system you use.
First choose the cluster you use, then select the correct topic.

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
|-
|
* [[Registration]]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[BwUniCluster2.0|bwUniCluster 2.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Computational Humanities, Structural and Systems Biology, Medical Science, and Soft Matter
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster NEMO| bwForCluster NEMO]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster BinAC| bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics.
|}
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
Further Compute Clusters in Baden-Württemberg (separate access policies):
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/HPE_Hawk Hawk] ([https://www.hlrs.de/solutions-services/academic-users/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}

{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Development| Software Development and Parallel Programming]]
* [[Energy Efficient Cluster Usage]]
* [[HPC Glossary]]

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
|-
|
For user guides of the scientific data storage services:
* [[SDS@hd]]
* [https://www.rda.kit.edu/english bwDataArchive]
* [https://zas.bwsfs.uni-tuebingen.de/info/uebersicht bwSFS]
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://bw-support.scc.kit.edu/ Submit a Ticket]
* extended Support via [https://zas.bwhpc.de/en/zas_info_tigerteamsupport.php "Tiger Teams"]
|}

BwUniCluster2.0/First Steps

2022-08-16T08:40:14Z

B Wellenkamp:

== Command line interface ==

Any work is to be done via command line interface. A quick guide can be found [https://indico.scc.kit.edu/indico/event/278/material/slides/10.pdf '''here'''].

== Software setup ==

Softwares provided by bwHPC have to be loaded according to your need via the [[BwUniCluster_2.0_Software|'''Software Module System''']].

== Computation ==

Any kind of computation on any HPC cluster is done as [[bwUniCluster_2.0_Slurm_common_Features|'''batch jobs''']].

Registration/bwUniCluster/Questionnaire

2022-08-16T08:37:48Z

B Wellenkamp:

= Step C: bwUniCluster Questionnaire =

'''Please fill out the bwUniCluster questionnaire within 14 days after registration. Otherwise your login to the cluster will be deactivated.''' The information will only be used to improve our support activities and for capacity planning of future HPC resources.

Please complete the following steps:

1. Visit the page '''[https://zas.bwhpc.de/shib/en/bwunicluster_survey.php bwUniCluster Questionnaire]'''.

2. Select your home organization from the list on the main page and click '''Proceed/Fortfahren'''.

3. You will be directed to the ''Identity Provider'' of your home organization.
Enter the username and password of your '''home organization''' (usually these credentials are also used for other services like email) and click '''Login/Einloggen'''.

4. You will be redirected back to the questionnaire '''https://zas.bwhpc.de/shib/en/bwunicluster_survey.php'''.
Please '''fill''' out the questionnaire, '''accept''' the terms of use and click '''Preview/Vorschau'''.

5. If everything is correct click '''Send/Abschicken'''.

[[BwUniCluster 2.0| Go to bwUniCluster]]

Registration/bwForCluster/Service

2022-08-16T08:32:56Z

B Wellenkamp:

= Step C: bwForCluster Registration =

Prerequisites for successful account creation:
* '''[[Registration/bwForCluster/Entitlement|Step A: bwForCluster Entitlement]]'''
* '''[[Registration/bwForCluster/RV|Step B: Apply for a Rechenvorhaben/project]].

Once you have registered your own RV (''Rechenvorhaben'') or a membership in an RV, you will receive an email with a website to create an account for yourself on that cluster.

To finish the registration procedure select the cluster your RV was assigned to:

* '''[[Registration/bwForCluster/BINAC|bwForCluster BINAC]]'''
* '''[[Registration/bwForCluster/JUSTUS2|bwForCluster JUSTUS 2]]'''
* '''[[Registration/bwForCluster/MLS_WISO|bwForCluster MLS&WISO]]'''
* '''[[Registration/bwForCluster/NEMO|bwForCluster NEMO]]'''

[[Main Page| Go back to Home]]

Registration/bwForCluster/RV

2022-08-16T08:25:24Z

B Wellenkamp:

= Step B: Apply for a Rechenvorhaben/Project =

'''Rechenvorhaben/Projects (RV)''' are required for assignment to a bwForCluster.
The [https://www.bwhpc.de/bwhpc-domains.php research area] of the group as well as the software and hardware requirements are taken into account.
A research group may decide to split its research among several RV if it sees the need to do so.
However, this does not mean that another RV is assigned to another cluster.
A RV should be registered by a leader or senior scientist of a research group/collaboration.
Any number of coworkers can then join your RV to work with the cluster.

To apply for a RV simply answer this simple question:
* Does your work group already have a RV?
** '''Yes → [[Registration/bwForCluster/RV#Become_Coworker_of_a_RV|Become Coworker of a RV]]'''
** '''No → [[Registration/bwForCluster/RV#Register_a_new_RV|Register a new RV]]'''

= Become Coworker of a RV =

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
You can only sign up for an RV once.
If you are an inactive member of an RV, either because you de-registered yourself or a manager deactivated you, only an RV manager can reactivate you.
|}

{| style="width: 100%;"
| The "RV responsible" will provide you with the following data on the RV:
* RV acronym
* RV password

If this information is lost, please let the "RV responsible" [[Registration/bwForCluster/RV#Renew_RV_Password|renew the password]] for the RV.

To become coworker of an RV, follow these simple steps:

1. Please visit the [https://zas.bwhpc.de/shib/en/bwforcluster_collaboration.php '''RV collaboration'''] web form at the [https://zas.bwhpc.de ZAS].
[[File:RV-collab.png|center|frame|RV collaboration.]]

2. Select your home organization from the list on the main page and click '''Proceed''' or '''Fortfahren'''.
[[File:BwIDM-login.png|center|400px|thumb|Select your home organization]]

3. You will be redirected back to the RV collaboration form '''https://zas.bwhpc.de/shib/en/bwforcluster_collaboration.php'''.

4. Enter '''RV Acronym''', '''RV Password''' and '''Institute''' into the form and check both "Terms of Use".
Click '''Send'''.

5. You will be assigned to the RV as a new member.

After submitting the request you will receive an email from ZAS about the further steps.
RV owner and RV managers will be notified automatically.

| [[File:RV-formcol.png|center|400px|thumb|Become Coworker of a RV.]]
|}

= Register a new RV=

A RV should be registered by a leader or senior scientist of a research group/collaboration.
You will be:
* held accountable for the coworkers in the RV
* asked to provide information for the two reports required by the DFG for their funding of bwForClusters
* likely asked for a contribution to a future DFG grant proposal for a new bwForCluster in your area of research ("wissenschaftliches Beiblatt")

To apply for a new RV, follow these steps:

1. Please visit the [https://zas.bwhpc.de/shib/en/bwforcluster_proposal.php '''RV registration'''] web form at the [https://zas.bwhpc.de ZAS].
[[File:RV-reg.png|center|frame|Register a new RV.]]

2. Select your home organization from the list on the main page and click '''Proceed''' or '''Fortfahren'''.
[[File:BwIDM-login.png|center|400px|thumb|Select your home organization]]

3. You will be redirected back to the RV registration form '''https://zas.bwhpc.de/shib/en/bwforcluster_proposal.php'''.

4. Fill in all mandatory fields of the form and tick the two "Terms of use".
Detailed information on the individual fields can be found in the section [[Registration/bwForCluster/RV#Registration_Form_Details|Registration Form Details]].
Click '''Preview'''.

5. If the information is correct, click '''Submit''', otherwise you can customize your application.

6. Go to section [[Registration/bwForCluster/RV#Registration_Response|Registration Response]] for the next steps.

Please note that for your convenience you can also switch to the [https://zas.bwhpc.de/shib/bwforcluster_proposal.php German version] of the web form.
The submitter of the RV will be assigned the role "RV responsible" (see [[Registration/bwForCluster/RV#Roles_in_a_RV|Roles in a RV]]).

== Registration Form Details ==

The web form consists of the following fields.
Note that the fields - name, given name, organization, mail, and EPPN - are auto-filled and can not be changed.
These are your credentials as given by your home organization.

{| style="width:100%;border:3px solid darkgray; margin: 1em auto 1em auto;"
|-
! style="width:20%;padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;"| Field
! style="padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;" | Explanation
|rowspan="15"| [[File:RV-form.png|center|400px|thumb|Registering a new RV.]]
|-
!scope="column" {{Lightgray_small}}| RV Title
|scope="column" {{Tab element}} | Define a short title of your planned compute activities, maximum of 255 characters including spaces.
|-
!scope="column" {{Lightgray_small}}| RV Description
|scope="column" {{Tab element}} | Write a short abstract about your planned compute activities (maximum of 2048 characters including spaces). Research groups that contributed to the DFG grant proposal (Art. 91b GG) of the corresponding bwForCluster only need to give reference to that particular proposal.
|-
!scope="column" {{Lightgray_small}}| Scientific field
|scope="column" {{Tab element}} | Tick one or several scientific fields. Once all bwForClusters are up and running the full list of given scientific fields are supported and hence for RV applicable. If your RV does not match any given scientific field, please state your scientific field in the given text box. Grayed out scientific fields indicate that the corresponding bwForCluster(s) is/are not operational yet.
|-
!scope="column" {{Lightgray_small}}| Field of activity
|scope="column" {{Tab element}} | Define if your RV is primarily for research and/or teaching. If not applicable, use text box.
|-
!scope="column" {{Lightgray_small}}| Parallel paradigm
|scope="column" {{Tab element}} | State what parallel paradigm your code or application uses. Multiple ticks are allowed. Further information can be provided via text box. If you are not sure about it, please state the software you are using.
|-
!scope="column" {{Lightgray_small}}| Programming language
|scope="column" {{Tab element}} | State the programming language(s) of your code or application.
|-
!scope="column" {{Lightgray_small}}| Numerical methods
|scope="column" {{Tab element}} | State the numerical or "calculation" methods your code or application utilizes. If you do not know, write "unknown".
|-
!scope="column" {{Lightgray_small}}| Software packages
|scope="column" {{Tab element}} | State all software package you will or want to use for your RV. Also include compiler, MPI and numerical packages (e.g. MKL, FFTW).
|-
!scope="column" {{Lightgray_small}}| Estimated requested computing resources
|scope="column" {{Tab element}} | Roughly estimate how many CPU hours are required to finish your RV. To calculate "CPU hours" multiply "elapsed parallel computing time" with "number of CPU core" per job.
''Example: Your code uses 4 CPU cores and has a wall time of 1h. This makes 4 CPU hours.''
|-
!scope="column" {{Lightgray_small}}| Planned maximum number of parallel used CPU cores per job
|scope="column" {{Tab element}} | Give an upper limit of how many CPU cores per job are required. Please cross-check with your statement about parallel paradigm.
''Obviously, a sequential code can only use 1 CPU core per job.''
|-
!scope="column" {{Lightgray_small}}| Estimated maximal memory requirements per CPU core
|scope="column" {{Tab element}} | Give an upper limit of how much RAM per CPU core your jobs require. Please give a value in Gigabytes.
|-
!scope="column" {{Lightgray_small}}| Estimated requested persistent disk space for the RV
|scope="column" {{Tab element}} | State how much disk space in total you need for your RV. Please give a value in Gigabytes.
''Example: If your RV has 4 more coworker and each of you produces until the end of your RV 20 Gigabyte of output, your maximum disk space is 100 Gigabyte.''
|-
!scope="column" {{Lightgray_small}}| Estimated maximal temporary disk space per job
|scope="column" {{Tab element}} | State how much space your intermediate files require during a job run. Please give a value in Gigabytes.
''Example: Your final output of your job is 0.1 Gigabyte, but during your job 10 temporary files, each with a size of 1 Gigabyte, are written to disk, hence your correct answer is 10 Gigabyte.''
|-
!scope="column" {{Lightgray_small}}| Institute
|scope="column" {{Tab element}} | State the full name of your Institute.
|-
|}

== Registration Response ==

After submitting you will get an email from the ZAS confirming your submission.
With this email you are given an unique
* RV acronym
* RV password

Please keep the password enclosed.
With RV acronym and password, [[Registration/bwForCluster/RV#Become_Coworker_of_a_RV| coworkers ]] can already associate themselves to the RV.
If this information is lost, please [[Registration/bwForCluster/RV#Renew_RV_Password|renew the password]] for the RV.

The cluster assignment team assigns a bwForCluster to your RV based on your submitted data, including the [https://www.bwhpc.de/bwhpc-domains.php research area] as well as the software and hardware requirements.
The ZAS notifies you in an email about your assigned bwForCluster and provides website details for [[Registration/bwForCluster/Service| Step C]].

= My RVs =

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
If you de-register from a RV, only a RV responsible or manager can activate (register) you again.
|}
You can see your RV memberships at [https://zas.bwhpc.de/shib/en/info_rv.php '''My RVs'''].
[[File:RV-my.png|center|frame|My RVs.]]

= Renew RV Password =

If you lose the RV password or want to create a new one, you can simply renew it:

1. Login to [https://zas.bwhpc.de/shib/en/info_rv.php '''My RVs'''] first.
[[File:RV-my.png|center|frame|My RVs.]]

2. Select the RV acronym for your RV.

3. Scroll down an click '''Renew password'''.
[[File:RV-pw.png|center|thumb|400px|Renew RV password.]]

= Duration of an RV =

A RV is valid for '''one year'''.
After that, the RV responsible must apply for an extension of the RV for it to be renewed for another year.

= Roles in a RV =

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
Once a member is inactive, only a RV responsible or manager can re-activate this member.
|}
The RV Responsible can assign managers to activate and deactivate coworkers.
RV responsible and RV managers can check the list of RV members at [https://zas.bwhpc.de/shib/en/info_rv.php '''My RVs'''] by selecting the RV acronym.
After a role change, click '''Save changes''' at the end of the members list.
[[File:RV-my.png|center|frame|My RVs.]]

{| style="width:100%;border:3px solid darkgray; margin: 1em auto 1em auto;"
|-
! style="width:20%;padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;"| Role
! style="padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;" | Explanation
|rowspan="4"| [[File:RV-member.png|center|400px|thumb|Roles in a RV.]]
|-
!scope="column" {{Lightgray_small}}| RV responsible
|scope="column" {{Tab element}} | Registers the RV, i.e. the planned compute activities. Can deactivate but also reactivate RV managers and coworkers. Can promote coworkers to mangers and vice versa.
|-
!scope="column" {{Lightgray_small}}| RV manager
|scope="column" {{Tab element}} | RV coworker with elevated rights to deactivate and reactivate other RV coworkers.
|-
!scope="column" {{Lightgray_small}}| RV coworker
|scope="column" {{Tab element}} | Typical user who has registered her/himself via RV acronym and password.
|-
|}

[[Registration/bwForCluster/Service | Go to step C]]

Registration/bwForCluster/Entitlement

2022-08-16T08:18:27Z

B Wellenkamp:

{|style="background:#ffffff; width:100%;"
|style="padding:5px; background:#ffffff; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#ffffff; text-align:left"|
The bwForCluster entitlement (see [https://www.bwidm.de/attribute.php#Berechtigung eduPersonEntitlement]) issued by a university assures the operator of a bwForCluster that its university member's compute activities comply with the German Foreign Trade Act (Außenwirtschaftsgesetz - AWG) und German Foreign Trade Regulations (Außenwirtschaftsverordnung - AWV).
|}

= Step A: bwForCluster Entitlement =

To register for a bwForCluster you need the '''bwForCluster Entitlement''' issued by your university.

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
The entitlement is called '''bwForCluster''' and each university assigns the entitlement '''only''' for its own members.
|}

If you are not sure if you already have an entitlement, please check it first with the [[Registration/bwForCluster/Entitlement#Check_your_Entitlements|'''Check your Entitlements''']] guide below.
If you need the entitlement, please follow the link for your institution or contact your local service desk if no information is provided:
* [https://www.hs-esslingen.de/informatik-und-informationstechnik/forschung-labore/projekte/forschungsprojekte/high-performance-computing/ Hochschule Esslingen]
* [[BwCluster User Access Uni Freiburg|Universität Freiburg]]
* [https://bwforcluster.urz.uni-heidelberg.de/ Universität Heidelberg]
* [https://kim.uni-hohenheim.de/bwhpc-account/ Universität Hohenheim]
* [http://www.scc.kit.edu/downloads/sdo/Antrag_Zugangsberechtigung_bwForCluster.pdf Karlsruhe Institute of Technology (KIT)]
* [[BwForCluster User Access Members Uni Konstanz|Universität Konstanz]]
* [[BwForCluster User Access Members Uni Mannheim|Universität Mannheim]]
* [https://www.hlrs.de/solutions-services/academic-users/bwforcluster-access/ Universität Stuttgart]
* [[BwForCluster User Access Members Uni Tübingen|Universität Tübingen]]
* [[BwForCluster User Access Members Uni Ulm|Universität Ulm]]
* [[Registration/HAW|HAW BW e.V.]]: Please contact your local service desk

== Check your Entitlements ==

To make sure you do not already have the entitlement, please log in to '''https://login.bwidm.de/user/index.xhtml'''.
To see the list of your entitlements, first select the '''Shibboleth''' tab at the top.
If the list below <code><nowiki>urn:oid:1.3.6.1.4.1.5923.1.1.1.7</nowiki></code> contains
<pre>http://bwidm.de/entitlement/bwForCluster</pre>
you already have the entitlement and can skip step A.
{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
<code><nowiki>http://bwidm.de/entitlement/bwForCluster</nowiki></code> is an attribute and not a link!
See [https://www.bwidm.de/dienste.php bwUniCluster und bwForCluster] for more information about needed attributes for this service.
|}
[[File:BwIDM-idp.png|center|600px|thumb|Verify Entitlement.]]

[[Registration/bwForCluster/RV|Go to step B]]

Registration/bwUniCluster/Questionnaire

2022-08-04T12:40:55Z

B Wellenkamp:

Registration/bwUniCluster/Questionnaire

2022-08-04T12:38:12Z

B Wellenkamp:

Registration/bwUniCluster/Service

2022-08-04T12:36:23Z

B Wellenkamp:

= Step B: bwUniCluster Registration =

After you have completed [[Registration/bwUniCluster/Entitlement|step A]], you need to register for the '''bwUniCluster''' service.
To do this, please visit '''https://login.bwidm.de''' and complete the following steps.

1. Select your home organization from the list on the main page and click '''Proceed/Fortfahren'''.
[[File:BwIDM-login.png|center|600px|thumb|Select your home organization]]

2. You will be directed to the ''Identity Provider'' of your home organization.
Enter the username and password of your '''home organization''' (usually these credentials are also used for other services like email) and click '''Login/Einloggen'''.

3. You will be redirected back to the registration page '''https://login.bwidm.de'''.
When you log in to bwIDM for the first time, an overview will appear, with the account information that your home institution submits to the system.
Please verify that all data is valid and then click '''Continue/Weiter'''.

4. After you have successfully logged into the bwIDM system, you will be greeted by a welcome screen that displays all the statewide services you have access to.
There you will find a field labeled '''bwUniCluster 2.0'''.
Click '''Register/Registrieren''' to start the registration process.
[[File:BwIDM-reg.png|center|frame|Register for bwUniCluster service.]]
{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
If you do not see the service, then you are probably missing the necessary entitlement.
Go to [[Registration/bwUniCluster/Entitlement|step A]] to check this.
|}

5. The bwUniCluster uses a '''2-factor authentication''' (2FA) mechanism to increase security.
If you have never registered a 2FA token on bwIDM, the following error message will appear:
[[File:Bwidm-3-red.png|center|600px|thumb|Second factor missing.]]

Use this '''[https://login.bwidm.de/user/twofa.xhtml link]''' or select '''My Tokens''' in the main menu.
To register a new token, please follow these '''[[Registration/2FA|instructions]]'''.
Please complete this step before continuing.

6. Read the Terms of Use ('''Nutzungsbedingungen und -richtlinien'''), place a check mark next to '''I have read and accepted the terms of use''' and click '''Register/Registrieren'''.

7. Set a service password for the bwUniCluster and click '''Save/Speichern'''.
Be sure to use a secure password that is different from any other passwords you currently use or have used on other systems.
[[File:BwIDM-passwd.png|center|600px|thumb|Set service password]]
{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
A login with the password of your home organization, as with the former bwUniCluster 1.0, is no longer possible.
|}

[[Registration/bwUniCluster/Questionnaire| Go to step C]]

Registration/bwUniCluster/Service

2022-08-04T12:34:30Z

B Wellenkamp:

Registration/bwUniCluster/Entitlement

2022-08-04T12:25:43Z

B Wellenkamp:

{|style="background:#ffffff; width:100%;"
|style="padding:5px; background:#ffffff; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#ffffff; text-align:left"|
The bwUniCluster entitlement (see [https://www.bwidm.de/attribute.php#Berechtigung eduPersonEntitlement]) issued by a university assures the operator of the bwUniCluster that its university member's compute activities comply with the German Foreign Trade Act (Außenwirtschaftsgesetz - AWG) und German Foreign Trade Regulations (Außenwirtschaftsverordnung - AWV).
|}

= Step A: bwUniCluster Entitlement =

To register for the bwUniCluster 2.0 you need the '''bwUniCluster Entitlement''' issued by your university.

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
The entitlement is called '''bwUniCluster''' (and not bwUniCluster 2.0) and each university assigns the entitlement '''only''' for its own members.
|}

If you are not sure if you already have an entitlement, please check it first with the [[Registration/bwUniCluster/Entitlement#Check_your_Entitlements|'''Check your Entitlements''']] guide below.
If you need the entitlement, please follow the link for your institution or contact your local service desk if no information is provided:
* [https://www.hs-esslingen.de/informatik-und-informationstechnik/forschung-labore/projekte/forschungsprojekte/high-performance-computing/ Hochschule Esslingen]
* [[BwCluster_User_Access_Uni_Freiburg|Universität Freiburg]]
* [https://bwunicluster.urz.uni-heidelberg.de/ Universität Heidelberg]
* [https://kim.uni-hohenheim.de/bwhpc-account Universität Hohenheim]
* [http://www.scc.kit.edu/downloads/ISM/Accessform_bwUniCluster_DE_EN.pdf Karlsruhe Institute of Technology (KIT)]
* [[BWUniCluster_User_Access_Members_Uni_Konstanz|Universität Konstanz]]
* [[BWUniCluster_User_Access_Members_Uni_Mannheim|Universität Mannheim]]
* [https://www.hlrs.de/solutions-services/academic-users/bwunicluster-access/ Universität Stuttgart]
* [https://uni-tuebingen.de/de/155157 Universität Tübingen]
* [[BWUniCluster_User_Access_Members_Uni_Ulm|Universität Ulm]]
* [[Registration/HAW|HAW BW e.V.]]: Please contact your local service desk

== Check your Entitlements ==

To make sure you do not already have the entitlement, please log in to '''https://login.bwidm.de/user/index.xhtml'''.
To see the list of your entitlements, first select the '''Shibboleth''' tab at the top.
If the list below <code><nowiki>urn:oid:1.3.6.1.4.1.5923.1.1.1.7</nowiki></code> contains
<pre>http://bwidm.de/entitlement/bwUniCluster</pre>
you already have the entitlement and can skip step A.
{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
<code><nowiki>http://bwidm.de/entitlement/bwUniCluster</nowiki></code> is an attribute and not a link!
See [https://www.bwidm.de/dienste.php bwUniCluster und bwForCluster] for more information about needed attributes for this service.
|}
[[File:BwIDM-idp.png|center|600px|thumb|Verify Entitlement.]]

{|style="text-align:right"|
[[Registration/bwUniCluster/Service | Go to step B]]
|}

Registration/bwUniCluster/Entitlement

2022-08-04T11:13:43Z

B Wellenkamp:

{|style="background:#ffffff; width:100%;"
|style="padding:5px; background:#ffffff; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#ffffff; text-align:left"|
The bwUniCluster entitlement (see [https://www.bwidm.de/attribute.php#Berechtigung eduPersonEntitlement]) issued by a university assures the operator of the bwUniCluster that its university member's compute activities comply with the German Foreign Trade Act (Außenwirtschaftsgesetz - AWG) und German Foreign Trade Regulations (Außenwirtschaftsverordnung - AWV).
|}

= Step A: bwUniCluster Entitlement =

To register for the bwUniCluster 2.0 you need the '''bwUniCluster Entitlement''' issued by your university.

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
The entitlement is called '''bwUniCluster''' (and not bwUniCluster 2.0) and each university assigns the entitlement '''only''' for its own members.
|}

If you are not sure if you already have an entitlement, please check it first with the [[Registration/bwUniCluster/Entitlement#Check_your_Entitlements|'''Check your Entitlements''']] guide below.
If you need the entitlement, please follow the link for your institution or contact your local service desk if no information is provided:
* [https://www.hs-esslingen.de/informatik-und-informationstechnik/forschung-labore/projekte/forschungsprojekte/high-performance-computing/ Hochschule Esslingen]
* [[BwCluster_User_Access_Uni_Freiburg|Universität Freiburg]]
* [https://bwunicluster.urz.uni-heidelberg.de/ Universität Heidelberg]
* [https://kim.uni-hohenheim.de/bwhpc-account Universität Hohenheim]
* [http://www.scc.kit.edu/downloads/ISM/Accessform_bwUniCluster_DE_EN.pdf Karlsruhe Institute of Technology (KIT)]
* [[BWUniCluster_User_Access_Members_Uni_Konstanz|Universität Konstanz]]
* [[BWUniCluster_User_Access_Members_Uni_Mannheim|Universität Mannheim]]
* [https://www.hlrs.de/solutions-services/academic-users/bwunicluster-access/ Universität Stuttgart]
* [https://uni-tuebingen.de/de/155157 Universität Tübingen]
* [[BWUniCluster_User_Access_Members_Uni_Ulm|Universität Ulm]]
* [[Registration/HAW|HAW BW e.V.]]: Please contact your local service desk

== Check your Entitlements ==

To make sure you do not already have the entitlement, please log in to '''https://login.bwidm.de/user/index.xhtml'''.
To see the list of your entitlements, first select the '''Shibboleth''' tab at the top.
If the list below <code><nowiki>urn:oid:1.3.6.1.4.1.5923.1.1.1.7</nowiki></code> contains
<pre>http://bwidm.de/entitlement/bwUniCluster</pre>
you already have the entitlement and can skip step A.
{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
<code><nowiki>http://bwidm.de/entitlement/bwUniCluster</nowiki></code> is an attribute and not a link!
See [https://www.bwidm.de/dienste.php bwUniCluster und bwForCluster] for more information about needed attributes for this service.
|}
[[File:BwIDM-idp.png|center|600px|thumb|Verify Entitlement.]]

[[Three Steps for Registration | back]]

Main Page

2022-08-04T11:06:27Z

B Wellenkamp:

'''Welcome to the bwHPC Wiki.'''

bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').

The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].

Many topics depend on the cluster system you use.
First choose the cluster you use, then select the correct topic.

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
|-
|
* [[Registration]]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[:Category:bwUniCluster_2.0|bwUniCluster 2.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster_JUSTUS_2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster_MLS&WISO| bwForCluster MLS&WISO]]
| style="padding-left:20px;" | Computational Humanities, Structural and Systems Biology, Medical Science, and Soft Matter
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster NEMO| bwForCluster NEMO]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster BinAC| bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics.
|}
|-
|
Further Compute Clusters in Baden-Württemberg (separate access policies):
* bwHPC [[:Category:bwHPC infrastructure|tier]] 1: [https://kb.hlrs.de/platforms/index.php/HPE_Hawk Hawk] ([https://www.hlrs.de/solutions-services/academic-users/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}

{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[BwHPC_BPG_for_Parallel_Programming| Parallel Programming]]
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
|-
|
For user guides of the scientific data storage services:
* [[sds-hd|SDS@hd]]
* [https://www.rda.kit.edu/english bwDataArchive] ([http://wiki.scc.kit.edu/lsdf/index.php/BwDataArchiv_FAQs FAQs])
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://bw-support.scc.kit.edu/ Submit a Ticket]
* extended Support via [https://zas.bwhpc.de/en/zas_info_tigerteamsupport.php "Tiger Teams"]

|}

Main Page

2022-08-04T10:44:36Z

B Wellenkamp:

'''Welcome to the bwHPC Wiki.'''

bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').

The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].

Many topics depend on the cluster system you use.
First choose the cluster you use, then select the correct topic.

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
|-
|
* [[Registration]]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[:Category:bwUniCluster_2.0|bwUniCluster 2.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster_JUSTUS_2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster_MLS&WISO| bwForCluster MLS&WISO]]
| style="padding-left:20px;" | Computational Humanities, Structural and Systems Biology, Medical Science, and Soft Matter
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster NEMO| bwForCluster NEMO]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[:Category:bwForCluster BinAC| bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics.
|}
|-
|
Further Compute Clusters in Baden-Württemberg (separate access policies):
* bwHPC [[:Category:bwHPC infrastructure|tier]] 1: [https://kb.hlrs.de/platforms/index.php/HPE_Hawk Hawk] ([https://www.hlrs.de/solutions-services/academic-users/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}

{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[BwHPC_BPG_for_Parallel_Programming| Parallel Programming]]
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
|-
|
For user guides of the scientific data storage services:
* [[sds-hd|SDS@hd]]
* [https://www.rda.kit.edu/english bwDataArchive] ([http://wiki.scc.kit.edu/lsdf/index.php/BwDataArchiv_FAQs FAQs])
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Contact persons Research Data Management (RDM)]
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://bw-support.scc.kit.edu/ Submit a Ticket]
* extended Support via [https://zas.bwhpc.de/en/zas_info_tigerteamsupport.php "Tiger Teams"]

|}

BwUniCluster 2.0 User Access

2017-08-28T08:27:53Z

B Wellenkamp:

[[bwUniCluster]] is Baden-Württemberg's general purpose tier 3 high performance computing (HPC)
cluster co-financed by Baden-Württemberg's ministry of science, research and arts and
the shareholders:
* Albert Ludwig University of Freiburg
* Eberhard Karls University, Tübingen
* Karlsruhe Institute of Technology (KIT)
* Ruprecht-Karls-Universität Heidelberg
* Ulm University
* University of Hohenheim
* University of Konstanz
* University of Mannheim
* University of Stuttgart
* HAW BW e.V. (an association of university of applied sciences in Baden-Württemberg)
 
To '''log on''' [[bwUniCluster]] a user account is required. All members of the shareholder
universities can apply for an account.
 

{| style="width: 100%; border-spacing: 5px;"
| style="text-align:left; color:#000;vertical-align:top;" |__TOC__
| [[File:bwUniCluster_17Jan2014_p044-rot_t10.10.00.jpg|center|border|250px|bwUniCluster wiring by Holger Obermaier, copyright: KIT (SCC)]] bwUniCluster wiring © KIT (SCC)
|}

= Registration =

Granting access and issuing a user account for '''''bwUniCluster''''' requires the registration at the KIT service website [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu] (step B). However, this registration depends on the '''bwUniCluster entitlement''' issued by your university (step A).
 

== Step A: bwUniCluster entitlement for registration ==
Each university issues the bwUniCluster entitlement '''only''' for their own members. Details on the issuing process and/or the entitlement application forms are listed hereafter:

* [[BwCluster_User_Access_Uni_Freiburg|Albert Ludwig University of Freiburg]]
* [http://www.zdv.uni-tuebingen.de/dienstleistungen/computing/zugang-zu-den-ressourcen.html Eberhard Karls University Tübingen]
* [http://www.scc.kit.edu/downloads/sdo/Antrag_Benutzernummer_bwUniCluster.pdf Karlsruhe Institute of Technology (KIT)]
* [[‎BWUniCluster_User_Access_Members_Uni_Heidelberg|Ruprecht-Karls-Universität Heidelberg]]
* [[BWUniCluster_User_Access_Members_Uni_Ulm|Ulm University]]
* [https://kim.uni-hohenheim.de/bwhpc-account University of Hohenheim]
* [[BWUniCluster_User_Access_Members_Uni_Konstanz|University of Konstanz]]
* [[BWUniCluster_User_Access_Members_Uni_Mannheim|University of Mannheim]]
* [https://www.hlrs.de/solutions-services/academic-users/bwunicluster-access/ University of Stuttgart]

 

== Step B: Web Registration ==
After step A, i.e., after issueing the bwUniCluster entitlement, please visit:
* [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu]
*# Select your home organization from the list and click '''Proceed'''
*# You will be directed to the ''Identity Provider'' of your home organisation
*# Enter your home-organisational user ID / username and your home-organisational password and click '''Login''' button
*# You will be redirected back to the registration website [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu/]
*# <div>Select unter '''The following services are available''' the service '''bwUniCluster''' [[File:bwRegWebApp_avail_services_pic01.png|center|border|]]</div>
*# Click '''Register'''
*# Finally
*#* for all non-KIT members '''mandatorily''' set a service password for authentication on bwUniCluster
*#* for KIT members '''optionally''' set a service password for authentication on bwUniCluster


 

== Step C: Amendment: bwUniCluster questionnaire ==
Starting June 1st, 2015, usage of bwUniCluster mandatorily requires the
questionnaire

https://www.bwhpc-c5.de/en/ZAS/bwunicluster_survey.php

to be answered. The input is solely used for the
elaboration of future support activities and for planning future HPC
resources. From June 1st, 2015, login to bwUniCluster is only permitted
to users who have already answered the questionnaire. '''''Exception''': For the first 14 days after the web registration login to bwUniCluster is permitted without participation in the questionnaire.''
 
 

== Changing Password ==
By default, for KIT members your bwUniCluster '''password''' to log on matches that one of your KIT
account, while for all non-KIT members your bwUniCluster '''password''' is that one you saved during the web registration (compare step 7 of chapter 1.2).
At any time, you can set a new bwUniCluster password via the registration website [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu] by carrying out the following steps:
# visit [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu] and select your home organization
# authenticate yourself via your home-organizational user id / username and your home-organizational password
# find on the left side '''bwUniCluster''' and select '''Set Service Password'''
# set new service, i.e. bwUniCluster, password, repeat it and click '''Save''' button.
# the page answers e.g. "Das Passwort wurde bei dem Dienst geändert" ("password has been changed")
# proceed to log in using the new password in the next step
 

== Contact ==
If you have questions or problems concerning bwUniCluster registration, please [[Registration_Support_-_bwUniCluster|contact your local hotline]].
 
 

= Login =
After finishing the web registration '''''bwUniCluster''''' is ready for your '''SSH''' based login.
'''''bwUniCluster''''' has two dedicated login nodes. The selection of the login node is done automatically and is based on a round-robin scheduling. Logging in another time the session might run
on the other login node.

Only the secure shell '''SSH''' is allowed to login. Other protocols like '''telnet''' or '''rlogin'''
are not allowed for security reasons.

A connection to '''''bwUniCluster''''' can be established by the command:

<pre>
$ ssh <UserID>@bwunicluster.scc.kit.edu
</pre>

If you are using '''OpenSSH''' (usually installed on Linux based systems) and you want to use a GUI-based application on '''''bwUniCluster''''' you should use the
''ssh'' command with the option ''-X''

<pre>
$ ssh -X <UserID>@bwunicluster.scc.kit.edu
</pre>

== Hints for using PuTTY ==
Start PuTTY, fill in at window ''PuTTY Configuration'' under category ''Session'' the following fields
<pre>
Host Name : <UserID>@bwunicluster.scc.kit.edu
Port : 22
Connection type : SSH
</pre>
and click on ''Open'', enter your password and accept adding ''host key''. Note that you can also name the configured session via ''Save'' and load it later via the given name.

== Hints for using WinSCP ==

Start WinSCP, fill in the following fields:
<pre>
File Protocol : SCP
Host name : bwunicluster.scc.kit.edu
Port : 22
User name : <UserID>
</pre>
and click on 'Login' and enter your password. Note that you can also name the configured session via ''Save'' and load it later via the given name.

== About UserID / Username ==

'''<UserID>''' of the ssh command is a placeholder for your '''''username''''' at your home
organization together with a '''''prefix''''' as followed:

{| width=450px class="wikitable"
! Home organization !! <UserID>
|-
| Universität Freiburg || ''fr_''username
|-
| Universität Heidelberg || ''hd_''username
|-
| Universität Hohenheim || ''ho_''username
|-
| KIT || username ''(without any prefix)''
|-
| Universität Konstanz || ''kn_''username
|-
| Universität Mannheim || ''ma_''username
|-
| Universität Stuttgart || ''st_''username
|-
| Universität Tübingen || ''tu_''username
|-
| Universität Ulm || ''ul_''username
|-
| Hochschule Aalen || ''aa_''username
|-
| Hochschule Albstadt-Sigmaringen || ''as_''username
|-
| Hochschule Esslingen || ''es_''username
|-
| Hochschule Furtwangen || ''hf_''username
|-
| Hochschule Karlsruhe || ''hk_''username
|-
| HTWG Konstanz || ''ht_''username
|-
| Hochschule Reutlingen || ''hr_''username
|-
| Hochschule Rottenburg || ''ro_''username
|-
| Hochschule für Technik Stuttgart || ''hs_''username
|-
| Hochschule Ulm || ''hu_''username
|-
|}

== Allowed activities on login nodes ==

The login nodes of bwUniCluster are the access point to the compute system and to your bwUniCluster $HOME directory. The login nodes are shared with all the users of bwUniCluster. Therefore, your activities on the login nodes are limited to primarily set up your batch jobs. Your activities may also be:
* '''short''' compilation of your program code and
* '''short''' pre- and postprocessing of your batch jobs.

To guarantee usability for all the users of bwUniCluster '''you must not run your compute jobs on the login nodes'''. Compute jobs must be submitted to the
[[bwUniCluster Batch Jobs|queueing system]]. Any compute job running on the login nodes will be terminated without any notice. Any long-running compilation or any long-running pre- or postprocessing of batch jobs must also be submitted to the [[bwUniCluster Batch Jobs|queueing system]].
 

= [[First_Steps_on_bwHPC_cluster|First steps on bwUniCluster]] =

First and some important steps on bwUniCluster can be found [[First_Steps_on_bwHPC_cluster|here]].

= Deregistration =
If you plan to permanently leave the bwUniCluster, follow the deregister checklist:
# Transfer all your data in $HOME and workspace to your local computer/storage and after that clear off all your data
# Visit [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu]
#* Select your home organization from the list and click '''Proceed'''
#* Enter your home-organisational user ID / username and your home-organisational password and click '''Login''' button
#* You will be redirected back to the registration website [https://bwidm.scc.kit.edu/ https://bwidm.scc.kit.edu/]
#* <div>Select '''Registry Info''' of the service '''bwUniCluster''' (on the left hand side) [[File:bwUniCluster_registration_sidebar.png|center|border|]]</div>
#* Click '''Deregister'''
Note that Step 2 will automatically unsubscribe you from the bwunicluster mail list.

----
[[Category:bwUniCluster|Access]][[Category:Access|bwUniCluster]]

BwForCluster User Access

2017-05-24T07:42:03Z

B Wellenkamp:

The usage of bwForCluster is free of charge. bwForClusters are customized to the requirements of particular research areas.
Each bwForCluster is/will be financed by the DFG (German Research Foundation) and by the Ministry of Science, Research and Arts of Baden-Württemberg based on scientifc grant proposal (compare proposals guidelines as per Art. 91b GG).

{| style="width: 100%; border-spacing: 5px;"
| style="text-align:center; color:#000;vertical-align:middle;font-size:75%;" |[[File:Bwforreg.svg|center|border|500px|]]
|-
| style="text-align:center; color:#000;vertical-align:middle;" |
|}

Granting user access to a bwForCluster requires 3 steps:

# Registration of a new or joining an already existing ''rechenvorhaben (RV)'' at [https://www.bwhpc-c5.de/en/ZAS/zas_overview.php "Zentrale Antragsseite (ZAS)"]. An ''RV'' defines the planned compute activities of a group of researchers. As coworker of this group you only need to register your membership in the corresponding ''RV''.
# Application for a [[#Issuing bwForCluster entitlement | bwForCluster entitlement]] issued by your university.
# [[#Personal registration at bwForCluster | Personal registration at assigned cluster site ]] based on approved ''RV'' [[File:Zas assignment icon.svg|25px|]] and issued bwForCluster entitlement [[File:bwfor entitlement icon.svg|25px|]].

 
Step 1 and 2 are pre-steps and requirements of step 3. Moreover, steps 1 and 2 can be done in parallel. The question, at which bwForCluster site to do step 3, will be answered by the cluster assignment team (CAT) based on the data of step 1, i.e. at ''ZAS''.

= ''RV'' registration at ''ZAS'' =

The ''rechenvorhaben (RV)'' registration at ''ZAS'' does '''not''' correspond to typical compute project proposals as for other HPC clusters, since:
* there is no scientific reviewing process
* the registration inquires only brief details and
* it covers a group of coworkers, and
* only the ''RV'' responsible must submit the ''RV''.
 

== How to register? ==
=== Register a new ''RV'' ===
Typically only the leader of a scientific work group or the senior scientist of a research group/collaboration needs to login at
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_rv_registration.php
and to fill in all mandatory fields of the given web form. Please note that for your convenience you can also switch to the [https://www.bwhpc-c5.de/ZAS/bwforcluster_rechenvorhaben.php german version] of the web form. The submitter of the ''rechenvorhaben (RV)'' will be assigned the role ''RV'' responsible.

The web form consists of the following fields to be filled:
{| style="width:100%;border:3px solid darkgray; margin: 1em auto 1em auto;"
|-
! style="width:25%;padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;"| Field
! style="padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;" | Explanation
|-
!scope="column" {{Lightgray_small}}| RV Title
|scope="column" {{Tab element}} | Define a short title of your planned compute activities, maximum of 255 characters including spaces.
|-
!scope="column" {{Lightgray_small}}| RV Description
|scope="column" {{Tab element}} | Write a short abstract about your planned compute activities (maximum of 2048 characters including spaces). Research groups that contributed to the DFG grant proposal (Art. 91b GG) of the corresponding bwForCluster only need to give reference to that particular proposal.
|-
!scope="column" {{Lightgray_small}}| Scientific field
|scope="column" {{Tab element}} | Tick one or several scientific fields. Once all bwForClusters are up and running the full list of given scientific fields are supported and hence for ''rechenvorhaben (RV)'' applicable. If your ''RV'' does not match any given scientific field, please state your scientific field in the given text box. Grayed out scientific fields indicate that the corresponding bwForCluster(s) is/are not operational yet.
|-
!scope="column" {{Lightgray_small}}| Field of activity
|scope="column" {{Tab element}} | Define if your ''RV'' is primarily for research and/or teaching. If not applicable, use text box.
|-
!scope="column" {{Lightgray_small}}| Parallel paradigm
|scope="column" {{Tab element}} | State what parallel paradigm your code or application uses. Multiple ticks are allowed. Further information can be provided via text box. If you are not sure about it, please state the software you are using.
|-
!scope="column" {{Lightgray_small}}| Programming language
|scope="column" {{Tab element}} | State the programming language(s) of your code or application.
|-
!scope="column" {{Lightgray_small}}| Numerical methods
|scope="column" {{Tab element}} | State the numerical or "calculation" methods your code or application utilises. If you do not know, write "unknown".
|-
!scope="column" {{Lightgray_small}}| Software packages
|scope="column" {{Tab element}} | State all software package you will or want to use for your ''RV''. Also include compiler, MPI and numerical packages (e.g. MKL, FFTW).
|-
!scope="column" {{Lightgray_small}}| Estimated requested computing resources
|scope="column" {{Tab element}} | Roughly estimate how many CPU hours are required to finish your ''RV''. To calculate "CPU hours" multiply "elapsed parallel computing time" with "number of CPU core" per job.
''Example: Your code uses 4 CPU cores and has a wall time of 1h. This makes 4 CPU hours.''
|-
!scope="column" {{Lightgray_small}}| Planned maximum number of parallel used CPU cores per job
|scope="column" {{Tab element}} | Give an upper limit of how many CPU cores per job are required. Please cross-check with your statement about parallel paradigm.
''Obviously, a sequential code can only use 1 CPU core per job.''
|-
!scope="column" {{Lightgray_small}}| Estimated maximal memory requirements per CPU core
|scope="column" {{Tab element}} | Give an upper limit of how much RAM per CPU core your jobs require. Please give a value in GigaBytes.
|-
!scope="column" {{Lightgray_small}}| Estimated requested persistent disk space for the ''RV''
|scope="column" {{Tab element}} | State how much disk space in total you need for your ''RV''. Please give a value in GigaBytes.
''Example: If your RV has 4 more coworker and each of you produces until the end of your RV 20 GigaByte of output, your maximum disk space is 100 GigaByte.''
|-
!scope="column" {{Lightgray_small}}| Estimated maximal temporary disk space per job
|scope="column" {{Tab element}} | State how much space your intermediate files require during a job run. Please give a value in GigaBytes.
''Example: Your final output of your job is 0.1 GigaByte, but during your job 10 temporary files, each with a size of 1 GigaByte, are written to disk, hence your correct answer is 10 GigaByte.''
|-
!scope="column" {{Lightgray_small}}| Institute
|scope="column" {{Tab element}} | State the full name of your Institute.
|-
|}
Note that the fields - name, firstname, organization, mail, und EPPN - are auto-filled and can not be changed. These are your credentials as given by your home organization.

Response
# After submitting you will get an email from ''ZAS'' confirming your submission. With this email you are given an unique * acronym * password Please keep the password enclosed. Only with both, acronym and password, [[BwForCluster_User_Access#Register_for_an_RV_as_coworker | coworkers ]] can be added to your ''rechenvorhaben''.
# The cluster assignment team will be notified immediately about your submission.
# The cluster assignment team decides based on your submitted data which bwForCluster most fits, and submits its decision to ''ZAS''.
# ''ZAS'' notifies you in an email about your assigned bwForCluster and provides website details for [[BwForCluster_User_Access#Personal_registration_at_bwForCluster | step 3 ]].

 

=== Register for an ''RV'' as coworker ===

Each coworker must add herself/himself to a ''rechenvorhaben (RV)''.
To become coworker of an ''RV'', please login at
* https://www.bwhpc-c5.de/en/ZAS/bwforcluster_collaboration.php
and provide the
* acronym
* password
of the ''RV''. Your ''RV'' responsible will provide you with that information.
You will be assigned to role ''RV'' member.

Response
# After submitting the request for participating in an ''RV'', the coworker will receive an email from ''ZAS'' about the further steps (i.e. [[#Personal registration at bwForCluster | personal registration at assigned bwForCluster]]). The membership status in the ''RV'' is set active by default.
# Each person with role ''RV'' responsible or ''RV'' manager will be notified automatically. They can check the list of ''RV'' members at https://www.bwhpc-c5.de/en/ZAS/info_rv.php by clicking on the ''RV'' acronym.
# The ''RV'' responsible can set any ''RV'' coworker to ''RV'' manager and vice versa as well as deactivate/reactivate any ''RV'' coworker or ''RV'' manager.
# An ''RV'' manager can deactivate/reactivate any ''RV'' coworker.



== Roles in an ''RV'' ==
{| style="width:100%;border:3px solid darkgray; margin: 1em auto 1em auto;"
|-
! style="width:25%;padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;"| Role
! style="padding:2px;margin:3px; background:#AAA; font-size:100%; font-weight:bold; border:1px solid #BBBBBB; text-align:left; color:#000; padding:0.2em 0.4em;" | Explanation
|-
!scope="column" {{Lightgray_small}}| RV responsible
|scope="column" {{Tab element}} | Registers the ''rechenvorhaben (RV)'', i.e. the planned compute activities. Can deactivate but also reactivate ''RV'' managers and coworkers. Can promote coworkers to mangers and vice versa.
|-
!scope="column" {{Lightgray_small}}| RV manager
|scope="column" {{Tab element}} | ''RV'' coworker with elevated rights to deactivate and reactivate other ''RV'' coworkers.
|-
!scope="column" {{Lightgray_small}}| RV coworker
|scope="column" {{Tab element}} | Typical user who has registered her/himself via ''RV'' acronym and password.
|-
|}

 

= Issuing bwForCluster entitlement =

Each university issues the bwForCluster entitlement
<pre>http://bwidm.de/entitlement/bwForCluster</pre>
only for their own members.

The bwForCluster entitlement issued by a university assures the operator of a bwForCluster that its university member's compute activities comply with the German Foreign Trade Act (Außenwirtschaftsgesetz - AWG) und German Foreign Trade Regulations (Außenwirtschaftsverordnung - AWV).

The following unversities have already established a process to issue the bwForCluster entitlement:

* [[BwForCluster User Access Members Hochschule Esslingen|Hochschule Esslingen]]
* [[BwCluster User Access Uni Freiburg|University of Freiburg]]
* [[BwForCluster User Access Members Uni Heidelberg|University of Heidelberg]]
* University of Hohenheim
* [http://www.scc.kit.edu/downloads/sdo/Antrag_Zugangsberechtigung_bwForCluster.pdf Karlsruhe Institute of Technology (KIT)]
* [[BwForCluster User Access Members Uni Konstanz|University of Konstanz]]
* [[BwForCluster User Access Members Uni Mannheim|University of Mannheim]]
* [https://www.hlrs.de/solutions-services/academic-users/bwforcluster-access/ University of Stuttgart]
* [[BwForCluster User Access Members Uni Tübingen|University of Tübingen]]
* [[BwForCluster User Access Members Uni Ulm|University of Ulm]]

If you do not find your university in the list above, please contact your local service desk.

= Personal registration at bwForCluster =

Once you have registered your own RV (''rechenvorhaben'')
or a membership in an RV, the cluster assignment team will provide
you with information about your designated cluster. You will receive
an email with a website to create an account for yourself
on that cluster.

Available bwForCluster registration servers (service providers):
{| style="border:3px solid darkgray; margin: 1em auto 1em auto;" width="72%"
|-
!scope="row" {{Darkgray}} | Cluster topic and location
!scope="row" {{Darkgray}} | Registration server
|-
| bwForCluster Chemistry JUSTUS Ulm
| http://bwidm.rz.uni-ulm.de
|-
| bwForCluster MLS&WISO (Production and Development)
| https://bwservices.uni-heidelberg.de
|-
| bwForCluster NEMO Freiburg
| https://bwservices.uni-freiburg.de
|-
| bwForCluster BinAC Tübingen
| https://bwservices.uni-tuebingen.de
|}

Please note, this step is different to your registration at ZAS since
here you register yourself as a person. Only based on your personal credentials
a user account can be generated. However, resource requests of the RV in ZAS
will be cross-checked with the resources consumed by you and your RV coworkers
on this cluster.

After steps 1 and 2 (RV approval and bwForCluster entitlement) please visit the

* bwForCluster ''service provider'' registration website (see table above or email after RV approval):
*# Select your home organization from the list of organizations and click '''Proceed'''.
*# You will be redirected to the ''Identity Provider'' of your home organization.
*# Enter your home-organizational user ID (might be user name, email, ...) and password and click '''Login''' or '''Anmelden'''.
*# When doing this for the first time you need to accept that your personal data is transferred to the ''service provider''.
*# You will be redirected back to the cluster registration website.
*# Select '''Service Description''' of the designated cluster.
*# Click on '''Register''' link to register for this cluster.
*# Read and accept the terms and conditions of use and click on button '''Register'''.
*# Finally you will receive an email with instructions how to login to the cluster (please wait ~15 minutes before trying).
*# Optionally but strongly recommended: Click on '''Set Service Password''' and set a password for the cluster.
*# '''Note: Tübinger users don't need to set a separate service password''' and can use their local account credentials instead.
*# '''Note:''' You can return to the registration website at any time, in order to review your registration details, change/reset your service password or deregister from the service by yourself.

= Login to bwForCluster =

Personalized details about how to login to the cluster are included
in an email send after registration at the bwForCluster service provider.

General instructions for the bwForCluster login can be found here:
{| style="border:3px solid darkgray; margin: 1em auto 1em auto;" width="73%"
|-
!scope="row" {{Darkgray}} | Cluster topic and location
!scope="row" {{Darkgray}} | Login instructions
|-
| bwForCluster Chemistry JUSTUS Ulm
| [[BwForCluster_Chemistry_Login|bwForCluster Chemistry Login]]
|-
| bwForCluster MLS&WISO Production
| [[BwForCluster_MLS&WISO_Production_Login|bwForCluster MLS&WISO Production Login]]
|-
| bwForCluster MLS&WISO Development
| [[BwForCluster_MLS&WISO_Development_Login|bwForCluster MLS&WISO Development Login]]
|-
| bwForCluster NEMO Freiburg
| [[bwForCluster NEMO Login]]
|-
| bwForCluster BinAC Tübingen
| [[bwForCluster BinAC Login]]

|}

 

----
[[Category:Access|bwForCluster]][[Category:bwForCluster_Chemistry]][[Category:bwForCluster_MLS&WISO_Production]][[Category:bwForCluster_MLS&WISO_Development]]