bwHPC Wiki - Recent changes [en]

FAQ

K Siegmund — Mon, 22 Jun 2026 13:31:20 GMT

Access and Account Issues: bwForCluster

← Older revision		Revision as of 15:31, 22 June 2026
(One intermediate revision by the same user not shown)
Line 40:		Line 40:
	Please check which of those two things are missing using the following documentation:		Please check which of those two things are missing using the following documentation:

	==== Entitlement ====		==== Entitlement (and IDP Problems) ====

	You need the bwForCluster Entitlement.		You need the bwForCluster Entitlement.

			The same page can also help you recognize problems with the IDP (identity provider) of your home university

	<b>→</b> Read [[Registration/bwForCluster/Entitlement]] and check if it is present.		<b>→</b> Read [[Registration/bwForCluster/Entitlement]] and check if it is present.

			In case
⚫	~~If the entitlement is missing:~~ please check with the local support of your home university (the university where you study or are employed)
			* the entitlement is missing
			* Name/Email/eduPersonPrincipalName in the "personal data" tab are incorrect or missing
		⚫	<b>→</b> please check with the local support of your home university (the university where you study or are employed)

			Note: in case of temporary problems with your IDP, data in the registration server can become corrupted or missing. Logging in to the registration server that your cluster uses can fix this problem and fill in correct values again. Check in [[Registration/Password]] which registration server your cluster uses and log in there (for some cluster it is the same as given for the Entitlement Check).

	==== ZAS Permission ====		==== ZAS Permission ====

Registration/bwForCluster/Entitlement

K Siegmund — Mon, 22 Jun 2026 13:22:01 GMT

Check your Entitlements

← Older revision		Revision as of 15:22, 22 June 2026
Line 18:		Line 18:
	== Check your Entitlements ==		== Check your Entitlements ==

⚫	First check if you already have the Entitlement, some universities automatically assign the entitlement to some accounts:

		⚫	First check if you already have the Entitlement, some universities automatically assign the entitlement to some accounts (you must allow that your data is being transferred to that page or your cluster login will also not work):
⚫	→ '''[https://login.bwidm.de/user/index.xhtml?show=entitlement&highlight=bwForCluster Registration Server bwForCluster Entitlement Check]'''

		⚫	→ '''[https://login.bwidm.de/user/index.xhtml?show=entitlement&highlight=bwForCluster Registration Server bwForCluster Entitlement Check]'''
	<!-- image can be deleted [[File:BwIDM-idp.png\|center\|600px\|thumb\|Verify Entitlement.]] -->

	Note: if you cannot log in to the registration server at all, some crucial information is missing in the information your home university is transmitting to it. Contact the helpdesk of your home university.		Note: if you cannot log in to the registration server at all, some crucial information is missing in the information your home university is transmitting to it. Contact the helpdesk of your home university.

File:BwIDM-idp.png

K Siegmund — Mon, 22 Jun 2026 13:20:35 GMT

K Siegmund deleted page File:BwIDM-idp.png replaced by tab showing only entitlement

Registration/bwForCluster/RV/Management

H Schumacher — Mon, 22 Jun 2026 10:59:31 GMT

added RV extension section, redesigned 'change RVV' section

@@ Line 44: / Line 44: @@
 ==== Change the RV Responsible ====
-Prerequisites:
+<ins>Prerequisites:</ins>
 * You need to be the current RV responsible. In case you don't have access to your account anymore, you can ask the cluster support for help.
-* The person you want to appoint new responsible is a member of the RV.
+* The person you want to appoint as new RV responsible is a member of the RV.
-Steps:
+<ins>Steps:</ins>
-[[File:RV-my.png|center|frame|My RVs.]]
+File:RV-my.png|center|frame|'''1.''' Login to [https://zas.bwhpc.de/shib/en/info_rv.php '''My RVs'''] and go to the RV.

DACHS/Jupyter

M Kunzelmann — Fri, 19 Jun 2026 11:59:40 GMT

Prerequisites

← Older revision		Revision as of 13:59, 19 June 2026
Line 17:		Line 17:
	== Prerequisites ==		== Prerequisites ==
	# Register as described on the [[DACHS/Registration\|Registration]]		# Register as described on the [[DACHS/Registration\|Registration]]
	# Then [[DACHS/Login\|login to DACHS]] via SSH '''at least once''': This ensures that your home directory is setup properly on DACHS
	# Make sure you're '''connected to the VPN of your university''' (see above)		# Make sure you're '''connected to the VPN of your university''' (see above)


	= Login Process =		= Login Process =

Justus3/Getting Started

K Siegmund — Fri, 19 Jun 2026 11:21:17 GMT

Created page with " == Pre-Requisite: Get Cluster Access == Follow the registration process for the bwForCluster. → How to Register for a bwForCluster == Pre-Requisite: Know the Workflow of Running Calculations == On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers. Ho..."

New page

== Pre-Requisite: Get Cluster Access ==

Follow the registration process for the bwForCluster.

→ [[Registration/bwForCluster|How to Register for a bwForCluster]]

== Pre-Requisite: Know the Workflow of Running Calculations ==

On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers.

How this is done is described in a little more detail here: [[Running Calculations]]

== Login to the Cluster ==

Setup service password and 2FA token and login to the cluster. → [[JUSTUS2/Login|Login JUSTUS2]]

== Online Course on Justus2 ==
* Training course → [https://training.bwhpc.de/goto.php?target=crs_629_rcodeM6n48kAUsT&client_id=BWHPC Introduction to JUSTUS2 ]

== Know the Cluster Rules ==

→ '''[[JUSTUS2/Policy_Agreement]]'''

== Using the Linux Commandline ==

* [[Media:HPC_User_Linux_command_cheatsheet.pdf|HPC User's Linux Cheat Sheet (PDF)]]

* HPC Wiki (external site) → [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line Introduction to Linux Commandline]

* Training course → [https://training.bwhpc.de/ilias.php?baseClass=illmpresentationgui&cmd=resume&ref_id=310 Linux course on training.bwhpc.de] (please log in to the training site, then click this link again)

also see: [[.bashrc Do's and Don'ts]]

== Transfer your Data to the Cluster ==

Get familiar with available file systems on the cluster. → [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)#Storage_Architecture|File Systems]]

Transfer your data to the cluster using appropriate tools. → [[Data Transfer|Data Transfer]]

== Find Information About Installed Software and Examples ==

Compiler, Libraries and application software are provided as software modules. Learn how to work with
[[Environment_Modules|software modules]]. → [[JUSTUS2/Software|Software]]


Run sample script from a pre-installed software (Software job examples in the page above)

== Run your Software in a Batch Job ==

Get familiar with available nodes types on the cluster. → [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)|Hardware and Architecture]]

Submit and monitor your jobs with Slurm commands.
* → [[JUSTUS2/Jobscripts: Running Your Calculations|Jobscripts: Running Your Calculations]]
* → [[BwForCluster_JUSTUS_2_Slurm_HOWTO| extensive Slurm HOWTO on specific tasks]]

== Learn about Scaling your Job ==

How many compute-cores should my job use? This depends on the software and the problem you are trying to solve. But if you use too few cores, your computation may take much too long - if you use too many cores, they will not improve the speed of your computation and all you do by using more cores is wasting compute resources and energy.

If you run hundreds or thousands of similar calculations, you should look at this carefully before starting.

How to do this is described in: [[Scaling]]

== Acknowledge the Cluster ==

Remember to mention the cluster in your publications. → [[bwForCluster JUSTUS 2 Acknowledgement|Acknowledgement]]

Justus3

K Siegmund — Fri, 19 Jun 2026 09:15:33 GMT

← Older revision		Revision as of 11:15, 19 June 2026
Line 3:		Line 3:

	The '''bwForCluster Justus 3''' is the state-wide high-performance compute cluster dedicated to '''Computational Chemistry and Quantum Sciences''' in Baden-Württemberg.		The '''bwForCluster Justus 3''' is the state-wide high-performance compute cluster dedicated to '''Computational Chemistry and Quantum Sciences''' in Baden-Württemberg.

	<!--{\| style=" background:#FEF4AB; width:100%;"
	\| style="padding:8px; background:#FFE856; font-size:120%; font-weight:bold; text-align:left" \| News
	\|-
	\|
	\|}
	-->
	{\| style=" background:#FEF4AB; width:100%;"		{\| style=" background:#FEF4AB; width:100%;"
	\| style="padding:8px; background:#FFE856; font-size:120%; font-weight:bold; text-align:left" \| News		\| style="padding:8px; background:#FFE856; font-size:120%; font-weight:bold; text-align:left" \| News
	\|-		\|-
	\|		\|
			* 2026-06-16: Cooling installations for the new cluster has been enabled
	* None
	\|}		\|}
	{\| style=" background:#eeeefe; width:100%;"		{\| style=" background:#eeeefe; width:100%;"

Justus3

K Siegmund — Fri, 19 Jun 2026 09:06:28 GMT

Created page with " 700px The '''bwForCluster Justus 3''' is the state-wide high-performance compute cluster dedicated to '''Computational Chemistry and Quantum Sciences''' in Baden-Württemberg.  {| style=" b..."

New page

[[File:Justus3_header.png|700px]]

The '''bwForCluster Justus 3''' is the state-wide high-performance compute cluster dedicated to '''Computational Chemistry and Quantum Sciences''' in Baden-Württemberg.

{| style=" background:#FEF4AB; width:100%;"
| style="padding:8px; background:#FFE856; font-size:120%; font-weight:bold; text-align:left" | News
|-
|
* None
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Training & Support
|-
|
* [[Justus3/Getting Started|Getting Started]]
* Online Tutorial [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC] (external link)
* [[Justus3/Support|Contact and Support]]
* Send [[Feedback|Feedback]] about Wiki pages
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | User Documentation
|-
|
* [[Registration/bwForCluster|Registration]]
* [[Justus3/Policy Agreement|Policy Agreement]]

* [[Justus3/Login|Login]]
* [[Justus3/Hardware|Hardware and Architecture]]
** [[Justus3/Hardware#Node_Specifications|Node Specifications]]
** [[Justus3/Hardware#Storage_Architecture|File Systems and Workspaces]]

* [[Justus3/Software|Software]]
* [[Justus3/Jobscripts: Running Your Calculations|Jobscripts: Running Your Calculations]]
** [[bwForCluster Justus 3 Slurm HOWTO|Slurm HOWTO]]
* [[Justus3/Visualization|Visualisation]]
* [[Development]]
|}

{| style=" background:#e6e9eb; width:100%;"
| style="padding:8px; background:#d1dadf; font-size:120%; font-weight:bold; text-align:left" | Cluster Funding
|-
|
* Please '''[[Justus3/Acknowledgement|acknowledge]]''' the Justus 3 cluster in your publications.
|}

Status

K Siegmund — Fri, 19 Jun 2026 08:30:23 GMT

← Older revision		Revision as of 10:30, 19 June 2026
Line 6:		Line 6:
	Due to work on the power supply of the cooling system all jobs have been suspended to prevent overheating.-->		Due to work on the power supply of the cooling system all jobs have been suspended to prevent overheating.-->

	{{Template:Status\|~~warn~~\|Status: ~~BinAC 2 maintenance: June 8–12~~ }}		{{Template:Status\|ok\|Status: Ok}}

	<!--		<!--
Line 16:		Line 16:

	== Relevant Old Messages ==		== Relevant Old Messages ==
			* BinAC 2 maintenance: June 8–12
	None

Main Page

K Siegmund — Fri, 19 Jun 2026 08:29:53 GMT

← Older revision		Revision as of 10:29, 19 June 2026
Line 10:		Line 10:
	<!-- bwHPC STATUS START -->		<!-- bwHPC STATUS START -->

	~~<!--~~{{Template:Status\|~~warn~~\|Status: ~~Jobs suspended on Justus 2~~}}~~-->~~		{{Template:Status\|ok\|Status: Ok}}
⚫	{{Template:Status\|warn\|Status: ~~BinAC~~ 2 ~~maintenance:~~ ~~June 8–12~~ }}

	<!--		<!--
Line 18:		Line 17:
	{{Template:Status\|warn\|Status: maintenance upcoming}}		{{Template:Status\|warn\|Status: maintenance upcoming}}
	{{Template:Status\|alert\|Status: bwUniCluster down}}		{{Template:Status\|alert\|Status: bwUniCluster down}}
		⚫	{{Template:Status\|warn\|Status: Jobs suspended on Justus 2}}
	-->		-->

Data Transfer/SSHFS

K Siegmund — Wed, 17 Jun 2026 14:26:17 GMT

@@ Line 15: / Line 15: @@
 == Usage ==
 === Windows ===
@@ Line 34: / Line 60: @@
 # subfolderX
 sshfs <username>@<hostname>:subfolderX <localPath></syntaxhighlight></li></ol>

Registration/bwForCluster/Helix

H Schumacher — Wed, 17 Jun 2026 08:43:27 GMT

emphasized main point

← Older revision		Revision as of 10:43, 17 June 2026
Line 43:		Line 43:
	=== Troubleshooting with the Help of bwServices ===		=== Troubleshooting with the Help of bwServices ===
	When encountering connection issues with a service, the bwServices website is a good starting point for troubleshooting:		When encountering connection issues with a service, the bwServices website is a good starting point for troubleshooting:
			{\| style="border: 2px solid #FFD28A; background-color: #ffe0af; padding: 10px; margin-bottom: 1em; width: 100%;"
			\|-
		⚫	\| '''⚠ Login to bwServices first.''' This triggers an update of your user information within some minutes and solves the connection issue in the following cases:
			* User data changed: entitlement, SV/RV status, SV/RV membership status, role or email address changed or uni-id was (re)activated
			* Synchronization issues of the service
			\|}

	* <ins>'''Issue:</ins> Expired contract''' or inactive student id:		* <ins>'''Issue:</ins> Expired contract''' or inactive student id:
	** No access to state services like the bwHPC clusters or SDS@hd is possible.		** No access to state services like the bwHPC clusters or SDS@hd is possible.
	** You can see that this is the issue when the login to bwServices via your identity provider is not possible.		** You can see that this is the issue when the login to bwServices via your identity provider is not possible.
	* <ins>'''Issue:</ins> Recently (re)activated uni-id or other user data changes:''' Your id at your home organization was (re)activated a short time ago or your email address changed (or sth. similar) but this change didn't get through to the bwHPC cluster or SDS@hd service.
⚫	** Login to bwServices. This triggers an update of your user information. ~~Some~~ minutes ~~later,~~ the connection to the ~~service~~ ~~should work again.~~
	* <ins>'''Issue:</ins> Entitlement / RV missing:''' Prerequisites like entitlement ownership or RV membership aren't met (anymore).		* <ins>'''Issue:</ins> Entitlement / RV missing:''' Prerequisites like entitlement ownership or RV membership aren't met (anymore).
	** You can see the concrete issue and advice on how to move forward when looking at the registry info of the service on the bwServices website.		** You can see the concrete issue and advice on how to move forward when looking at the registry info of the service on the bwServices website.