BwUniCluster3.0/Running Jobs/Slurm - Revision history

P Schuhmacher: /* BeeOND (BeeGFS On-Demand) */

2025-08-19T09:30:21Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 11:30, 19 August 2025
Line 733:		Line 733:
	* BEEOND_MAXMDS: on every node of your job a metadata server for the on_demand file system is started		* BEEOND_MAXMDS: on every node of your job a metadata server for the on_demand file system is started

	BEEOND will only work if the node is allocated exclusively, meaning that no other jobs are running on the same node. To achieve this, use the batch option "--exclusive". This is particularly important ~~in the~~ in shared partitions.		BEEOND will only work if the node is allocated exclusively, meaning that no other jobs are running on the same node. To achieve this, use the batch option "--exclusive". This is particularly important in shared partitions.

	As starting point we recommend using the "BEEOND" option. If you are unsure if this is sufficient for you feel free to contact the support team.		As starting point we recommend using the "BEEOND" option. If you are unsure if this is sufficient for you feel free to contact the support team.

2025-08-19T09:29:54Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 11:29, 19 August 2025
Line 732:		Line 732:
	* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.		* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.
	* BEEOND_MAXMDS: on every node of your job a metadata server for the on_demand file system is started		* BEEOND_MAXMDS: on every node of your job a metadata server for the on_demand file system is started

			BEEOND will only work if the node is allocated exclusively, meaning that no other jobs are running on the same node. To achieve this, use the batch option "--exclusive". This is particularly important in the in shared partitions.

	As starting point we recommend using the "BEEOND" option. If you are unsure if this is sufficient for you feel free to contact the support team.		As starting point we recommend using the "BEEOND" option. If you are unsure if this is sufficient for you feel free to contact the support team.
Line 738:		Line 740:
	#SBATCH ...		#SBATCH ...
	#SBATCH --constraint=BEEOND # or BEEOND_4MDS or BEEOND_MAXMDS		#SBATCH --constraint=BEEOND # or BEEOND_4MDS or BEEOND_MAXMDS
			#SBATCH --exclusive
	</source>		</source>

2025-04-06T17:56:42Z

← Older revision		Revision as of 19:56, 6 April 2025
Line 1:		Line 1:
	{\| style="background:#FFCCCC; width:100%; font-size:120%;"		{\| style="background:#FFCCCC; width:100%; font-size:120%;"
	\| '''This page is work-in-progress'''<br>		\| '''This page is work-in-progress'''<br>
	We will ~~update~~ all examples and ~~provide~~ gold-standard		We will revise all examples and describe gold standard ways to use the resources efficiently: OpenMP, MPI and hybrid using MPI+OpenMP
	\|}		\|}

2025-04-06T17:55:04Z

← Older revision		Revision as of 19:55, 6 April 2025
Line 1:		Line 1:
			{\| style="background:#FFCCCC; width:100%; font-size:120%;"
			\| '''This page is work-in-progress'''<br>
			We will update all examples and provide gold-standard
			\|}

	= Slurm HPC Workload Manager =		= Slurm HPC Workload Manager =
	== Specification ==		== Specification ==

2025-04-06T17:50:00Z

← Older revision	Revision as of 19:50, 6 April 2025
(No difference)

2025-04-06T17:47:44Z

← Older revision		Revision as of 19:47, 6 April 2025
Line 1:		Line 1:

	{\|style="background:#FEF4AB; width:100%;"
	\|style="padding:5px; background:#FEF4AB; text-align:left"\|
	This page is work in progress.
	\|}


	= Slurm HPC Workload Manager =		= Slurm HPC Workload Manager =
	== Specification ==		== Specification ==

2025-04-04T14:52:44Z

Shows free resources : sinfo_t_idle

← Older revision		Revision as of 16:52, 4 April 2025
Line 817:		Line 817:
	<br>		<br>
	SCC has prepared a special script (sinfo_t_idle) to find out how many processors are available for immediate use on the system. It is anticipated that users will use this information to submit jobs that meet these criteria and thus obtain quick job turnaround times.		SCC has prepared a special script (sinfo_t_idle) to find out how many processors are available for immediate use on the system. It is anticipated that users will use this information to submit jobs that meet these criteria and thus obtain quick job turnaround times.
	<br>
	<br>
	=== Access ===
	By default, this command can be used by any user or administrator.
	<br>		<br>
	<br>		<br>
Line 838:		Line 834:
	Partition gpu_h100_il : 0 nodes idle		Partition gpu_h100_il : 0 nodes idle
	</pre>		</pre>
	* For the above example jobs in all partitions can be run immediately.
	<br>		<br>

2025-04-04T08:12:22Z

Examples

← Older revision		Revision as of 10:12, 4 April 2025
Line 796:		Line 796:

	=== Examples ===		=== Examples ===
	''squeue'' example on bwUniCluster 2.0 <small>(Only your own jobs are displayed!)</small>.		''squeue'' example on bwUniCluster 3.0 <small>(Only your own jobs are displayed!)</small>.
	<pre>		<pre>
	$ squeue		$ squeue

2025-04-04T08:12:09Z

Examples

← Older revision		Revision as of 10:12, 4 April 2025
Line 800:		Line 800:
	$ squeue		$ squeue
	JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON)		JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON)
	~~18088744~~ ~~single~~ ~~CPV.sbat~~ ~~ab1234~~ PD 0:00 1 ~~(Priority)~~		1262 cpu wrap ka_ab123 R 8:15 1 uc3n002
	~~18098414~~ ~~multiple~~ ~~CPV.sbat~~ ~~ab1234~~ PD 0:00 2 (~~Priority~~)		1267 dev_gpu_h wrap ka_ab123 PD 0:00 1 (Resources)
	~~18090089~~ ~~multiple~~ ~~CPV.sbat~~ ~~ab1234~~ R 2:27 2 ~~uc2n[127-128]~~		1265 highmem wrap ka_ab123 R 2:41 1 uc3n084
	$ squeue -l		$ squeue -l
	JOBID PARTITION NAME USER STATE TIME TIME_LIMI NODES NODELIST(REASON)		JOBID PARTITION NAME USER STATE TIME TIME_LIMI NODES NODELIST(REASON)
	~~18088654~~ ~~single~~ ~~CPV.sbat~~ ~~ab1234~~ ~~COMPLETI~~ ~~4:29~~ 2:00:00 1 ~~uc2n374~~		1262 cpu wrap ka_ab123 RUNNING 8:55 20:00 1 uc3n002
	~~18088785~~ ~~single~~ ~~CPV.sbat~~ ~~ab1234~~ PENDING 0:00 ~~2:00~~:00 1 (~~Priority~~)		1267 dev_gpu_h wrap ka_ab123 PENDING 0:00 20:00 1 (Resources)
	~~18098414~~ ~~multiple~~ ~~CPV.sbat~~ ~~ab1234~~ ~~PENDING~~ ~~0:00~~ 2:00:00 2 ~~(Priority)~~		1265 highmem wrap ka_ab123 RUNNING 3:21 20:00 1 uc3n084

	18088683 single CPV.sbat ab1234 RUNNING 0:14 2:00:00 1 uc2n413
	</pre>		</pre>
	* The output of ''squeue'' shows how many jobs of yours are running or pending and how many nodes are in use by your jobs.		* The output of ''squeue'' shows how many jobs of yours are running or pending and how many nodes are in use by your jobs.

2025-04-04T08:06:04Z

Batch Job (Slurm) Variables

← Older revision		Revision as of 10:06, 4 April 2025
Line 1,010:		Line 1,010:
	\|}		\|}
	See also:		See also:
	* [https://slurm.schedmd.com/sbatch.html#~~lbAI~~ Slurm input and output environment variables]		* [https://slurm.schedmd.com/sbatch.html#SECTION_INPUT-ENVIRONMENT-VARIABLES Slurm input and output environment variables]
	<br>		<br>