BwUniCluster2.0/Slurm - Revision history

R Laifer: /* BeeOND (BeeGFS On-Demand) */

2025-04-03T14:13:20Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 16:13, 3 April 2025
Line 524:		Line 524:
	====BeeOND (BeeGFS On-Demand)====		====BeeOND (BeeGFS On-Demand)====

	Starting and stopping BeeOND is integrated in the prolog and epilog of the cluster batch system Slurm. It can be used during job runtime if compute nodes are exclusive used. You can request the creation of a ~~BeeON~~ file system with the constraint flags "BEEOND", "BEEOND_4MDS" or "BEEOND_MAXMDS" ([[BwUniCluster_2.0_Slurm_common_Features#sbatch_Command_Parameters\|Slurm Command Parameters]])		Starting and stopping BeeOND is integrated in the prolog and epilog of the cluster batch system Slurm. It can be used during job runtime if compute nodes are exclusive used. You can request the creation of a BeeOND file system with the constraint flags "BEEOND", "BEEOND_4MDS" or "BEEOND_MAXMDS" ([[BwUniCluster_2.0_Slurm_common_Features#sbatch_Command_Parameters\|Slurm Command Parameters]])
	* BEEOND: one metadata server is started on the first node		* BEEOND: one metadata server is started on the first node
	* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.		* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.

R Laifer: /* BeeOND (BeeGFS On-Demand) */

2025-04-03T12:05:20Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 14:05, 3 April 2025
Line 524:		Line 524:
	====BeeOND (BeeGFS On-Demand)====		====BeeOND (BeeGFS On-Demand)====

	~~BeeOND~~ ~~instances~~ ~~are~~ integrated ~~into~~ the prolog and epilog ~~script~~ of the cluster batch system Slurm. It can be used on ~~the~~ ~~exclusive~~ compute nodes ~~during~~ the ~~job~~ ~~runtime~~ with the constraint ~~flag~~ "BEEOND", "BEEOND_4MDS" or "BEEOND_MAXMDS" ([[BwUniCluster_2.0_Slurm_common_Features#sbatch_Command_Parameters\|Slurm Command Parameters]])		Starting and stopping BeeOND is integrated in the prolog and epilog of the cluster batch system Slurm. It can be used during job runtime if compute nodes are exclusive used. You can request the creation of a BeeON file system with the constraint flags "BEEOND", "BEEOND_4MDS" or "BEEOND_MAXMDS" ([[BwUniCluster_2.0_Slurm_common_Features#sbatch_Command_Parameters\|Slurm Command Parameters]])
	* BEEOND: one metadata server is started on the first node		* BEEOND: one metadata server is started on the first node
	* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.		* BEEOND_4MDS: 4 metadata servers are started within your job. If you have less than 4 nodes less metadata servers are started.
Line 554:		Line 554:

	; <font color=red>'''Attention:'''</font><br>		; <font color=red>'''Attention:'''</font><br>
	:Be careful when creating large files: ~~use~~ ~~always~~ the directory with the ~~max~~ stripe count for large files.		:Be careful when creating large files: It is recommended to use the directory with the maximum stripe count for large files. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, otherwise the used disk space is exceeded.
	:If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2,
	:otherwise the used disk space is exceeded.

	The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.		The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.

H Weber: /* BeeOND (BeeGFS On-Demand) */

2024-06-06T08:22:46Z

BeeOND (BeeGFS On-Demand)

@@ Line 560: / Line 560: @@
 The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.
 If you request 100 nodes for your job, the private file system is 100 * 750 Gbyte ~ 75 Tbyte (approx) capacity.
 == Start time of job or resources : squeue --start ==

M Janczyk: /* Submitting Termination Signal */

2024-05-21T08:26:57Z

Submitting Termination Signal

← Older revision		Revision as of 10:26, 21 May 2024
Line 868:		Line 868:
	<br>		<br>
	----		----
	[[Category:bwUniCluster 2.0\|bwUniCluster 2.0]]
	[[#top\|Back to top]]		[[#top\|Back to top]]

R Keller: /* Intel MPI */

2024-05-02T08:46:31Z

Intel MPI

← Older revision		Revision as of 10:46, 2 May 2024
Line 256:		Line 256:
	#!/bin/bash		#!/bin/bash
	# Use when a defined module environment related to Intel MPI is wished		# Use when a defined module environment related to Intel MPI is wished
			module load compiler/<placeholder_for_compiler>/<placeholder_for_compiler_version>
	module load mpi/impi/<placeholder_for_version>		module load mpi/impi/<placeholder_for_version>
	mpiexec.hydra -bootstrap slurm my_par_program		mpiexec.hydra -bootstrap slurm my_par_program

R Keller: /* OpenMPI */

2024-05-02T08:46:15Z

OpenMPI

← Older revision		Revision as of 10:46, 2 May 2024
Line 237:		Line 237:
	<source lang="bash">		<source lang="bash">
	#!/bin/bash		#!/bin/bash
	# Use when a ~~defined~~ module environment ~~related to~~ OpenMPI ~~is wished~~		# Use when using the module environment for OpenMPI
			module load compiler/<placeholder_for_compiler>/<placeholder_for_compiler_version>
	module load mpi/openmpi/<~~placeholder_for_version~~>		module load mpi/openmpi/<placeholder_for_mpi_version>
	mpirun --bind-to core --map-by core -report-bindings my_par_program		mpirun --bind-to core --map-by core -report-bindings my_par_program
	</source>		</source>

J Steuer: /* Slurm Commands (excerpt) */

2023-11-20T13:35:10Z

Slurm Commands (excerpt)

← Older revision		Revision as of 15:35, 20 November 2023
Line 26:		Line 26:
	\| [[#Canceling own jobs : scancel\|scancel]] \|\| Cancels a job (obsoleted!) [[https://slurm.schedmd.com/scancel.html scancel]]		\| [[#Canceling own jobs : scancel\|scancel]] \|\| Cancels a job (obsoleted!) [[https://slurm.schedmd.com/scancel.html scancel]]
	\|}		\|}
	If your job was submitted to the "multiple" queue you can log into the allocated nodes via SSH as soon as the job is running.

	<br>		<br>

H Weber: /* BeeOND (BeeGFS On-Demand) */

2023-11-15T08:32:46Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 10:32, 15 November 2023
Line 554:		Line 554:
	; <font color=red>'''Attention:'''</font><br>		; <font color=red>'''Attention:'''</font><br>
	:Be careful when creating large files: use always the directory with the max stripe count for large files.		:Be careful when creating large files: use always the directory with the max stripe count for large files.
	:If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, ~~otherwise the used disk :space is exceeded.~~		:If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2,
			:otherwise the used disk space is exceeded.

	The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.		The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.

H Weber: /* BeeOND (BeeGFS On-Demand) */

2023-11-15T08:30:51Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 10:30, 15 November 2023
Line 552:		Line 552:
	If you request less nodes than stripe count, the stripe count will be the number of nodes. For example, if you only request 8 nodes the directory stripe_16 has only a stripe count 8.		If you request less nodes than stripe count, the stripe count will be the number of nodes. For example, if you only request 8 nodes the directory stripe_16 has only a stripe count 8.

	<font color=red>'''Attention:'''</font><br>		; <font color=red>'''Attention:'''</font><br>
	Be careful when creating large files: use always the directory with the max stripe count for large files.		:Be careful when creating large files: use always the directory with the max stripe count for large files.
	If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, otherwise the used disk space is exceeded.		:If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, otherwise the used disk :space is exceeded.

	The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.		The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.

H Weber: /* BeeOND (BeeGFS On-Demand) */

2023-11-14T09:26:55Z

BeeOND (BeeGFS On-Demand)

← Older revision		Revision as of 11:26, 14 November 2023
Line 551:		Line 551:

	If you request less nodes than stripe count, the stripe count will be the number of nodes. For example, if you only request 8 nodes the directory stripe_16 has only a stripe count 8.		If you request less nodes than stripe count, the stripe count will be the number of nodes. For example, if you only request 8 nodes the directory stripe_16 has only a stripe count 8.

⚫	The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.

	<font color=red>'''Attention:'''</font><br>		<font color=red>'''Attention:'''</font><br>
Line 558:		Line 556:
	If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, otherwise the used disk space is exceeded.		If you create large files use a higher stripe count. For example, if your largest file is 1.1 Tb, then you have to use a stripe count larger than 2, otherwise the used disk space is exceeded.

		⚫	The capacity of the private file system depends on the number of nodes. For each node you get 750 Gbyte.
	If you request 100 nodes for your job, the private file system is 100 * 750 Gbyte ~ 75 Tbyte (approx) capacity.		If you request 100 nodes for your job, the private file system is 100 * 750 Gbyte ~ 75 Tbyte (approx) capacity.