BwUniCluster2.0/First Steps - Revision history

K Siegmund: /* Submit your application as a batch job */

2024-09-11T09:59:16Z

Submit your application as a batch job

← Older revision		Revision as of 11:59, 11 September 2024
Line 48:		Line 48:

	Submit and monitor your jobs with Slurm commands. → [[BwUniCluster2.0/Slurm\|Batch System Slurm]]		Submit and monitor your jobs with Slurm commands. → [[BwUniCluster2.0/Slurm\|Batch System Slurm]]

			== Learn about Scaling your Job ==

			How many compute-cores should my job use? This depends on the software and the problem you are trying to solve. But if you use too few cores, your computation may take much too long - if you use too many cores, they will not improve the speed of your computation and all you do by using more cores is wasting compute resources and energy.

			If you run hundreds or thousands of similar calculations, you should look at this carefully before starting.

			How to do this is described in: [[Scaling]]

	== Acknowledge the cluster ==		== Acknowledge the cluster ==

K Siegmund at 14:28, 8 January 2024

2024-01-08T14:28:09Z

← Older revision		Revision as of 16:28, 8 January 2024
Line 17:		Line 17:
	* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]		* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]
	-->		-->

			== General Workflow of Running a Calculation ==

			On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers.

			How this is done is described in a little more detail here: [[Running Calculations]]


	== Get access to the cluster ==		== Get access to the cluster ==

K Siegmund: /* Find information about installed software and examples */

2023-05-22T07:57:13Z

Find information about installed software and examples

← Older revision		Revision as of 09:57, 22 May 2023
Line 33:		Line 33:
	== Find information about installed software and examples ==		== Find information about installed software and examples ==

	Compiler, Libraries and application software are provided as software modules. Learn how to work with software modules. → [[BwUniCluster2.0/Software\|Software ~~Modules~~]]		Compiler, Libraries and application software are provided as software modules. Learn how to work with [[Environment_Modules\|software modules]]. → [[BwUniCluster2.0/Software\|Software]]

	== Submit your application as a batch job ==		== Submit your application as a batch job ==

R Barthel at 21:00, 7 October 2022

2022-10-07T21:00:16Z

R Barthel at 13:38, 7 October 2022

2022-10-07T13:38:33Z

← Older revision		Revision as of 15:38, 7 October 2022
Line 17:		Line 17:
	* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]		* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]
	-->		-->

	== Get access to the cluster ==		== Get access to the cluster ==

R Barthel at 13:38, 7 October 2022

2022-10-07T13:38:04Z

← Older revision		Revision as of 15:38, 7 October 2022
Line 12:		Line 12:
	Any kind of computation on any HPC cluster is done as [[bwUniCluster_2.0_Slurm_common_Features\|'''batch jobs''']].		Any kind of computation on any HPC cluster is done as [[bwUniCluster_2.0_Slurm_common_Features\|'''batch jobs''']].

	<!--
	For setting up your environment to use compilers and installed software please visit:		For setting up your environment to use compilers and installed software please visit:
	* [[BwUniCluster_Environment_Modules\|bwUniCluster user environment]]		* [[BwUniCluster_Environment_Modules\|bwUniCluster user environment]]
	For guides on how to submit compute jobs to bwUniCluster please visit:		For guides on how to submit compute jobs to bwUniCluster please visit:
	* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]~~-->~~		* [[bwUniCluster_2.0_Slurm_common_Features\|bwUniCluster 2.0 batch jobs]]
	-->		-->

R Barthel at 13:37, 7 October 2022

2022-10-07T13:37:08Z

@@ Line 1: / Line 1: @@
 == Command line interface ==
@@ Line 16: / Line 17: @@
 For guides on how to submit compute jobs to bwUniCluster please visit:
 * [[bwUniCluster_2.0_Slurm_common_Features|bwUniCluster 2.0 batch jobs]]-->

P Schuhmacher: P Schuhmacher moved page First Steps on bwHPC cluster to BwUniCluster2.0/First Steps: Restructuring bwUniCluster pages into subpages

2022-10-07T07:22:44Z

P Schuhmacher moved page First Steps on bwHPC cluster to BwUniCluster2.0/First Steps: Restructuring bwUniCluster pages into subpages

← Older revision	Revision as of 09:22, 7 October 2022
(No difference)

B Wellenkamp at 08:40, 16 August 2022

2022-08-16T08:40:14Z

← Older revision		Revision as of 10:40, 16 August 2022
Line 1:		Line 1:
	== Command line interface ==		== Command line interface ==

	Any work is to be done via command line interface. A quick guide can be found [https://indico.scc.kit.edu/indico/event/278/material/slides/10.pdf here].		Any work is to be done via command line interface. A quick guide can be found [https://indico.scc.kit.edu/indico/event/278/material/slides/10.pdf '''here'''].

	== Software setup ==		== Software setup ==

	Softwares provided by bwHPC have to be loaded according to your need via the [[BwUniCluster_2.0_Software\|Software Module System]].		Softwares provided by bwHPC have to be loaded according to your need via the [[BwUniCluster_2.0_Software\|'''Software Module System''']].

	== Computation ==		== Computation ==

	Any kind of computation on any HPC cluster is done as [[bwUniCluster_2.0_Slurm_common_Features\|batch jobs]].		Any kind of computation on any HPC cluster is done as [[bwUniCluster_2.0_Slurm_common_Features\|'''batch jobs''']].

	<!--		<!--

H Haefner: /* Software setup */

2020-03-16T10:37:46Z

Software setup

← Older revision		Revision as of 12:37, 16 March 2020
Line 5:		Line 5:
	== Software setup ==		== Software setup ==

	Softwares provided by bwHPC have to be loaded according to your need via the [[BwUniCluster_2.~~0_SoftwareModules~~\|~~software~~ ~~module~~ ~~system~~]].		Softwares provided by bwHPC have to be loaded according to your need via the [[BwUniCluster_2.0_Software\|Software Module System]].

	== Computation ==		== Computation ==

← Older revision		Revision as of 23:00, 7 October 2022
Line 19:		Line 19:
	== Get access to the cluster ==		== Get access to the cluster ==

	Follow the registration process for the bwUniCluster. -> [[Registration/bwUniCluster\|bwUniCluster registration]]		Follow the registration process for the bwUniCluster. → [[Registration/bwUniCluster\|bwUniCluster registration]]

	== Login to the cluster ==		== Login to the cluster ==

	Setup service password and 2FA token and login to the cluster. -> [[BwUniCluster2.0/Login\|Login and security measures]]		Setup service password and 2FA token and login to the cluster. → [[BwUniCluster2.0/Login\|Login and security measures]]

	== Transfer your data to the cluster ==		== Transfer your data to the cluster ==

	Get familiar with available file systems on the cluster. -> [[BwUniCluster2.0/Hardware_and_Architecture\|File Systems and Workspaces]]		Get familiar with available file systems on the cluster. → [[BwUniCluster2.0/Hardware_and_Architecture\|File Systems and Workspaces]]

	Transfer your data to the cluster using appropriate tools. -> [[Data Transfer\|Data Transfer]]		Transfer your data to the cluster using appropriate tools. → [[Data Transfer\|Data Transfer]]

	== Find information about installed software and examples ==		== Find information about installed software and examples ==

	Compiler, Libraries and application software are provided as software modules. Learn how to work with software modules. -> [[BwUniCluster2.0/Software\|Software Modules]]		Compiler, Libraries and application software are provided as software modules. Learn how to work with software modules. → [[BwUniCluster2.0/Software\|Software Modules]]

	== Submit your application as a batch job ==		== Submit your application as a batch job ==

	Get familiar with available nodes types on the cluster. -> [[BwUniCluster2.0/Hardware and Architecture\|Hardware and Architecture]]		Get familiar with available nodes types on the cluster. → [[BwUniCluster2.0/Hardware and Architecture\|Hardware and Architecture]]

	Submit and monitor your jobs with Slurm commands. -> [[BwUniCluster2.0/Slurm\|Batch System Slurm]]		Submit and monitor your jobs with Slurm commands. → [[BwUniCluster2.0/Slurm\|Batch System Slurm]]

	== Acknowledge the cluster ==		== Acknowledge the cluster ==

	Remember to mention the cluster in your publications. -> [[BwUniCluster2.0/Acknowledgement\|Acknowledgement]]		Remember to mention the cluster in your publications. → [[BwUniCluster2.0/Acknowledgement\|Acknowledgement]]