BwUniCluster3.0/Getting Started - Revision history

S Braun: /* General Workflow of Running a Calculation */

2025-03-31T07:11:28Z

General Workflow of Running a Calculation

← Older revision		Revision as of 09:11, 31 March 2025
Line 5:		Line 5:
	Interactive usage of the compute infrastructure is furthermore possible via the bwUniCluster-JupyterHub.		Interactive usage of the compute infrastructure is furthermore possible via the bwUniCluster-JupyterHub.

	How ~~this~~ is ~~done~~ is described in a little more detail here: [[Running Calculations]]		How a basic non-interactive job is sceduled is described in a little more detail here: [[Running Calculations]]

	== Get access to the cluster ==		== Get access to the cluster ==

S Braun: /* General Workflow of Running a Calculation */

2025-03-31T07:10:33Z

General Workflow of Running a Calculation

← Older revision		Revision as of 09:10, 31 March 2025
Line 1:		Line 1:
	== General Workflow of Running a Calculation ==		== General Workflow of Running a Calculation ==

	On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers.		On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers.<br>
			For some use cases, also interactive usage of the compute nodes is possible. But here, too, you have to join the waiting queue.<br>
			Interactive usage of the compute infrastructure is furthermore possible via the bwUniCluster-JupyterHub.

	How this is done is described in a little more detail here: [[Running Calculations]]		How this is done is described in a little more detail here: [[Running Calculations]]


	== Get access to the cluster ==		== Get access to the cluster ==

S Braun: /* Transfer your data to the cluster */

2025-03-28T10:25:30Z

Transfer your data to the cluster

← Older revision		Revision as of 12:25, 28 March 2025
Line 16:		Line 16:
	== Transfer your data to the cluster ==		== Transfer your data to the cluster ==

	Get familiar with available file systems on the cluster. → [[BwUniCluster3.0/Hardware_and_Architecture\|File Systems and Workspaces]]		Get familiar with available file systems on the cluster. → [[BwUniCluster3.0/Hardware_and_Architecture#File_Systems\|File Systems and Workspaces]]

	Transfer your data to the cluster using appropriate tools. → [[Data Transfer\|Data Transfer]]		Transfer your data to the cluster using appropriate tools. → [[Data Transfer\|Data Transfer]]

S Braun: Created page with "== General Workflow of Running a Calculation == On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers. How this is done is described in a little more detail here: Running Calculations == Get access to the cluster == Follow the registration process for the bwUniCluster. → Regi..."

2025-01-09T12:16:41Z

Created page with "== General Workflow of Running a Calculation == On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers. How this is done is described in a little more detail here: Running Calculations == Get access to the cluster == Follow the registration process for the bwUniCluster. → Regi..."

New page

== General Workflow of Running a Calculation ==

On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers.

How this is done is described in a little more detail here: [[Running Calculations]]

== Get access to the cluster ==

Follow the registration process for the bwUniCluster. → [[Registration/bwUniCluster|bwUniCluster registration]]

== Login to the cluster ==

Setup service password and 2FA token and login to the cluster. → [[BwUniCluster3.0/Login|Login and security measures]]

== Transfer your data to the cluster ==

Get familiar with available file systems on the cluster. → [[BwUniCluster3.0/Hardware_and_Architecture|File Systems and Workspaces]]

Transfer your data to the cluster using appropriate tools. → [[Data Transfer|Data Transfer]]

== Find information about installed software and examples ==

Compiler, Libraries and application software are provided as software modules. Learn how to work with [[Environment_Modules|software modules]]. → [[BwUniCluster3.0/Software|Software]]

== Submit your application as a batch job ==

Get familiar with available nodes types on the cluster. → [[BwUniCluster3.0/Hardware and Architecture|Hardware and Architecture]]

Submit and monitor your jobs with Slurm commands. → [[BwUniCluster3.0/Slurm|Batch System Slurm]]

== Learn about Scaling your Job ==

How many compute-cores should my job use? This depends on the software and the problem you are trying to solve. But if you use too few cores, your computation may take much too long - if you use too many cores, they will not improve the speed of your computation and all you do by using more cores is wasting compute resources and energy.

If you run hundreds or thousands of similar calculations, you should look at this carefully before starting.

How to do this is described in: [[Scaling]]

== Acknowledge the cluster ==

Remember to mention the cluster in your publications. → [[BwUniCluster3.0/Acknowledgement|Acknowledgement]]