Difference between revisions of "Batch Jobs"

From bwHPC Wiki
Jump to: navigation, search
Line 6: Line 6:
 
Any kind of calculation on the compute nodes of '''bwUniCluster''' requires the user to define calculations as a sequence of commands or single command together with required run time, number of CPU cores and main memory and submit all, i.e., the '''batch job''', to a resource and workload managing software. All bwHPC cluster, including '''bwUniCluster''', have installed the workload managing software MOAB. Therefore any job submission by the user is to be executed by commands of the MOAB software. MOAB queues and runs user jobs based on fair sharing policies.
 
Any kind of calculation on the compute nodes of '''bwUniCluster''' requires the user to define calculations as a sequence of commands or single command together with required run time, number of CPU cores and main memory and submit all, i.e., the '''batch job''', to a resource and workload managing software. All bwHPC cluster, including '''bwUniCluster''', have installed the workload managing software MOAB. Therefore any job submission by the user is to be executed by commands of the MOAB software. MOAB queues and runs user jobs based on fair sharing policies.
   
 
 
= MOAB Queueing System =
 
 
Batch jobs are submitted using the command '''msub'''. The main purpose of the '''msub''' command is to specify the resources that are needed to run the job. '''msub''' will then queue the job into the input queue. The jobs are organized into different job classes. For each job class there are specific limits for the available resources (number of nodes, number of CPUs, maximum CPU time, maximum memory etc.).
 
   
 
{| style="border-style: solid; border-width: 1px 1px 1px 1"
 
{| style="border-style: solid; border-width: 1px 1px 1px 1"
Line 25: Line 20:
   
   
  +
= Job Submission =
== Submitting Batch Jobs ==
 
   
  +
Batch jobs are submitted using the command '''msub'''. The main purpose of the '''msub''' command is to specify the resources that are needed to run the job. '''msub''' will then queue the job into the input queue. The jobs are organized into different job classes. For each job class there are specific limits for the available resources (number of nodes, number of CPUs, maximum CPU time, maximum memory etc.).
=== msub Command ===
 
  +
  +
  +
  +
== msub Command ==
   
 
The syntax and use of '''msub''' can be displayed via:
 
The syntax and use of '''msub''' can be displayed via:
Line 36: Line 35:
   
   
=== msub Examples ===
+
== msub Examples ==
  +
  +
  +
=== Serial Programs ===
  +
  +
  +
=== Multithreaded Programs ===
  +
  +
  +
=== Parallel MPI Programs ===
   
==== Serial Programs ====
 
   
==== Parallel SMP Programs ====
 
   
  +
= Display Status of submitted Jobs =
==== Parallel MPI Programs ====
 
   
   
== Display Status of submitted Jobs ==
 
   
  +
= Environment Variables for Batch Jobs =
   
== Environment Variables for Batch Jobs ==
 
   
   

Revision as of 00:36, 15 December 2013

Navigation: bwHPC / User Guides


Any kind of calculation on the compute nodes of bwUniCluster requires the user to define calculations as a sequence of commands or single command together with required run time, number of CPU cores and main memory and submit all, i.e., the batch job, to a resource and workload managing software. All bwHPC cluster, including bwUniCluster, have installed the workload managing software MOAB. Therefore any job submission by the user is to be executed by commands of the MOAB software. MOAB queues and runs user jobs based on fair sharing policies.


MOAB commands Brief explanation
msub submits an job and queues it in an input queue
checkjob displays detailed job state information
showq displays information about active, eligible, blocked, and/or recently completed jobs
showbf shows what resources are available for immediate use


1 Job Submission

Batch jobs are submitted using the command msub. The main purpose of the msub command is to specify the resources that are needed to run the job. msub will then queue the job into the input queue. The jobs are organized into different job classes. For each job class there are specific limits for the available resources (number of nodes, number of CPUs, maximum CPU time, maximum memory etc.).


1.1 msub Command

The syntax and use of msub can be displayed via:

$ man msub


1.2 msub Examples

1.2.1 Serial Programs

1.2.2 Multithreaded Programs

1.2.3 Parallel MPI Programs

2 Display Status of submitted Jobs

3 Environment Variables for Batch Jobs