https://wiki.bwhpc.de/wiki/index.php?action=history&feed=atom&title=DACHS%2FGetting_StartedDACHS/Getting Started - Revision history2026-04-04T11:40:15ZRevision history for this page on the wikiMediaWiki 1.39.17https://wiki.bwhpc.de/wiki/index.php?title=DACHS/Getting_Started&diff=13043&oldid=prevR Keller: /* Run your Software in a Batch Job */2024-10-28T10:34:11Z<p><span dir="auto"><span class="autocomment">Run your Software in a Batch Job</span></span></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 12:34, 28 October 2024</td>
</tr><tr>
<td colspan="2" class="diff-lineno">Line 53:</td>
<td colspan="2" class="diff-lineno">Line 53:</td>
</tr>
<tr>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Get familiar with available nodes types on the cluster: &rarr; [[DACHS/Hardware_and_Architecture|Hardware and Architecture]]</div></td>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Get familiar with available nodes types on the cluster: &rarr; [[DACHS/Hardware_and_Architecture|Hardware and Architecture]]</div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td>
</tr>
<tr>
<td class="diff-marker" data-marker="−"></td>
<td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>Submit and monitor your jobs with Slurm commands: &rarr; [[BwUniCluster2.0/Slurm<del style="font-weight: bold; text-decoration: none;"> </del>bwUniCluster2.0 Slurm]] <!-- [[DACHS/Running Your Calculations|Running Your Calculations]] --></div></td>
<td class="diff-marker" data-marker="+"></td>
<td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>Submit and monitor your jobs with Slurm commands: &rarr; [[BwUniCluster2.0/Slurm<ins style="font-weight: bold; text-decoration: none;">|</ins>bwUniCluster2.0 Slurm]] <!-- [[DACHS/Running Your Calculations|Running Your Calculations]] --></div></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td>
</tr>
<tr>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Acknowledge the Cluster ==</div></td>
<td class="diff-marker"></td>
<td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Acknowledge the Cluster ==</div></td>
</tr>
</table>R Kellerhttps://wiki.bwhpc.de/wiki/index.php?title=DACHS/Getting_Started&diff=13042&oldid=prevR Keller: Getting started2024-10-28T10:33:19Z<p>Getting started</p>
<p><b>New page</b></p><div><!--<br />
Here is a short list of things you may need to do first when you get onto the cluster<br />
== Basics ==<br />
* Log in to the cluster: [[DACHS/Login]]<br />
* Get accustomed with the Linux commandline:<br />
** linux course at [https://training.bwhpc.de/ training.bwhpc.de]<br />
** [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line Introduction to the Command Line on the external hpc wiki]<br />
<br />
<br />
== Running an Example with Preinstalled Software ==<br />
* Scientific software: read on how to load [[Software Modules]]<br />
* Continue reading until you found that there are example job scripts: [[Environment_Modules#Software_job_examples]]<br />
* Submit a sample job from a software as mentioned in the job example. Also see: [[BwUniCluster2.0/Slurm bwUniCluster2.0 Slurm]]<br />
* Monitor your job: [[BwUniCluster2.0/Slurm bwUniCluster2.0 Monitoring Your Jobs]]<br />
--><br />
== General Workflow of Running a Calculation ==<br />
<br />
On a compute cluster, you do not simply log into the Cluster and run your software on the login node.<br />
Rather you write a "job script" that contains all commands to run and process your job.<br />
This job script is sent into a queue via the SLURM job scheduler to be run on one (or many) of the compute nodes. <br />
<br />
Please follow the links for more details and example on job scripts.<br />
The overall process is described in more detail here: &rarr; [[Running Calculations]]<br />
<br />
== Get Access to the Cluster ==<br />
<br />
Follow the registration process for the DACHS Cluster: &rarr; [[DACHS/Registration|How to Register]]<br />
<br />
== Login to the Cluster ==<br />
<br />
Setup service password and 2FA token and login to the cluster: &rarr; [[DACHS/Login|Login DACHS]]<br />
<br />
== Using the Linux Commandline ==<br />
<br />
The Training course &rarr; [https://training.bwhpc.de/ Linux course on training.bwhpc.de]<br />
The (external) HPC Wiki &rarr; [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line Introduction to Linux Command line]<br />
<br />
== Transfer your Data to the Cluster ==<br />
<br />
Get familiar with available file systems on the cluster: &rarr; [[DACHS/Hardware_and_Architecture#Storage_Architecture|File Systems]]<br />
<br />
Transfer your data to the cluster using appropriate tools: &rarr; [[Data Transfer|Data Transfer]]<br />
<br />
== Find Information About Installed Software and Examples ==<br />
<br />
Compiler, Libraries and application software are provided as software modules. Learn how to work with<br />
[[Environment_Modules|software modules]]. <!--: &rarr; [[DACHS/Software|Software]] --><br />
<br />
Run sample script from a pre-installed software (Software job examples in the page above)<br />
<br />
== Run your Software in a Batch Job ==<br />
<br />
Get familiar with available nodes types on the cluster: &rarr; [[DACHS/Hardware_and_Architecture|Hardware and Architecture]]<br />
<br />
Submit and monitor your jobs with Slurm commands: &rarr; [[BwUniCluster2.0/Slurm bwUniCluster2.0 Slurm]] <!-- [[DACHS/Running Your Calculations|Running Your Calculations]] --><br />
<br />
== Acknowledge the Cluster ==<br />
<br />
Remember to mention the cluster in your publications. &rarr; [[DACHS/Acknowledgement|Acknowledgement]]</div>R Keller