JUSTUS2/Getting Started: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<!--

Here is a short list of things you may need to do first when you get onto the cluster
Here is a short list of things you may need to do first when you get onto the cluster
== Basics ==

* log in to the cluster: [[JUSTUS2/Login]]
* log in to the cluster: [[JUSTUS2/Login]]
* get accustomed with the linux commandline:
* get accustomed with the linux commandline: [https://www.uni-ulm.de/?id=linux-ex1 exercises1] [https://www.uni-ulm.de/?id=linux-ex2 exercises2] [https://www.uni-ulm.de/?id=linux-ex1 exercises3] or linux course at [https://training.bwhpc.de/ training.bwhpc.de]
** [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line introduction on the (external) hpc wiki] or
** linux course at [https://training.bwhpc.de/ training.bwhpc.de]

== Running an Example with Preinstalled Software ==
* scientific software: read on how to load [[Software Modules]]
* scientific software: read on how to load [[Software Modules]]
* continue reading until you found that there are example job scripts: [[Environment_Modules#Software_job_examples]]
* continue reading until you found that there are example job scripts: [[Environment_Modules#Software_job_examples]]
* submit a sample job from a software as mentioned in the job example. Also see: [[JUSTUS2/Slurm]]
* submit a sample job from a software as mentioned in the job example. Also see: [[JUSTUS2/Slurm]]
* monitor your job: [[JUSTUS2/Slurm#Monitoring_Your_Jobs]]
* monitor your job: [[JUSTUS2/Slurm#Monitoring_Your_Jobs]]
== Running Your Own Calculations ==
* transfer your own data to the cluster: [[Data Transfer]]
* transfer your own data to the cluster: [[Data Transfer]]
* adapt the sample job script to run your own job
* adapt the sample job script to run your own job


Note that your jobs should not write/read much on the lustre filesystem while the job runs, but either use the ram disk in /tmp or request /scratch if the space of the ram disk isn't sufficient
Note that your jobs should not write/read much on the lustre filesystem while the job runs, but either use the ram disk in /tmp or request /scratch if the space of the ram disk isn't sufficient. The [[BwForCluster_JUSTUS_2_Slurm_HOWTO#How_to_clean-up_or_save_files_before_a_job_times_out.3F| Slurm Howto]] shows how to copy and clean up your data from /tmp or /scratch at the end of the job
-->
== Get access to the cluster ==

Follow the registration process for the bwForCluster. &rarr; [[Registration/bwForCluster|How to Register for a bwForCluster]]

== Login to the Cluster ==

Setup service password and 2FA token and login to the cluster. &rarr; [[JUSTUS2/Login|Login JUSTUS2]]

== Get Accustomed with the Linux Commandline ==

HPC Wiki (external site) &rarr; [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line Introduction to Linux Commandline]

Training course &rarr; [https://training.bwhpc.de/ Linux course on training.bwhpc.de]

== Transfer your data to the cluster ==

Get familiar with available file systems on the cluster. &rarr; [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)#Storage_Architecture|File Systems]]

Transfer your data to the cluster using appropriate tools. &rarr; [[Data Transfer|Data Transfer]]

== Find information about installed software and examples ==

Compiler, Libraries and application software are provided as software modules. Learn how to work with
[[Environment_Modules|software modules]]. &rarr; [[JUSTUS2/Software|Software]]
<!-- Overview of available software modules &rarr; [https://www.bwhpc.de/software.php https://www.bwhpc.de/software.php], select <code>Cluster → bwForCluster JUSTUS 2</code> -->

Run sample script from a pre-installed software (Software job examples in the page above)

== Submit your application as a batch job ==

Get familiar with available nodes types on the cluster. &rarr; [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)|Hardware and Architecture]]

Submit and monitor your jobs with Slurm commands. &rarr; [[JUSTUS2/Slurm|Batch System Slurm]]

== Acknowledge the cluster ==

Remember to mention the cluster in your publications. &rarr; [[bwForCluster JUSTUS 2 Acknowledgement|Acknowledgement]]

Revision as of 09:58, 22 May 2023

Get access to the cluster

Follow the registration process for the bwForCluster. → How to Register for a bwForCluster

Login to the Cluster

Setup service password and 2FA token and login to the cluster. → Login JUSTUS2

Get Accustomed with the Linux Commandline

HPC Wiki (external site) → Introduction to Linux Commandline

Training course → Linux course on training.bwhpc.de

Transfer your data to the cluster

Get familiar with available file systems on the cluster. → File Systems

Transfer your data to the cluster using appropriate tools. → Data Transfer

Find information about installed software and examples

Compiler, Libraries and application software are provided as software modules. Learn how to work with software modules. → Software

Run sample script from a pre-installed software (Software job examples in the page above)

Submit your application as a batch job

Get familiar with available nodes types on the cluster. → Hardware and Architecture

Submit and monitor your jobs with Slurm commands. → Batch System Slurm

Acknowledge the cluster

Remember to mention the cluster in your publications. → Acknowledgement