Difference between revisions of "JUSTUS2/Getting Started"

From bwHPC Wiki
Jump to: navigation, search
(Find information about installed software and examples)
(4 intermediate revisions by 2 users not shown)
Line 1: Line 1:
  +
<!--
 
 
Here is a short list of things you may need to do first when you get onto the cluster
 
Here is a short list of things you may need to do first when you get onto the cluster
 
== Basics ==
 
== Basics ==
Line 17: Line 17:
   
 
Note that your jobs should not write/read much on the lustre filesystem while the job runs, but either use the ram disk in /tmp or request /scratch if the space of the ram disk isn't sufficient. The [[BwForCluster_JUSTUS_2_Slurm_HOWTO#How_to_clean-up_or_save_files_before_a_job_times_out.3F| Slurm Howto]] shows how to copy and clean up your data from /tmp or /scratch at the end of the job
 
Note that your jobs should not write/read much on the lustre filesystem while the job runs, but either use the ram disk in /tmp or request /scratch if the space of the ram disk isn't sufficient. The [[BwForCluster_JUSTUS_2_Slurm_HOWTO#How_to_clean-up_or_save_files_before_a_job_times_out.3F| Slurm Howto]] shows how to copy and clean up your data from /tmp or /scratch at the end of the job
  +
-->
  +
== Get access to the cluster ==
  +
  +
Follow the registration process for the bwForCluster. &rarr; [[Registration/bwForCluster|How to Register for a bwForCluster]]
  +
  +
== Login to the Cluster ==
  +
  +
Setup service password and 2FA token and login to the cluster. &rarr; [[JUSTUS2/Login|Login JUSTUS2]]
  +
  +
== Get Accustomed with the Linux Commandline ==
  +
  +
HPC Wiki (external site) &rarr; [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC/The_Command_Line Introduction to Linux Commandline]
  +
  +
Training course &rarr; [https://training.bwhpc.de/ Linux course on training.bwhpc.de]
  +
  +
== Transfer your data to the cluster ==
  +
  +
Get familiar with available file systems on the cluster. &rarr; [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)#Storage_Architecture|File Systems]]
  +
  +
Transfer your data to the cluster using appropriate tools. &rarr; [[Data Transfer|Data Transfer]]
  +
  +
== Find information about installed software and examples ==
  +
  +
Compiler, Libraries and application software are provided as software modules. Learn how to work with
  +
[[Environment_Modules|software modules]]. &rarr; [[JUSTUS2/Software|Software]]
  +
<!-- Overview of available software modules &rarr; [https://www.bwhpc.de/software.php https://www.bwhpc.de/software.php], select <code>Cluster → bwForCluster JUSTUS 2</code> -->
  +
  +
Run sample script from a pre-installed software (Software job examples in the page above)
  +
  +
== Submit your application as a batch job ==
  +
  +
Get familiar with available nodes types on the cluster. &rarr; [[Hardware_and_Architecture_(bwForCluster_JUSTUS_2)|Hardware and Architecture]]
  +
  +
Submit and monitor your jobs with Slurm commands. &rarr; [[JUSTUS2/Slurm|Batch System Slurm]]
  +
  +
== Acknowledge the cluster ==
  +
  +
Remember to mention the cluster in your publications. &rarr; [[bwForCluster JUSTUS 2 Acknowledgement|Acknowledgement]]

Revision as of 09:58, 22 May 2023

1 Get access to the cluster

Follow the registration process for the bwForCluster. → How to Register for a bwForCluster

2 Login to the Cluster

Setup service password and 2FA token and login to the cluster. → Login JUSTUS2

3 Get Accustomed with the Linux Commandline

HPC Wiki (external site) → Introduction to Linux Commandline

Training course → Linux course on training.bwhpc.de

4 Transfer your data to the cluster

Get familiar with available file systems on the cluster. → File Systems

Transfer your data to the cluster using appropriate tools. → Data Transfer

5 Find information about installed software and examples

Compiler, Libraries and application software are provided as software modules. Learn how to work with software modules. → Software

Run sample script from a pre-installed software (Software job examples in the page above)

6 Submit your application as a batch job

Get familiar with available nodes types on the cluster. → Hardware and Architecture

Submit and monitor your jobs with Slurm commands. → Batch System Slurm

7 Acknowledge the cluster

Remember to mention the cluster in your publications. → Acknowledgement