DACHS/Hardware and Architecture: Difference between revisions
m (→Storage Architecture: Mention Quota) |
|||
| Line 79: | Line 79: | ||
== Storage Architecture == |
== Storage Architecture == |
||
The system features a 700 TB large BeeGFS filesystem available on login and compute nodes. |
The system features a 700 TB large BeeGFS filesystem available on login and compute nodes. |
||
Please note: there is a hard file size quota per partner organization and a soft quota per user. |
Please note: there is a hard file size quota per partner organization and a soft quota per user on Your HOME. |
||
Users will be notified by E-Mail if the quota is to be reached. |
Users will be notified by E-Mail if the quota is to be reached. |
||
Please '''do make usage''' of [[Workspace | Work Space mechanism]] for larger files. |
|||
Latest revision as of 16:01, 14 January 2025
Architecture of DACHS
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband to all login and compute nodes
The Operating System is Rocky-Linux 9.4 (which is based on RHEL). The setup is kept in-line (with regard to Software, Setup and general usage) and thus mostly equivalent to bwHPC and bwUniCluster in particular.
Components of DACHS
| Compute nodes "L40S" | Compute nodes "H100" | Compute nodes "AMD_APU" | Login | |
|---|---|---|---|---|
| Number of nodes | 45 | 1 | 1 | 2 |
| Processors | AMD EPYC 9254 | AMD EPYC 9454 | AMD MI300A | AMD EPYC 9254 |
| Number of sockets | 2 | 2 | 4 | 2 |
| Processor frequency (GHz) | 2.9 Ghz | 2.75 Ghz | 2.1 Ghz | 2.9 Ghz |
| Total number of cores | 48 | 96 | 96 | 48 |
| Main memory | 384 GB | 1536 GB | 512 GB | 384 GB |
| Local SSD | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe |
| Accelerators | 1x NVIDIA L40S | 8x NVIDIA H100 | 4x AMD MI300A | - |
| Accelerator memory | 48 GB | 8x 80 GB | 4x 128 GB | - |
| Interconnect | IB HDR100 | IB HDR100 | IB HDR100 | IB HDR100 |
Table 1: Properties of the nodes
Storage Architecture
The system features a 700 TB large BeeGFS filesystem available on login and compute nodes. Please note: there is a hard file size quota per partner organization and a soft quota per user on Your HOME. Users will be notified by E-Mail if the quota is to be reached.
Please do make usage of Work Space mechanism for larger files.