DACHS/Hardware and Architecture: Difference between revisions
< DACHS
Jump to navigation
Jump to search
(1st Version) |
(Update Hardware) |
||
Line 1: | Line 1: | ||
= Architecture of DACHS = |
= Architecture of DACHS = |
||
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband |
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband to all login and compute nodes |
||
The Operating System is Rocky-Linux 9.4 (which is based on RHEL) |
The Operating System is Rocky-Linux 9.4 (which is based on RHEL). |
||
The setup is kept in-line (with regard to Software, Setup and general usage) is mostly equivalent to bwHPC and bwUniCluster in particular. |
|||
= Components of DACHS = |
|||
{| class="wikitable" |
|||
|- |
|||
! style="width:9%"| |
|||
! style="width:13%"| Compute nodes "L40S" |
|||
! style="width:13%"| Compute nodes "H100" |
|||
! style="width:13%"| Compute nodes "AMD_APU" |
|||
! style="width:13%"| Login |
|||
|- |
|||
!scope="column"| Number of nodes |
|||
| 45 |
|||
| 1 |
|||
| 1 |
|||
| 2 |
|||
|- |
|||
!scope="column"| Processors |
|||
| AMD EPYC 9254 |
|||
| AMD EPYC 9454 |
|||
| AMD MI300A |
|||
| AMD EPYC 9254 |
|||
|- |
|||
!scope="column"| Number of sockets |
|||
| 2 |
|||
| 2 |
|||
| 2 |
|||
| 2 |
|||
|- |
|||
!scope="column"| Processor frequency (GHz) |
|||
| 2.9 Ghz |
|||
| 2.75 Ghz |
|||
| 2.1 Ghz |
|||
| 2.9 Ghz |
|||
|- |
|||
!scope="column"| Total number of cores |
|||
| 48 |
|||
| 96 |
|||
| 96 |
|||
| 48 |
|||
|- |
|||
!scope="column"| Main memory |
|||
| 384 GB |
|||
| 1536 GB |
|||
| 512 GB |
|||
| 384 GB |
|||
|- |
|||
!scope="column"| Local SSD |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
|- |
|||
!scope="column"| Accelerators |
|||
| 1x NVIDIA L40S |
|||
| 8x NVIDIA H100 |
|||
| 4x AMD MI300A |
|||
| - |
|||
|- |
|||
!scope="column"| Accelerator memory |
|||
| 48 GB |
|||
| 8x 80 GB |
|||
| 4x 128 GB |
|||
| - |
|||
|- |
|||
!scope="column"| Interconnect |
|||
| IB HDR100 (blocking) |
|||
| IB HDR100 |
|||
| IB HDR100 |
|||
| IB HDR100 |
|||
|} |
|||
Table 1: Properties of the nodes |
Revision as of 11:19, 22 October 2024
Architecture of DACHS
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband to all login and compute nodes
The Operating System is Rocky-Linux 9.4 (which is based on RHEL). The setup is kept in-line (with regard to Software, Setup and general usage) is mostly equivalent to bwHPC and bwUniCluster in particular.
Components of DACHS
Compute nodes "L40S" | Compute nodes "H100" | Compute nodes "AMD_APU" | Login | |
---|---|---|---|---|
Number of nodes | 45 | 1 | 1 | 2 |
Processors | AMD EPYC 9254 | AMD EPYC 9454 | AMD MI300A | AMD EPYC 9254 |
Number of sockets | 2 | 2 | 2 | 2 |
Processor frequency (GHz) | 2.9 Ghz | 2.75 Ghz | 2.1 Ghz | 2.9 Ghz |
Total number of cores | 48 | 96 | 96 | 48 |
Main memory | 384 GB | 1536 GB | 512 GB | 384 GB |
Local SSD | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe |
Accelerators | 1x NVIDIA L40S | 8x NVIDIA H100 | 4x AMD MI300A | - |
Accelerator memory | 48 GB | 8x 80 GB | 4x 128 GB | - |
Interconnect | IB HDR100 (blocking) | IB HDR100 | IB HDR100 | IB HDR100 |
Table 1: Properties of the nodes