DACHS/Hardware and Architecture: Difference between revisions
< DACHS
Jump to navigation
Jump to search
(1st Version) |
|||
| (4 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
= Architecture of DACHS = |
= Architecture of DACHS = |
||
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband |
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband to all login and compute nodes |
||
The Operating System is Rocky-Linux 9.4 (which is based on RHEL) |
The Operating System is Rocky-Linux 9.4 (which is based on RHEL). |
||
The setup is kept in-line (with regard to Software, Setup and general usage) and thus mostly equivalent to bwHPC and bwUniCluster in particular. |
|||
= Components of DACHS = |
|||
{| class="wikitable" |
|||
|- |
|||
! style="width:9%"| |
|||
! style="width:13%"| Compute nodes "L40S" |
|||
! style="width:13%"| Compute nodes "H100" |
|||
! style="width:13%"| Compute nodes "AMD_APU" |
|||
! style="width:13%"| Login |
|||
|- |
|||
!scope="column"| Number of nodes |
|||
| 45 |
|||
| 1 |
|||
| 1 |
|||
| 2 |
|||
|- |
|||
!scope="column"| Processors |
|||
| AMD EPYC 9254 |
|||
| AMD EPYC 9454 |
|||
| AMD MI300A |
|||
| AMD EPYC 9254 |
|||
|- |
|||
!scope="column"| Number of sockets |
|||
| 2 |
|||
| 2 |
|||
| 4 |
|||
| 2 |
|||
|- |
|||
!scope="column"| Processor frequency (GHz) |
|||
| 2.9 Ghz |
|||
| 2.75 Ghz |
|||
| 2.1 Ghz |
|||
| 2.9 Ghz |
|||
|- |
|||
!scope="column"| Total number of cores |
|||
| 48 |
|||
| 96 |
|||
| 96 |
|||
| 48 |
|||
|- |
|||
!scope="column"| Main memory |
|||
| 384 GB |
|||
| 1536 GB |
|||
| 512 GB |
|||
| 384 GB |
|||
|- |
|||
!scope="column"| Local SSD |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
| 1,92 TB NVMe |
|||
|- |
|||
!scope="column"| Accelerators |
|||
| 1x NVIDIA L40S |
|||
| 8x NVIDIA H100 |
|||
| 4x AMD MI300A |
|||
| - |
|||
|- |
|||
!scope="column"| Accelerator memory |
|||
| 48 GB |
|||
| 8x 80 GB |
|||
| 4x 128 GB |
|||
| - |
|||
|- |
|||
!scope="column"| Interconnect |
|||
| IB HDR100 |
|||
| IB HDR100 |
|||
| IB HDR100 |
|||
| IB HDR100 |
|||
|} |
|||
Table 1: Properties of the nodes |
|||
== Storage Architecture == |
|||
The system features a 700 TB large BeeGFS filesystem available on login and compute nodes. |
|||
Latest revision as of 13:19, 12 November 2024
Architecture of DACHS
The Datenanalyse Cluster der Hochschulen (DACHS) is a parallel computer with distributed memory connected over Infiniband and Ethernet. The compute nodes contain at least dual AMD processors, at least 384GB of local memory, 2 TB local NVMe-based disc storage and accelerators as shown in the table below. With BeeGFS a fast and scalable filesystem is provided via Infiniband to all login and compute nodes
The Operating System is Rocky-Linux 9.4 (which is based on RHEL). The setup is kept in-line (with regard to Software, Setup and general usage) and thus mostly equivalent to bwHPC and bwUniCluster in particular.
Components of DACHS
| Compute nodes "L40S" | Compute nodes "H100" | Compute nodes "AMD_APU" | Login | |
|---|---|---|---|---|
| Number of nodes | 45 | 1 | 1 | 2 |
| Processors | AMD EPYC 9254 | AMD EPYC 9454 | AMD MI300A | AMD EPYC 9254 |
| Number of sockets | 2 | 2 | 4 | 2 |
| Processor frequency (GHz) | 2.9 Ghz | 2.75 Ghz | 2.1 Ghz | 2.9 Ghz |
| Total number of cores | 48 | 96 | 96 | 48 |
| Main memory | 384 GB | 1536 GB | 512 GB | 384 GB |
| Local SSD | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe | 1,92 TB NVMe |
| Accelerators | 1x NVIDIA L40S | 8x NVIDIA H100 | 4x AMD MI300A | - |
| Accelerator memory | 48 GB | 8x 80 GB | 4x 128 GB | - |
| Interconnect | IB HDR100 | IB HDR100 | IB HDR100 | IB HDR100 |
Table 1: Properties of the nodes
Storage Architecture
The system features a 700 TB large BeeGFS filesystem available on login and compute nodes.