BwUniCluster2.0/Maintenance/2021-10: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
 
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The following changes are currently planned for the maintenance interval starting on 11.10.2021 (Monday) at 8 AM and ending on 15.10.2020 (Friday) at 12 AM.
The following changes have been introduced during the maintenance interval between on 11.10.2021 (Monday) 08:00 and 15.10.2020 (Friday) 12:00.


The host key of the system have not changed. You should not receive any warnings by your SSH client(s), but if there should be a warning or if you want to check that you are connecting to the correct system, you can verify the key hashes using the following list:
This list will be extended and specified in the next days and weeks and is subject to change

{|class="wikitable"
! Algorithm
! Hash (SHA256)
! Hash (MD5)
|-
|RSA
|p6Ion2YKZr5cnzf6L6DS1xGnIwnC1BhLbOEmDdp7FA0
|59:2a:67:44:4a:d7:89:6c:c0:0d:74:ba:3c:c4:63:6d
|-
|ECDSA
|k8l1JnfLf1y1Qi55IQmo11+/NZx06Rbze7akT5R7tE8
|85:d4:d9:97:e0:f0:43:30:6e:66:8e:d0:b6:9b:85:d1
|-
|ED25519
|yEe5nJ5hZZ1YbgieWr+phqRZKYbrV7zRe8OR3X03cn0
|42:d2:0d:ab:87:48:fc:1d:5d:b3:7c:bf:22:c3:5f:b7
|}


= Hardware =
= Hardware =


* The Broadwell Login nodes (uc1e.scc.kit.edu) will be taken out of service permanently due to ongoing hardware and software issues and low utilisation. It is still possible to generate code for the Broadwell nodes using the compilers installed on the normal login nodes, or by starting an interactive job on the Broadwell compute nodes.
* The Broadwell Login nodes (uc1e.scc.kit.edu) have been taken out of service due to ongoing hardware and software issues and low utilisation. It is still possible to generate code for the Broadwell nodes using the compilers installed on the normal login nodes, or by starting an interactive job on the Broadwell compute nodes.


* All firmware versions on all components will be upgraded.
* All firmware versions on all components have been upgraded.


= Operating system =
= Operating system =


* The operating system version will continue to be based on Red Hat Enterprise Linux (RHEL) 8.2.
* The operating system version is still based on Red Hat Enterprise Linux (RHEL) 8.2.


= Compilers, Libaries and Runtime Environments =
= Compilers, Libaries and Runtime Environments =


* The modules below toolkit/oneAPI have been integrated into the normal module structure.
= Development tools =

* Intel oneAPI versions 2021.1.0 to 2021.3.0 have been replaced by the current version 2021.4.0.

* The obsolete Intel compiler version 18.0 has been removed. The officially supported Intel Compiler versions are now 19.0, 19.1 and 2021.4.0 (oneAPI). The latest version, namely 2021.4.0, has become the default compiler.

'''Please note that Intel Compiler Version 2021.4.0 is delivered as part of oneAPI in two different versions'''. The so-called Classic Compilers are based on the previous Intel Compilers. The next generation of Intel Compilers, on the other hand, is based on LLVM and, according to Intel's current plans, will replace the Classic Compilers in the medium term (see [https://software.intel.com/content/www/us/en/develop/blogs/adoption-of-llvm-complete-icx.html]). The new LLVM-based compilers support additional features that the Classic Compilers didn't, e.g. offloading to GPUs.

The Classic compilers are available via the ''compiler/intel/2021.4.0'' module and are marked as default. The LLVM-based compilers are available via the ''compiler/intel/2021.4.0_llvm'' module and are not marked as default.

We recommend to start testing the new LLVM-based compilers now. Please note that they accept different command line arguments than the Classic compilers and produce different compiler messages. You may therefore have to modify your build scripts. If you do not use environment variables like CC, CXX etc., you also have to keep in mind that the LLVM-based compilers use different names for the commands (''icx'', ''ipcx'', ''dpcpp''). Further information can be found, for example, at [https://software.intel.com/content/www/us/en/develop/documentation/oneapi-dpcpp-cpp-compiler-dev-guide-and-reference/top/compiler-setup/using-the-command-line/invoking-the-compiler.html].


= Userspace tools =
= Userspace tools =


* The workspace tools will be switched to a different, more modern implementation. The workspace management commands will not change, and all existing workspaces will be converted automatically.
* The workspace tools have been switched to a different, more modern implementation. The workspace management commands have not changed, and all existing workspaces have been converted automatically, but the new commands produce slightly different messages on the command line. You may therefore have to modify your build scripts.


= Software Modules =
= Software Modules =


⚫
* The ''math/R'' software module has been updated to the latest version 4.1.x.
The following list it not exhaustive.

⚫
* Update math/R software module to latest version 4.1.x.


= Batch system =
= Batch system =

* The Slurm version has been update to 20.11.5, the same version currently being used on HoreKa.


= Storage =
= Storage =


* Upgrade of the Lustre file systems
* The Lustre file systems have been updated.


= Graphics stack =
= Graphics stack =


* The NVIDIA driver will be updated to the most recent version available.
* The NVIDIA driver has been updated to version 470.57.02.


= Containers =
= Containers =

* Enroot has been updated to version 3.3.1.

* Singularity has been updated to version 3.8.3.


= JupyterHub =
= JupyterHub =


* The JupyterHub version will be updated to a more recent version.
* The JupyterHub version has been updated to version 1.4.2.

Latest revision as of 12:49, 7 October 2022

The following changes have been introduced during the maintenance interval between on 11.10.2021 (Monday) 08:00 and 15.10.2020 (Friday) 12:00.

The host key of the system have not changed. You should not receive any warnings by your SSH client(s), but if there should be a warning or if you want to check that you are connecting to the correct system, you can verify the key hashes using the following list:

Algorithm Hash (SHA256) Hash (MD5)
RSA p6Ion2YKZr5cnzf6L6DS1xGnIwnC1BhLbOEmDdp7FA0 59:2a:67:44:4a:d7:89:6c:c0:0d:74:ba:3c:c4:63:6d
ECDSA k8l1JnfLf1y1Qi55IQmo11+/NZx06Rbze7akT5R7tE8 85:d4:d9:97:e0:f0:43:30:6e:66:8e:d0:b6:9b:85:d1
ED25519 yEe5nJ5hZZ1YbgieWr+phqRZKYbrV7zRe8OR3X03cn0 42:d2:0d:ab:87:48:fc:1d:5d:b3:7c:bf:22:c3:5f:b7

Hardware

  • The Broadwell Login nodes (uc1e.scc.kit.edu) have been taken out of service due to ongoing hardware and software issues and low utilisation. It is still possible to generate code for the Broadwell nodes using the compilers installed on the normal login nodes, or by starting an interactive job on the Broadwell compute nodes.
  • All firmware versions on all components have been upgraded.

Operating system

  • The operating system version is still based on Red Hat Enterprise Linux (RHEL) 8.2.

Compilers, Libaries and Runtime Environments

  • The modules below toolkit/oneAPI have been integrated into the normal module structure.
  • Intel oneAPI versions 2021.1.0 to 2021.3.0 have been replaced by the current version 2021.4.0.
  • The obsolete Intel compiler version 18.0 has been removed. The officially supported Intel Compiler versions are now 19.0, 19.1 and 2021.4.0 (oneAPI). The latest version, namely 2021.4.0, has become the default compiler.

Please note that Intel Compiler Version 2021.4.0 is delivered as part of oneAPI in two different versions. The so-called Classic Compilers are based on the previous Intel Compilers. The next generation of Intel Compilers, on the other hand, is based on LLVM and, according to Intel's current plans, will replace the Classic Compilers in the medium term (see [1]). The new LLVM-based compilers support additional features that the Classic Compilers didn't, e.g. offloading to GPUs.

The Classic compilers are available via the compiler/intel/2021.4.0 module and are marked as default. The LLVM-based compilers are available via the compiler/intel/2021.4.0_llvm module and are not marked as default.

We recommend to start testing the new LLVM-based compilers now. Please note that they accept different command line arguments than the Classic compilers and produce different compiler messages. You may therefore have to modify your build scripts. If you do not use environment variables like CC, CXX etc., you also have to keep in mind that the LLVM-based compilers use different names for the commands (icx, ipcx, dpcpp). Further information can be found, for example, at [2].

Userspace tools

  • The workspace tools have been switched to a different, more modern implementation. The workspace management commands have not changed, and all existing workspaces have been converted automatically, but the new commands produce slightly different messages on the command line. You may therefore have to modify your build scripts.

Software Modules

  • The math/R software module has been updated to the latest version 4.1.x.

Batch system

  • The Slurm version has been update to 20.11.5, the same version currently being used on HoreKa.

Storage

  • The Lustre file systems have been updated.

Graphics stack

  • The NVIDIA driver has been updated to version 470.57.02.

Containers

  • Enroot has been updated to version 3.3.1.
  • Singularity has been updated to version 3.8.3.

JupyterHub

  • The JupyterHub version has been updated to version 1.4.2.
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=BwUniCluster2.0/Maintenance/2021-10&oldid=11146"