Difference between revisions of "BwUniCluster2.0/Maintenance/2024-05"

From bwHPC Wiki
Jump to: navigation, search
(→‎Software Modules)
 
(7 intermediate revisions by 2 users not shown)
Line 23: Line 23:
 
= Hardware =
  
= Hardware =
   
−
* All firmware versions on all components will be upgraded.
 +
* All firmware versions on all components were upgraded.
   
 
= Operating system =
  
= Operating system =
   
−
* The operating system will be upgraded from RHEL 8.6 EUS to RHEL 8.8 EUS. We recommend to re-compile all applications after the upgrade.
 +
* The operating system was upgraded from RHEL 8.6 EUS to RHEL 8.8 EUS. We recommend to re-compile all applications after the upgrade.
   
−
* The Mellanox OFED InfiniBand Stack will be updated.
 +
* The Mellanox OFED InfiniBand Stack was updated.
   
 
= Compilers, Libaries and Runtime Environments =
  
= Compilers, Libaries and Runtime Environments =
−
* Certain older compilers will be deprecated (hidden, aka module load compiler/gnu/9.3 will only be available as module load compiler/gnu/.9.3)
 +
* Certain older compilers will be deprecated and hidden (a dot prepended):<br>These compilers and Software is '''still available''', but instead of <code>module load compiler/gnu/9.3</code> will now be available as <code>module load compiler/gnu/.9.3</code>.
  +
* The compilers gnu-9.3, gnu-10.3, gnu-11.1, gnu-11.2, gnu-12.1, gnu-13.2, as well as llvm-11.0, llvm-13.0, llvm-14.0, llvm-15.0, llvm-16.0 will be deprecated and hidden. Modules depending on those as well.
−
* Intel OneAPI 2023 and 2024 will be available
  
  +
* The available (non-hidden) compilers therefore are:
−
* Intel parallel studio 2020 (compiler 19.1, impi 2020, mkl 2020) will be removed
  
  +
** gnu-8.5.0 (the system compiler)
  +
** gnu-10.2 (which a lot of modules still depend on)
  +
** gnu-13.3 (the new gnu default)
  +
** gnu-14.1 (which may require You to adapt your software, see https://gcc.gnu.org/gcc-14/porting_to.html)
  +
** llvm-17.0
  +
** llvm-18.1 (the new llvm default)
  +
* GNU compilers are compiled against CUDA to support parallelization for the GPU using OpenMP target and OpenACC.
  +
  +
* Intel OneAPI 2023 and 2024 are now available
  +
* Intel parallel studio 2020 (compiler 19.1, impi 2020, mkl 2020) are deprecated
   
 
= Userspace tools =
  
= Userspace tools =
Line 40: Line 50:
   
 
= Software Modules =
  
= Software Modules =
  +
* CMake has been updated to 3.29.3 (the old version 3.23.3 is hidden); the old version 3.18 is still available.
  +
* Valgrind has been updated to 3.23 (the old version 3.22 is hidden)
  +
* Dwarves tool pahole has been updated to 1.26 (the old version 1.24 is hidden)
  +
  +
* Open MPI has been upgraded to version 5.0.3 compiled against the compilers gnu-8.5.0 (the system default), gnu-10.2, gnu-13.2 and gnu-13.3, gnu-14.1, intel-2023.1.0, intel-2023.1.0_llvm, intel-2024.0_llvm, llvm-17.0 and llvm-18.1<br>'''Please note''': Open MPI now links against several internal libraries statically -- which adds the CUDA library as dependency. Therefore all modules load the default CUDA-12.2 module as well as add a soft-link to libcuda.so.1. You should be able to replace the CUDA version by unloading and loading your desired CUDA module.
   
  +
* The Library HDF5 has been upgraded to 1.14.4-2 for several compilers and MPI versions.
   
 
= Batch system =
  
= Batch system =
   
−
* The Slurm version will be upgraded to version 23.11.5
 +
* The Slurm version was upgraded to version 23.11.5
   
 
= Storage =
  
= Storage =
   
−
* Lustre client, BeeGFS client and Spectrum Scale client will be updated.
 +
* Lustre client, BeeGFS client and Spectrum Scale client were updated.
   
 
= Graphics stack =
  
= Graphics stack =
   
−
* The NVIDIA driver will be upgraded.
 +
* The NVIDIA driver was upgraded to 550.54.15
−
* CUDA 12.2 will be the default version, 12.4 will be available
 +
* CUDA 12.2 is now the default version, 12.4 is available
−
* NVIDIA toolkit: default will switch from 21.2 to 23.9
 +
* NVIDIA toolkit: default is now 23.9
   
 
= Containers =
  
= Containers =
Line 60: Line 76:
 
= JupyterHub =
  
= JupyterHub =
   
−
* Jupyterhub will be upgraded
 +
* Jupyterhub was upgraded to 4.1.3

Latest revision as of 15:09, 24 May 2024

The following changes were introduced during the maintenance interval between on 21.05.2024 (Tuesday) 08:30 and 24.05.2024 (Friday) 15:00.

We are not planning to change the host key of the system. You should not receive any warnings by your SSH client(s), but if there should be a warning or if you want to check that you are connecting to the correct system, you can verify the key hashes using the following list:

Algorithm Hash (SHA256) Hash (MD5)
RSA p6Ion2YKZr5cnzf6L6DS1xGnIwnC1BhLbOEmDdp7FA0 59:2a:67:44:4a:d7:89:6c:c0:0d:74:ba:3c:c4:63:6d
ECDSA k8l1JnfLf1y1Qi55IQmo11+/NZx06Rbze7akT5R7tE8 85:d4:d9:97:e0:f0:43:30:6e:66:8e:d0:b6:9b:85:d1
ED25519 yEe5nJ5hZZ1YbgieWr+phqRZKYbrV7zRe8OR3X03cn0 42:d2:0d:ab:87:48:fc:1d:5d:b3:7c:bf:22:c3:5f:b7

1 Hardware

  • All firmware versions on all components were upgraded.

2 Operating system

  • The operating system was upgraded from RHEL 8.6 EUS to RHEL 8.8 EUS. We recommend to re-compile all applications after the upgrade.
  • The Mellanox OFED InfiniBand Stack was updated.

3 Compilers, Libaries and Runtime Environments

  • Certain older compilers will be deprecated and hidden (a dot prepended):
    These compilers and Software is still available, but instead of module load compiler/gnu/9.3 will now be available as module load compiler/gnu/.9.3.
  • The compilers gnu-9.3, gnu-10.3, gnu-11.1, gnu-11.2, gnu-12.1, gnu-13.2, as well as llvm-11.0, llvm-13.0, llvm-14.0, llvm-15.0, llvm-16.0 will be deprecated and hidden. Modules depending on those as well.
  • The available (non-hidden) compilers therefore are:
    • gnu-8.5.0 (the system compiler)
    • gnu-10.2 (which a lot of modules still depend on)
    • gnu-13.3 (the new gnu default)
    • gnu-14.1 (which may require You to adapt your software, see https://gcc.gnu.org/gcc-14/porting_to.html)
    • llvm-17.0
    • llvm-18.1 (the new llvm default)
  • GNU compilers are compiled against CUDA to support parallelization for the GPU using OpenMP target and OpenACC.
  • Intel OneAPI 2023 and 2024 are now available
  • Intel parallel studio 2020 (compiler 19.1, impi 2020, mkl 2020) are deprecated

4 Userspace tools

5 Software Modules

  • CMake has been updated to 3.29.3 (the old version 3.23.3 is hidden); the old version 3.18 is still available.
  • Valgrind has been updated to 3.23 (the old version 3.22 is hidden)
  • Dwarves tool pahole has been updated to 1.26 (the old version 1.24 is hidden)
  • Open MPI has been upgraded to version 5.0.3 compiled against the compilers gnu-8.5.0 (the system default), gnu-10.2, gnu-13.2 and gnu-13.3, gnu-14.1, intel-2023.1.0, intel-2023.1.0_llvm, intel-2024.0_llvm, llvm-17.0 and llvm-18.1
    Please note: Open MPI now links against several internal libraries statically -- which adds the CUDA library as dependency. Therefore all modules load the default CUDA-12.2 module as well as add a soft-link to libcuda.so.1. You should be able to replace the CUDA version by unloading and loading your desired CUDA module.
  • The Library HDF5 has been upgraded to 1.14.4-2 for several compilers and MPI versions.

6 Batch system

  • The Slurm version was upgraded to version 23.11.5

7 Storage

  • Lustre client, BeeGFS client and Spectrum Scale client were updated.

8 Graphics stack

  • The NVIDIA driver was upgraded to 550.54.15
  • CUDA 12.2 is now the default version, 12.4 is available
  • NVIDIA toolkit: default is now 23.9

9 Containers

10 JupyterHub

  • Jupyterhub was upgraded to 4.1.3
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=BwUniCluster2.0/Maintenance/2024-05&oldid=12788"