New pages
Jump to navigation
Jump to search
- 18:58, 9 January 2025 BwUniCluster3.0/Maintenance (hist | edit) [929 bytes] S Braun (talk | contribs) (Created page with "'''2024''' * BwUniCluster2.0/Maintenance/2024-05 from 21.05.2024 to 24.05.2024 '''2023''' * BwUniCluster2.0/Maintenance/2023-03 from 20.03.2023 to 24.03.2023 '''2022''' * BwUniCluster2.0/Maintenance/2022-11 from 07.11.2022 to 10.11.2022 * BwUniCluster2.0/Maintenance/2022-03 from 28.03.2022 to 31.03.2022 '''2021''' * BwUniCluster2.0/Maintenance/2021-10 from 11.10.2021 to 15.10.2021 '''2020''' * BwUniCluster2.0/Maintenance/2020-10 from 06....")
- 18:56, 9 January 2025 BwUniCluster3.0/Containers (hist | edit) [10,800 bytes] S Braun (talk | contribs) (Created page with "= Introduction = To date, only few container runtime environments integrate well with HPC environments due to security concerns and differing assumptions in some areas. For example native Docker environments require elevated privileges, which is not an option on shared HPC resources. Docker's "rootless mode" is also currently not supported on our HPC systems because it does not support necessary features such as cgroups resource controls, security profiles, overlay netw...")
- 18:55, 9 January 2025 BwUniCluster3.0/Software (hist | edit) [802 bytes] S Braun (talk | contribs) (Created page with "== Environment Modules == Most software is provided as Modules. Required reading to use: Software Environment Modules == Available Software == Visit [https://www.bwhpc.de/software.php https://www.bwhpc.de/software.php], select <code>Cluster → bwUniCluster 3.0</code> On cluster: <code>module avail</code> == Software in Containers == Instructions for loading software in containers: BwUniCluster2.0/Containers == Documentation...")
- 16:57, 9 January 2025 BwUniCluster3.0/Acknowledgement (hist | edit) [1,130 bytes] S Braun (talk | contribs) (Created page with "The HPC resource bwUniCluster 3.0 is funded by the Ministry of Science, Research and the Arts Baden-Württemberg and the Universities of the State of Baden-Württemberg: * Albert Ludwig University of Freiburg * Eberhard Karls University, Tübingen * Karlsruhe Institute of Technology (KIT) * Ruprecht-Karls-Universität Heidelberg * Ulm University * University of Hohenheim * University of Konstanz * University of Mannheim * University of Stuttgart, * several Registration...")
- 14:29, 9 January 2025 BwUniCluster3.0/Jupyter (hist | edit) [17,510 bytes] S Braun (talk | contribs) (Created page with "Jupyter can be used as an alternative to accessing HPC resources via SSH. For this purpose only a web browser is required. Within the website source code of different programming languages can be edited and executed. Furthermore different user interfaces and terminals are available. = Short description of Jupyter = Jupyter is a web application, central component of Jupyter is the '''Jupyter Notebook'''. It is a document, which can contain formatted text, executable cod...")
- 14:25, 9 January 2025 BwUniCluster3.0/FAQ (hist | edit) [424 bytes] S Braun (talk | contribs) (Created page with "Frequently asked questions (FAQs) concerning best practice of bwUniCluster 3.0 = Login = * In case of having issues with OTP, service password or denied access → Troubleshooting = Hardware and Architecture = * Migration from bwUniCluster 2.0 to 3.0 ** Concerning guide to migrate your data → file system migration guide")
- 14:22, 9 January 2025 BwUniCluster3.0/Support (hist | edit) [2,020 bytes] S Braun (talk | contribs) (Created page with "== Registration == {| style="vertical-align:top;background:#f5fffa;border:2px solid #000000;" | The primary support channel for all inquiries is the ticket system at * '''[https://bw-support.scc.kit.edu/ bwSupport Portal]''' |} If you are having issues connected to your local home institution, e.g. getting the entitlement for registration on bwUniCluster 2.0, you may also contact your local hotline: {| style="vertical-align:top;" ! University !! Hotline |- | Albert...")
- 14:16, 9 January 2025 BwUniCluster3.0/Getting Started (hist | edit) [2,172 bytes] S Braun (talk | contribs) (Created page with "== General Workflow of Running a Calculation == On a compute cluster, you do not simply run log in and your software, but you write a "job script" that contains all commands to run and process your job and send this into a waiting queue to be run on one of several hundred computers. How this is done is described in a little more detail here: Running Calculations == Get access to the cluster == Follow the registration process for the bwUniCluster. → Regi...")
- 14:07, 9 January 2025 BwUniCluster3.0/Login (hist | edit) [9,469 bytes] S Braun (talk | contribs) (Created page with "{|style="background:#deffee; width:100%;" |style="padding:5px; background:#cef2e0; text-align:left"| center|25px |style="padding:5px; background:#cef2e0; text-align:left"| Access to bwUniCluster 2.0 is '''limited to IP addresses from the BelWü network'''. All home institutions of our current users are connected to BelWü, so if you are on your campus network (e.g. in your office or on the Campus WiFi) you should be able to connect to bwUniCluster...")
- 12:35, 9 January 2025 BwUniCluster3.0/Hardware and Architecture/Filesystem Details (hist | edit) [24,763 bytes] S Braun (talk | contribs) (Created page with "Filesystems_Details")
- 09:45, 8 January 2025 BwUniCluster3.0/First Steps (hist | edit) [2,172 bytes] S Braun (talk | contribs) (Created page with "<!-- == Command line interface == Any work is to be done via command line interface. A quick guide can be found [https://indico.scc.kit.edu/indico/event/278/material/slides/10.pdf '''here''']. == Software setup == Softwares provided by bwHPC have to be loaded according to your need via the '''Software Module System'''. == Computation == Any kind of computation on any HPC cluster is done as bwUniCluster_2.0_Slurm_common_Features|'''ba...")
- 22:43, 17 December 2024 DACHS/Queues (hist | edit) [4,537 bytes] R Keller (talk | contribs) (First page describing the partitions of DACHS)
- 14:23, 5 December 2024 BwUniCluster3.0/Slurm (hist | edit) [9,494 bytes] P Schuhmacher (talk | contribs) (Created page with "__TOC__ = Slurm HPC Workload Manager = == Specification == Slurm is an open source, fault-tolerant, and highly scalable cluster management and job scheduling system for large and small Linux clusters. Slurm requires no kernel modifications for its operation and is relatively self-contained. As a cluster workload manager, Slurm has three key functions. First, it allocates exclusive and/or non-exclusive access to resources (compute nodes) to users for some duration of...")
- 16:28, 4 December 2024 Helix/bwVisu/Acknowledgement (hist | edit) [894 bytes] H Schumacher (talk | contribs) (created page)
- 16:27, 4 December 2024 Helix/bwVisu/KI-Morph (hist | edit) [1,350 bytes] H Schumacher (talk | contribs) (created page)
- 16:22, 4 December 2024 Helix/bwVisu/RStudio (hist | edit) [510 bytes] H Schumacher (talk | contribs) (created page)
- 16:17, 4 December 2024 Helix/bwVisu/JupyterLab (hist | edit) [5,344 bytes] H Schumacher (talk | contribs) (created page)
- 16:08, 4 December 2024 Helix/bwVisu/Usage (hist | edit) [3,734 bytes] H Schumacher (talk | contribs) (created page)
- 15:44, 4 December 2024 Helix/bwVisu/Getting Started (hist | edit) [3,707 bytes] H Schumacher (talk | contribs) (created page)
- 15:30, 4 December 2024 Helix/bwVisu (hist | edit) [1,820 bytes] H Schumacher (talk | contribs) (created page)
- 17:45, 3 December 2024 BinAC2/SLURM Partitions (hist | edit) [1,996 bytes] F Bartusch (talk | contribs) (Create stub)
- 14:34, 3 December 2024 BinAC2/Slurm (hist | edit) [30,701 bytes] F Bartusch (talk | contribs) (Copy&Paste of the bwUniCluster Slurm page.)
- 11:28, 3 December 2024 BinAC2/Software (hist | edit) [1,087 bytes] F Bartusch (talk | contribs) (Begin BinAC 2 software page)
- 02:31, 29 November 2024 SDS@hd/Access/SMB (hist | edit) [13,350 bytes] H Schumacher (talk | contribs) (new version of CIFS page; added intro sentence; adjusted Mac and Windows sections)
- 01:25, 29 November 2024 Data Transfer/Rsync (hist | edit) [1,652 bytes] H Schumacher (talk | contribs) (created page)
- 17:51, 28 November 2024 Data Transfer/Graphical Clients (hist | edit) [3,694 bytes] H Schumacher (talk | contribs) (created page)
- 09:47, 28 November 2024 BwUniCluster3.0/Batch Queues (hist | edit) [8,995 bytes] S Braun (talk | contribs) (Created page with "__TOC__ == sbatch -p ''queue'' == Compute resources such as (wall-)time, nodes and memory are restricted and must fit into '''queues'''. Since requested compute resources are NOT always automatically mapped to the correct queue class, '''you must add the correct queue class to your sbatch command '''. <font color=red>The specification of a queue is obligatory on BwUniCluster 2.0.</font> <br> Details are: {| width=750px class="wikitable" ! colspan="5" | bwUniCluster 2....")
- 13:20, 27 November 2024 Data Transfer/SCP (hist | edit) [886 bytes] H Schumacher (talk | contribs) (created page)
- 14:34, 26 November 2024 BwUniCluster3.0/Hardware and Architecture (hist | edit) [11,117 bytes] S Braun (talk | contribs) (Created page with "= Architecture of bwUniCluster 3.0 = The bwUniCluster 3.0 is a parallel computer with distributed memory. Each node of system consists of at least two Intel Xeon processor, local memory, disks, network adapters and optionally accelerators (NVIDIA Tesla V100, A100 or H100). All nodes are connected by a fast InfiniBand interconnect. In addition the file system Lustre, that is connected by coupling the InfiniBand of the file server with the InfiniBand switch of the compute...")
- 18:35, 25 November 2024 Data Transfer/All Data Transfer Routes (hist | edit) [3,856 bytes] H Schumacher (talk | contribs) (created page)
- 18:11, 25 November 2024 Data Transfer/Advanced Data Transfer (hist | edit) [1,850 bytes] H Schumacher (talk | contribs) (created page)
- 20:31, 21 November 2024 Data Transfer/SSHFS (hist | edit) [2,703 bytes] H Schumacher (talk | contribs) (created page)
- 20:17, 21 November 2024 Data Transfer/SFTP (hist | edit) [544 bytes] H Schumacher (talk | contribs) (created page)
- 20:01, 21 November 2024 Data Transfer/WebDAV (hist | edit) [3,050 bytes] H Schumacher (talk | contribs) (created page)
- 18:36, 21 November 2024 Data Transfer/Rclone (hist | edit) [4,431 bytes] H Schumacher (talk | contribs) (Created page)
- 09:46, 11 November 2024 DACHS/Login (hist | edit) [8,534 bytes] M Kunzelmann (talk | contribs) (create login page)
- 17:02, 7 November 2024 DACHS/Support (hist | edit) [757 bytes] R Keller (talk | contribs) (Created page with "== Support == {| style="vertical-align:top;background:#f5fffa;border:2px solid #000000;" | All longer term support issues should be handled via the established trouble ticket system: * '''[https://bw-support.scc.kit.edu/ bwSupport Portal]''' |} == Contact == For specific questions and requests, You may reach administrators via e-mail to mailto:dachs-admin@hs-esslingen.de == Issues with Two-Factor Authentication (2FA) == '''Q: How do I register/deactivate a token?'''...")
- 16:00, 7 November 2024 BwUniCluster3.0 (hist | edit) [3,888 bytes] S Braun (talk | contribs) (Created page with "= bwUniCluster3.0 =")
- 10:51, 6 November 2024 BinAC2/Getting Started (hist | edit) [14,009 bytes] F Bartusch (talk | contribs) (Copy and Paste getting started from BinAC to BinAC2)
- 09:49, 5 November 2024 Development/Python (hist | edit) [8,976 bytes] S Braun (talk | contribs) (Created page with " = Installation and Usage = == Available versions == == Virtual environments ==")
- 18:04, 31 October 2024 BinAC2/Login (hist | edit) [6,970 bytes] F Bartusch (talk | contribs) (Created page with "{|style="background:#deffee; width:100%;" |style="padding:5px; background:#cef2e0; text-align:left"| center|25px |style="padding:5px; background:#cef2e0; text-align:left"| Access to bwForCluster BinAC 2 is only possible from IP addresses within the [https://www.belwue.de BelWü] network which connects universities and other scientific institutions in Baden-Württemberg. If your computer is in your University network (e.g. at your office), you shou...")
- 15:12, 30 October 2024 BwUniCluster2.0/Software/R/cummeRbund (hist | edit) [5,152 bytes] K Kuck (talk | contribs) (Created page with "= General information = [https://rspatial.github.io/terra/ '''<code>CummeRbund</code>'''] is an <code>R</code> package designed to aid and simplify the task of analyzing Cufflinks RNA-Seq output. = Installation instructions = == Preparations == Installing <code>CummeRbund</code> involves compiling source code. Therefore, ensure that the following flags are set in <code>$HOME/.R/Makevars</code>: <pre> cat ~/.R/Makevars CXX14=g++ CXX17=g++ CXX14FLAGS += -std=c++14 C...")
- 15:40, 28 October 2024 BinAC/Software/Conda (hist | edit) [5,892 bytes] F Bartusch (talk | contribs) (Created page with "{| style="height:100%; background:#ffeaef; width:100%" | style="padding:2px; background:#f5dfdf; font-size:100%; font-weight:bold; text-align:left" | '''Caution''' |- | The licensing situation with Anaconda is currently unclear. To be on the safe side, make sure to not use the '''defaults''' channel |} = Use Conda Environments on BinAC = [https://conda.io/docs/index.html Conda] can be used to easily install software (usually Python packages) in dedicated environme...")
- 13:39, 28 October 2024 BwUniCluster2.0/Software/R/terra (R 4.2.1) (hist | edit) [4,560 bytes] K Kuck (talk | contribs) (Created page with " <span style="color:red"><b>Note that the instructions provided below refer to R 4.2.1 (but not R 4.3.3)! We are currently updating our guides for R 4.3.3.</b></span> = General information = sf and terra allow to use the following tools for handling spatial structures in R * the 'Geospatial' Data Abstraction Library [https://gdal.org/ GDAL] * Projection/transformation operations from the [https://proj.org/ PROJ] library * Interface to the open source Geometry Engin...")
- 12:54, 28 October 2024 DACHS/Registration (hist | edit) [1,988 bytes] R Keller (talk | contribs) (Created page with "= Registration bwUniCluster = The DACHS is the high performance computing (HPC) for Data Analysis of Universities of Applied Science in Baden-Württemberg. It is co-financed by the Ministry of Science, Research and the Arts Baden-Württemberg and the shareholders: * HS Aalen * HS Albstadt-Sigmaringen * HS Esslingen * HS Heilbronn * HS Karlsruhe * HTWG Konstanz * HS Mannheim * HS Offenburg * HS Reutlingen * HfT Stuttgart * TH Ulm All members of the shareholder unive...")
- 12:33, 28 October 2024 DACHS/Getting Started (hist | edit) [2,977 bytes] R Keller (talk | contribs) (Getting started)
- 13:48, 27 October 2024 BwUniCluster2.0/Software/R/Rgdal (R 4.2.1) (hist | edit) [4,328 bytes] K Kuck (talk | contribs) (Created page with "<span style="color:red"><b>Note that the instructions provided below refer to R 4.2.1 (but not R 4.4.1)!</b></span> = General information = <span style="color:red"><b>Note that rgdal and rgeos have been retired by their developers in 2023!</b> Please find further information at [https://cran.r-project.org/web/packages/rgdal/index.html https://cran.r-project.org/web/packages/rgdal/index.html] and [https://cran.r-project.org/web/packages/rgeos/index.html https://cran.r-p...")