Main Page: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
m (Added icons and descriptions, moved data transfer link)
 
(45 intermediate revisions by 9 users not shown)
Line 1: Line 1:
⚫
{| style=" background:#FEF4AB; width:100%;"
⚫
| style="padding:8px; background:#FFE856; font-size:120%; font-weight:bold; text-align:left" | News
⚫
|-
⚫
|
* New support ticket system: bwHPC will switch to a new system for tickets on 2025-02-19. https://www.bwhpc.de/supportportal will stay vaild all the time. It will point to the new system from 2025-02-12 on. The old system will be switched off and all addresses migrated on 2025-02-19
⚫
|}

<span style="font-size:140%;>'''Welcome to the bwHPC Wiki.'''</span>
<span style="font-size:140%;>'''Welcome to the bwHPC Wiki.'''</span>


bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').
bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').


The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].
The main bwHPC web page is at '''[https://www.bwhpc.de/ https://www.bwhpc.de/]'''.


Many topics depend on the cluster system you use.
Many topics depend on the cluster system you use.
First choose the cluster you use, then select the correct topic.
First choose the cluster you use, then select the correct topic.

<!-- bwHPC STATUS START -->

{{Template:Status|ok|'''Status:''' Ok}}

<!--
Template usage examples: color ok(green),warn(yellow),alert(red). Enter custom text in 3rd field
{{Template:Status|ok|Status: Ok}}
{{Template:Status|warn|Status: maintenance upcoming}}
{{Template:Status|alert|Status: bwUniCluster down}}
-->

<!-- bwHPC STATUS END -->


{| style=" background:#eeeefe; width:100%;"
{| style=" background:#eeeefe; width:100%;"
Line 24: Line 30:


{| style=" background:#deffee; width:100%;"
{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] Need Access to a Cluster?
|-
|-
|
|
* [[When (not) to use a HPC Cluster]]
* [[When to use an HPC Cluster]]
* [[Running Calculations]]
* [[Registration]]
* [[Registration]]
|}
|}


{| style=" background:#deffee; width:100%;"
{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] HPC System Specific Documentation
|-
|-
|
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
bwHPC encompasses several HPC compute clusters at different universities in Baden-Württemberg. Each cluster is dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
{|
|-
|-
| style="padding:5px; width:30%" | [[BwUniCluster2.0|bwUniCluster 2.0]]
| style="padding:5px; width:30%" | [[BwUniCluster3.0|bwUniCluster 3.0]]
| style="padding-left:20px;" | General Purpose, Teaching
| style="padding-left:20px;" | General Purpose, Teaching
|-
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding:5px; width:30%" | [[BinAC2|bwForCluster BinAC 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
| style="padding-left:20px;" | Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
|-
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
|-
|-
| style="padding:5px; width:30%" | [[NEMO|bwForCluster NEMO]]
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
|-
| style="padding:5px; width:30%" | [[BinAC|bwForCluster BinAC]]
| style="padding:5px; width:30%" | [[NEMO2|bwForCluster NEMO 2]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics.
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|}
|}
|-
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
Further Compute Clusters in Baden-Württemberg (separate access policies):
Further Compute Clusters in Baden-Württemberg (separate access policies):
* Datenanalyse Cluster der Hochschulen (DACHS): [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/HPE_Hawk Hawk] ([https://www.hlrs.de/solutions-services/academic-users/ getting access])
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}
|}


{| style="background:#deffee; width:100%;"
{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] Documentation valid for all Clusters
|-
|-
|
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [[Environment Modules| Software Environment Modules]]: usage of preexisting software
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Data Transfer|Data Transfer]]: working with files [[File:Notebook.svg|x15px]] <---> [[File:Clusternodes.svg|x15px]]
* [[Development| Software Development and Parallel Programming]]
* [[Development| Development]]: software, programming languages, parallel pogramming
* [[Energy Efficient Cluster Usage]]
* [[Energy Efficient Cluster Usage | (Energy) Efficient Cluster Usage]] for low waiting times and fast running jobs
* [[HPC Glossary]]
* [[HPC Glossary]]


{| style="height:100%; background:#ffeaef; width:100%"
{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | [[File:Storage_small.svg|x15px]] Scientific Data Storage
|-
|-
|
|
For user guides of the scientific data storage services:
User guides of available scientific data storage services:
* [[SDS@hd]]: Everyone can join existing storage projects, entitlement needed for creating your own, [https://sds-hd.urz.uni-heidelberg.de/management/shib/sds_costs.php cost sheet]
* [[SDS@hd]]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
* [https://www.rda.kit.edu/english bwDataArchive]
* [https://zas.bwsfs.uni-tuebingen.de/info/uebersicht bwSFS]
Associated, but local scientific storage services are:
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
Line 85: Line 93:


{| style="height:100%; background:#ffeaef; width:100%"
{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | [[File:Storage_small.svg|x15px]] Scientific Data Archiving
⚫
|-
⚫
|
For user guides of the scientific data archiving services:
* [https://www.rda.kit.edu/english bwDataArchive]: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT
Associated, but local archiving services for scientific data are:
* [https://www.urz.uni-heidelberg.de/de/service-katalog/speicher/heiarchive heiARCHIVE] (only for members of Heidelberg University)
For instructions on how to move the data, depending on the offered connections, can be found under [[Data Transfer | Data Transfer]].
⚫
|}

⚫
{| style="height:100%; background:#ffeaef; width:100%"
⚫
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Research Data Management
|-
|-
|
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
Line 96: Line 114:
|-
|-
|
|
* [[BwSupportPortal|Submit a Ticket in our Support Portal]]
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://www.bwhpc.de/supportportal.php Submit a Ticket]
|}
|}
{| style=" background:#e6e9eb; width:100%;"
{| style=" background:#e6e9eb; width:100%;"

Latest revision as of 17:14, 20 April 2026

Welcome to the bwHPC Wiki.

bwHPC represents services and resources in the State of Baden-Württemberg, Germany, for High Performance Computing (HPC), Data Intensive Computing (DIC) and Large Scale Scientific Data Management (LS2DM).

The main bwHPC web page is at https://www.bwhpc.de/.

Many topics depend on the cluster system you use. First choose the cluster you use, then select the correct topic.


Status: Ok


Courses / eLearning
Clusternodes.svg Need Access to a Cluster?
Clusternodes.svg HPC System Specific Documentation

bwHPC encompasses several HPC compute clusters at different universities in Baden-Württemberg. Each cluster is dedicated to specific research domains.

Documentation differs between compute clusters, please see cluster specific overview pages:

bwUniCluster 3.0 General Purpose, Teaching
bwForCluster BinAC 2 Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
bwForCluster Helix Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
bwForCluster JUSTUS 2 Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
bwForCluster NEMO 2 Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
bwHPC Clusters: operational status

Further Compute Clusters in Baden-Württemberg (separate access policies):

Clusternodes.svg Documentation valid for all Clusters
Storage small.svg Scientific Data Storage

User guides of available scientific data storage services:

  • SDS@hd: Everyone can join existing storage projects, entitlement needed for creating your own, cost sheet
  • bwSFS

Associated, but local scientific storage services are:

Storage small.svg Scientific Data Archiving

For user guides of the scientific data archiving services:

  • bwDataArchive: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT

Associated, but local archiving services for scientific data are:

  • heiARCHIVE (only for members of Heidelberg University)

For instructions on how to move the data, depending on the offered connections, can be found under Data Transfer.

Research Data Management
Support

Support is provided by the bwHPC Competence Centers:

Acknowledgement
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=Main_Page&oldid=15970"