Main Page: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
m (Added icons and descriptions, moved data transfer link)
 
(8 intermediate revisions by 3 users not shown)
Line 8: Line 8:
First choose the cluster you use, then select the correct topic.
First choose the cluster you use, then select the correct topic.


<!-- bwHPC STATUS START
<!-- bwHPC STATUS START -->
{| style=" background:#FFD28A; width:100%;"
| style="padding:8px; background:#FFC05C; font-size:120%; font-weight:bold; text-align:left" | [[Status|Maintenances and Outages]]
|}
OK/green -->


{{Template:Status|ok|'''Status:''' Ok}}
{| style=" background:#B8FFB8; width:100%;"
| style="padding:8px; background:#8AFF8A; font-size:120%; text-align:left" | [[Status|'''Status:''' Maintenances [0] & Outages [0]]]
|}


<!-- warning/yellow -->
<!--
<!--
Template usage examples: color ok(green),warn(yellow),alert(red). Enter custom text in 3rd field
{| style=" background:#FFD28A; width:100%;"
{{Template:Status|ok|Status: Ok}}
| style="padding:8px; background:#FFC05C; font-size:120%; font-weight:bold; text-align:left" | [[Status|Maintenances and Outages: BwUniCluster offline]]
{{Template:Status|warn|Status: maintenance upcoming}}
|}
{{Template:Status|alert|Status: bwUniCluster down}}
-->
<!-- alert/red -->
<!--
{| style=" background:#FF8A8A; width:100%;"
| style="padding:8px; background:#FF5C5C; font-size:120%; font-weight:bold; text-align:left" | [[Status|Maintenances and Outages]] (Currently: 1)
-->
-->

<!-- bwHPC STATUS END -->
<!-- bwHPC STATUS END -->


Line 40: Line 30:


{| style=" background:#deffee; width:100%;"
{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] Need Access to a Cluster?
|-
|-
|
|
* [[When to use a HPC Cluster]]
* [[When to use an HPC Cluster]]
* [[Running Calculations]]
* [[Running Calculations]]
* [[Registration]]
* [[Registration]]
Line 49: Line 39:


{| style=" background:#deffee; width:100%;"
{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] HPC System Specific Documentation
|-
|-
|
|
Line 75: Line 65:
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
Further Compute Clusters in Baden-Württemberg (separate access policies):
Further Compute Clusters in Baden-Württemberg (separate access policies):
* Datenanalyse Cluster der Hochschulen (DACHS): [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
Line 81: Line 71:


{| style="background:#deffee; width:100%;"
{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | [[File:Clusternodes.svg|x20px]] Documentation valid for all Clusters
|-
|-
|
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [[Environment Modules| Software Environment Modules]]: usage of preexisting software
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Data Transfer|Data Transfer]]: working with files [[File:Notebook.svg|x15px]] <---> [[File:Clusternodes.svg|x15px]]
* [[Development| Software Development and Parallel Programming]]
* [[Development| Development]]: software, programming languages, parallel pogramming
* [[Energy Efficient Cluster Usage]]
* [[Energy Efficient Cluster Usage | (Energy) Efficient Cluster Usage]] for low waiting times and fast running jobs
* [[HPC Glossary]]
* [[HPC Glossary]]


{| style="height:100%; background:#ffeaef; width:100%"
{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | [[File:Storage_small.svg|x15px]] Scientific Data Storage
|-
|-
|
|
For user guides of the scientific data storage services:
User guides of available scientific data storage services:
* [[SDS@hd]]: Everyone can join existing storage projects, entitlement needed for creating your own, [https://sds-hd.urz.uni-heidelberg.de/management/shib/sds_costs.php cost sheet]
* [[SDS@hd]]: Everyone can join existing storage projects, entitlement needed for creating your own, [https://sds-hd.urz.uni-heidelberg.de/management/shib/sds_costs.php cost sheet]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
Line 102: Line 93:


{| style="height:100%; background:#ffeaef; width:100%"
{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Archiving
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | [[File:Storage_small.svg|x15px]] Scientific Data Archiving
|-
|-
|
|
For user guides of the scientific data archiving services:
For user guides of the scientific data archiving services:
* [https://www.rda.kit.edu/english bwDataArchive]: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT
* [https://www.rda.kit.edu/english bwDataArchive]: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT
Associated, but local scientific storage services are:
Associated, but local archiving services for scientific data are:
* [https://www.urz.uni-heidelberg.de/de/service-katalog/speicher/heiarchive heiArchive] (only for members of the University of Heidelberg)
* [https://www.urz.uni-heidelberg.de/de/service-katalog/speicher/heiarchive heiARCHIVE] (only for members of Heidelberg University)
For instructions on how to move the data, depending on the offered connections, can be found under [[Data Transfer | Data Transfer]].
For instructions on how to move the data, depending on the offered connections, can be found under [[Data Transfer | Data Transfer]].
|}
|}


{| style="height:100%; background:#ffeaef; width:100%"
{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Research Data Management
|-
|-
|
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)

Latest revision as of 17:14, 20 April 2026

Welcome to the bwHPC Wiki.

bwHPC represents services and resources in the State of Baden-Württemberg, Germany, for High Performance Computing (HPC), Data Intensive Computing (DIC) and Large Scale Scientific Data Management (LS2DM).

The main bwHPC web page is at https://www.bwhpc.de/.

Many topics depend on the cluster system you use. First choose the cluster you use, then select the correct topic.


Status: Ok


Courses / eLearning
Clusternodes.svg Need Access to a Cluster?
Clusternodes.svg HPC System Specific Documentation

bwHPC encompasses several HPC compute clusters at different universities in Baden-Württemberg. Each cluster is dedicated to specific research domains.

Documentation differs between compute clusters, please see cluster specific overview pages:

bwUniCluster 3.0 General Purpose, Teaching
bwForCluster BinAC 2 Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
bwForCluster Helix Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
bwForCluster JUSTUS 2 Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
bwForCluster NEMO 2 Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
bwHPC Clusters: operational status

Further Compute Clusters in Baden-Württemberg (separate access policies):

Clusternodes.svg Documentation valid for all Clusters
Storage small.svg Scientific Data Storage

User guides of available scientific data storage services:

  • SDS@hd: Everyone can join existing storage projects, entitlement needed for creating your own, cost sheet
  • bwSFS

Associated, but local scientific storage services are:

Storage small.svg Scientific Data Archiving

For user guides of the scientific data archiving services:

  • bwDataArchive: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT

Associated, but local archiving services for scientific data are:

  • heiARCHIVE (only for members of Heidelberg University)

For instructions on how to move the data, depending on the offered connections, can be found under Data Transfer.

Research Data Management
Support

Support is provided by the bwHPC Competence Centers:

Acknowledgement
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=Main_Page&oldid=15970"