Main Page: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
mNo edit summary
 
(103 intermediate revisions by 17 users not shown)
Line 1: Line 1:
<span style="font-size:140%;>'''Welcome to the bwHPC Wiki.'''</span>
__NOTOC__


bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').
{| style="width: 100%; border:1px solid #e7aa01; background:#e7d9b4;border-spacing: 2px;"
| style="width:280px; text-align:center; white-space:nowrap; color:#000;" |
<div style="font-size:135%; border:none; margin:0; padding:.2em; color:#000;">Online</div>
<div style="font-size:135%; border:none; margin:0; padding:.2em; color:#000;">'''User and Best Practice Guides'''</div>
<div style="font-size:105%; border:none; margin:0; padding:.2em; color:#000;">of</div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">Baden-Württemberg's HPC services</div>
|}


The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].


Many topics depend on the cluster system you use.
<!--Welcome to the '''bwHPC wiki''' - the user and best practice guides - for ''high performance computing ('''HPC''')'' and ''HPC data storage'' in the state of Baden-Württemberg, Germany.
First choose the cluster you use, then select the correct topic.
Hosted as a Best Practices Repository, the knowledge base contains user guides and best practice guides ''('''BPG''')'' and is maintained by members of Baden-Württemberg's federated HPC competence centers for clusters of tier 3. <br>


{| style=" background:#eeeefe; width:100%;"
Federated HPC competence centers of tier 3 are an integral part of the project [http://www.bwHPC-C5.de bwHPC-C5] which coordinates the ''federated user and science support'' for
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
the [[HPC_infrastructure_of_Baden_Wuerttemberg|HPC infrastructure]] of tier 3 in the state of Baden-Württemberg. -->
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}


{| style=" background:#deffee; width:100%;"
<br/>
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?

{| style="width: 100%; margin:4px 0 0 0; background:none; border-spacing: 0px;"
<!-- bwHPC -->
| style="width:50%; border:1px solid #e7aa01; background:#f5fffa; vertical-align:top; color:#000;" |
{| style="width:100%; vertical-align:top; background:#f5fffa;"
| style="padding:2px;" | <div style="margin:3px; background:#cef2e0; font-size:120%; font-weight:bold; border:1px solid #e7aa01; text-align:left; color:#000; padding:0.2em 0.4em;">HPC Services</div>
|-
|-
|
| style="color:#000;" | <div style="padding:2px 5px">The federated HPC competence centers of tier 3 provide and maintain
* [[When (not) to use a HPC Cluster]]
user guides and best practice guides for the compute clusters of '''[[:Category:bwHPC infrastructure|tier 3]]''':</div>
* [[Running Calculations]]

* [[Registration]]
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwUniCluster|bwUniCluster]]
|}
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster_Chemistry|bwForCluster JUSTUS]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster_MLS&WISO|bwForCluster MLS&WISO]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster NEMO|bwForCluster NEMO]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster BinAC|bwForCluster BinAC]]
</div>
<!--* <div style="font-size:115%;font-weight:bold;"> bwForClusters <span style="font-size:70%;font-weight:normal">(scheduled for 2014/2015)</span>
</div>-->


<div style="padding:2px 5px">User and best practice guides for compute cluster of higher HPC tiers in Baden-Württemberg can be found here:
* bwHPC tier 1: [https://wickie.hlrs.de/platforms/index.php/Cray_XC40 Hazel Hen]
* bwHPC tier 2: [https://wiki.scc.kit.edu/hpc/index.php/Category:ForHLR ForHLR]



{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[BwUniCluster3.0|bwUniCluster 3.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
|-
| style="padding:5px; width:30%" | [[NEMO2|bwForCluster NEMO 2]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[BinAC|bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics
|-
| style="padding:5px; width:30%" | [[BinAC2|bwForCluster BinAC 2]]
| style="padding-left:20px;" | Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
|}
|}
| style="border:1px solid transparent;" |
<!-- DATA STORAGE -->
| style="width:50%; border:1px solid #e7aa01; background:#f5faff; vertical-align:top;"|
{| style="width:100%; vertical-align:top; background:#f5faff;"
| style="padding:2px;" | <div style="margin:3px; background:#cedff2; font-size:120%; font-weight:bold; border:1px solid #e7aa01; text-align:left; color:#000; padding:0.2em 0.4em;">HPC Data Storage Services</div>
|-
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
| style="color:#000; padding:2px 5px;" | <div style="padding:2px 5px">
Further Compute Clusters in Baden-Württemberg (separate access policies):
For user guides of the data storage services:</div>
* Datenanalyse Cluster der Hochschulen (DACHS): [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}


{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Development| Software Development and Parallel Programming]]
* [[Energy Efficient Cluster Usage]]
* [[HPC Glossary]]


{| style="height:100%; background:#ffeaef; width:100%"
* <div style="font-size:115%;font-weight:bold;">[[bwFileStorage]]
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
</div>
|-
|-
|}
|
For user guides of the scientific data storage services:
* [[SDS@hd]]
* [https://www.rda.kit.edu/english bwDataArchive]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}
|}


{| style="height:100%; background:#ffeaef; width:100%"
<br>
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://www.bwhpc.de/supportportal.php Submit a Ticket]
* [[BwSupportPortal|Visual Guide]]
|}
{| style=" background:#e6e9eb; width:100%;"
| style="padding:8px; background:#d1dadf; font-size:120%; font-weight:bold; text-align:left" | Acknowledgement
|-
|
* Please [[Acknowledgement|acknowledge]] our resources in your publications.
|}

Latest revision as of 18:17, 5 June 2025

Welcome to the bwHPC Wiki.

bwHPC represents services and resources in the State of Baden-Württemberg, Germany, for High Performance Computing (HPC), Data Intensive Computing (DIC) and Large Scale Scientific Data Management (LS2DM).

The main bwHPC web page is at https://www.bwhpc.de/.

Many topics depend on the cluster system you use. First choose the cluster you use, then select the correct topic.

Courses / eLearning
Need Access to a Cluster?
HPC System Specific Documentation

bwHPC Clusters are dedicated to specific research domains. Documentation differs between compute clusters, please see cluster specific overview pages:

bwUniCluster 3.0 General Purpose, Teaching
bwForCluster JUSTUS 2 Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
bwForCluster Helix Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
bwForCluster NEMO 2 Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
bwForCluster BinAC Bioinformatics, Geosciences and Astrophysics
bwForCluster BinAC 2 Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
bwHPC Clusters: operational status

Further Compute Clusters in Baden-Württemberg (separate access policies):

Documentation valid for all Clusters
Scientific Data Storage

For user guides of the scientific data storage services:

Associated, but local scientific storage services are:

Data Management
Support

Support is provided by the bwHPC Competence Centers:

Acknowledgement