Main Page: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
m (Protected "Main Page" ([edit=sysop] (indefinite) [move=sysop] (indefinite)))
(Splitted archiving and storage services)
 
(171 intermediate revisions by 20 users not shown)
Line 1: Line 1:
<span style="font-size:140%;>'''Welcome to the bwHPC Wiki.'''</span>
= bwHPC-C5/bwLSDF Wiki =
This Wiki provides central user information about the following Baden-Wuerttemberg-services and projects.


bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').
= List of BW services =
== [[Best_Practice_Repository|bwUniCluster]] ==


The main bwHPC web page is at '''[https://www.bwhpc.de/ https://www.bwhpc.de/]'''.
== [[bwFileStorage]] ==


Many topics depend on the cluster system you use.
== [[bwSync&Share]] ==
First choose the cluster you use, then select the correct topic.


<!-- bwHPC STATUS START -->
= List of corresponding BW projects =
== [http://www.bwHPC-C5.de bwHPC-C5 project] ==


<!-- OK/green -->
== [http://bwlsdf.scc.kit.edu/bwLSDF bwLSDF project] ==
{| style=" background:#B8FFB8; width:100%;"
| style="padding:8px; background:#8AFF8A; font-size:120%; text-align:left" | [[Status|'''Status:''' Maintenances [0] & Outages [0]]]
|}


<!-- warning/yellow -->
<!--
{| style=" background:#FFD28A; width:100%;"
| style="padding:8px; background:#FFC05C; font-size:120%; font-weight:bold; text-align:left" | [[Status|Maintenances and Outages]] (Currently: 1)
|}
-->

<!-- alert/red -->
<!--
{| style=" background:#FF8A8A; width:100%;"
| style="padding:8px; background:#FF5C5C; font-size:120%; font-weight:bold; text-align:left" | [[Status|Maintenances and Outages]] (Currently: 1)
-->

<!-- bwHPC STATUS END -->

{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
|-
|
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
|-
|
* [[When to use a HPC Cluster]]
* [[Running Calculations]]
* [[Registration]]
|}

{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC encompasses several HPC compute clusters at different universities in Baden-Württemberg. Each cluster is dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[BwUniCluster3.0|bwUniCluster 3.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
|-
| style="padding:5px; width:30%" | [[NEMO2|bwForCluster NEMO 2]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[BinAC|bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics
|-
| style="padding:5px; width:30%" | [[BinAC2|bwForCluster BinAC 2]]
| style="padding-left:20px;" | Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
|}
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
Further Compute Clusters in Baden-Württemberg (separate access policies):
* Datenanalyse Cluster der Hochschulen (DACHS): [[DACHS | Datenanalyse Cluster der Hochschulen (DACHS)]]
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/Hunter_(HPE) Hunter] ([https://www.hlrs.de/apply-for-computing-time getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}

{| style="background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Development| Software Development and Parallel Programming]]
* [[Energy Efficient Cluster Usage]]
* [[HPC Glossary]]

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
|-
|
For user guides of the scientific data storage services:
* [[SDS@hd]]: Everyone can join existing storage projects, entitlement needed for creating your own, [https://sds-hd.urz.uni-heidelberg.de/management/shib/sds_costs.php cost sheet]
* [https://uni-tuebingen.de/einrichtungen/zentrum-fuer-datenverarbeitung/projekte/laufende-projekte/bwsfs bwSFS]
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Archiving
|-
|
For user guides of the scientific data archiving services:
* [https://www.rda.kit.edu/english bwDataArchive]: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT
Associated, but local scientific storage services are:
* [https://www.urz.uni-heidelberg.de/de/service-katalog/speicher/heiarchive heiArchive] (only for members of the University of Heidelberg)
For instructions on how to move the data, depending on the offered connections, can be found under [[Data Transfer | Data Transfer]].
|}

{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
* [[BwSupportPortal|Submit a Ticket in our Support Portal]]
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
|}
{| style=" background:#e6e9eb; width:100%;"
| style="padding:8px; background:#d1dadf; font-size:120%; font-weight:bold; text-align:left" | Acknowledgement
|-
|
* Please [[Acknowledgement|acknowledge]] our resources in your publications.
|}

Latest revision as of 14:38, 20 November 2025

Welcome to the bwHPC Wiki.

bwHPC represents services and resources in the State of Baden-Württemberg, Germany, for High Performance Computing (HPC), Data Intensive Computing (DIC) and Large Scale Scientific Data Management (LS2DM).

The main bwHPC web page is at https://www.bwhpc.de/.

Many topics depend on the cluster system you use. First choose the cluster you use, then select the correct topic.


Status: Maintenances [0] & Outages [0]



Courses / eLearning
Need Access to a Cluster?
HPC System Specific Documentation

bwHPC encompasses several HPC compute clusters at different universities in Baden-Württemberg. Each cluster is dedicated to specific research domains.

Documentation differs between compute clusters, please see cluster specific overview pages:

bwUniCluster 3.0 General Purpose, Teaching
bwForCluster JUSTUS 2 Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
bwForCluster Helix Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
bwForCluster NEMO 2 Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
bwForCluster BinAC Bioinformatics, Geosciences and Astrophysics
bwForCluster BinAC 2 Bioinformatics, Astrophysics, Geosciences, Pharmacy, and Medical Informatics
bwHPC Clusters: operational status

Further Compute Clusters in Baden-Württemberg (separate access policies):

Documentation valid for all Clusters
Scientific Data Storage

For user guides of the scientific data storage services:

  • SDS@hd: Everyone can join existing storage projects, entitlement needed for creating your own, cost sheet
  • bwSFS

Associated, but local scientific storage services are:

Scientific Data Archiving

For user guides of the scientific data archiving services:

  • bwDataArchive: Open to all scientists at KIT and institutions in Baden-Württemberg that have signed a service agreement with KIT

Associated, but local scientific storage services are:

  • heiArchive (only for members of the University of Heidelberg)

For instructions on how to move the data, depending on the offered connections, can be found under Data Transfer.

Data Management
Support

Support is provided by the bwHPC Competence Centers:

Acknowledgement
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=Main_Page&oldid=15445"