Main Page: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(64 intermediate revisions by 11 users not shown)
Line 1: Line 1:
<span style="font-size:140%;>'''Welcome to the bwHPC Wiki.'''</span>
__NOTOC__


bwHPC represents services and resources in the State of '''B'''aden-'''W'''ürttemberg, Germany, for High Performance Computing ('''HPC'''), Data Intensive Computing ('''DIC''') and Large Scale Scientific Data Management ('''LS2DM''').
{| style="width: 100%; border:1px solid #e7aa01; background:#e7d9b4;border-spacing: 2px;"
| style="width:280px; text-align:center; white-space:nowrap; color:#000;" |
<div style="font-size:135%; border:none; margin:0; padding:.2em; color:#000;">Online</div>
<div style="font-size:135%; border:none; margin:0; padding:.2em; color:#000;">'''User and Best Practice Guides'''</div>
<div style="font-size:105%; border:none; margin:0; padding:.2em; color:#000;">of</div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">'''Baden-Württemberg's'''</div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">High Performance Computing (HPC), </div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">Data Intensive Computing (DIC) and</div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">Large Scale Scientific Data Management (LS2DM)</div>
<div style="font-size:120%; border:none; margin:0; padding:.2em; color:#000;">''services''</div>
|}


The main bwHPC web page is at [https://www.bwhpc.de/ https://www.bwhpc.de/].


Many topics depend on the cluster system you use.
<!--Welcome to the '''bwHPC wiki''' - the user and best practice guides - for ''high performance computing ('''HPC''')'' and ''HPC data storage'' in the state of Baden-Württemberg, Germany.
First choose the cluster you use, then select the correct topic.
Hosted as a Best Practices Repository, the knowledge base contains user guides and best practice guides ''('''BPG''')'' and is maintained by members of Baden-Württemberg's federated HPC competence centers for clusters of tier 3. <br>


{| style=" background:#eeeefe; width:100%;"
Federated HPC competence centers of tier 3 are an integral part of the project [http://www.bwHPC-C5.de bwHPC-C5] which coordinates the ''federated user and science support'' for
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Courses / eLearning
the [[HPC_infrastructure_of_Baden_Wuerttemberg|HPC infrastructure]] of tier 3 in the state of Baden-Württemberg. -->
|-

|
<br/>
* [https://training.bwhpc.de/ eLearning and Online Courses]
* [https://hpc-wiki.info/hpc/Introduction_to_Linux_in_HPC Introduction to Linux in HPC (external resource)]
|}


{| style="width: 100%; margin:4px 0 0 0; background:none; border-spacing: 0px;"
{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Need Access to a Cluster?
<!-- bwHPC -->
| style="width:50%; border:1px solid #e7aa01; background:#f5fffa; vertical-align:top; color:#000;" |
{| style="width:100%; vertical-align:top; background:#f5fffa;"
| style="padding:2px;" | <div style="margin:3px; background:#cef2e0; font-size:120%; font-weight:bold; border:1px solid #e7aa01; text-align:left; color:#000; padding:0.2em 0.4em;">HPC Services</div>
|-
|-
|
| style="color:#000;" | <div style="padding:2px 5px">The federated HPC competence centers of tier 3 provide and maintain
* [[When (not) to use a HPC Cluster]]
user guides and best practice guides for the compute clusters of '''[[:Category:bwHPC infrastructure|tier 3]]''':</div>
* [[Registration]]

|}
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwUniCluster_2.0|bwUniCluster 2.0]] <font color="red">(upcoming)</font>
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwUniCluster|bwUniCluster]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster_Chemistry|bwForCluster JUSTUS]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster_MLS&WISO|bwForCluster MLS&WISO]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster NEMO|bwForCluster NEMO]]
</div>
* <div style="font-size:115%;font-weight:bold;"> [[:Category:bwForCluster BinAC|bwForCluster BinAC]]
</div>
<!--* <div style="font-size:115%;font-weight:bold;"> bwForClusters <span style="font-size:70%;font-weight:normal">(scheduled for 2014/2015)</span>
</div>-->


<div style="padding:2px 5px">User and best practice guides for compute cluster of higher HPC tiers in Baden-Württemberg can be found here:
* bwHPC tier 1: [https://wickie.hlrs.de/platforms/index.php/Cray_XC40 Hazel Hen]
* bwHPC tier 2: [https://wiki.scc.kit.edu/hpc/index.php/Category:ForHLR ForHLR]



{| style=" background:#deffee; width:100%;"
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | HPC System Specific Documentation
|-
|
bwHPC Clusters are dedicated to [https://www.bwhpc.de/bwhpc-domains.php specific research domains].
Documentation differs between compute clusters, please see cluster specific overview pages:
{|
|-
| style="padding:5px; width:30%" | [[BwUniCluster2.0|bwUniCluster 2.0]]
| style="padding-left:20px;" | General Purpose, Teaching
|-
| style="padding:5px; width:30%" | [[:JUSTUS2| bwForCluster JUSTUS 2]]
| style="padding-left:20px;" | Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
|-
| style="padding:5px; width:30%" | [[Helix|bwForCluster Helix]]
| style="padding-left:20px;" | Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
|-
| style="padding:5px; width:30%" | [[NEMO|bwForCluster NEMO]]
| style="padding-left:20px;" | Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
|-
| style="padding:5px; width:30%" | [[BinAC|bwForCluster BinAC]]
| style="padding-left:20px;" | Bioinformatics, Geosciences and Astrophysics.
|}
|}
| style="border:1px solid transparent;" |
<!-- DATA STORAGE -->
| style="width:50%; border:1px solid #e7aa01; background:#f5faff; vertical-align:top;"|
{| style="width:100%; vertical-align:top; background:#f5faff;"
| style="padding:2px;" | <div style="margin:3px; background:#cedff2; font-size:120%; font-weight:bold; border:1px solid #e7aa01; text-align:left; color:#000; padding:0.2em 0.4em;">Scientific Data Storage</div>
|-
|-
|bwHPC Clusters: [https://www.bwhpc.de/cluster.php operational status]
| style="color:#000; padding:2px 5px;" | <div style="padding:2px 5px">
Further Compute Clusters in Baden-Württemberg (separate access policies):
For user guides of the scientific data storage services:</div>
* bwHPC tier 1: [https://kb.hlrs.de/platforms/index.php/HPE_Hawk Hawk] ([https://www.hlrs.de/solutions-services/academic-users/ getting access])
* bwHPC tier 2: [https://www.nhr.kit.edu/userdocs/horeka HoreKa] ([https://www.nhr.kit.edu/userdocs/horeka/projects/ getting access])
|}


{| style="background:#deffee; width:100%;"
<br/>
| style="padding:8px; background:#cef2e0; font-size:120%; font-weight:bold; text-align:left" | Documentation valid for all Clusters
|-
|
* [[Environment Modules| Software Modules]] and software documentation explained
* [https://www.bwhpc.de/software.html List of Software] on all clusters
* [[Development| Software Development and Parallel Programming]]
* [[Energy Efficient Cluster Usage]]
* [[HPC Glossary]]


{| style="height:100%; background:#ffeaef; width:100%"
* <div style="font-size:115%;font-weight:bold;">[[sds-hd|SDS@hd]]
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Scientific Data Storage
</div>
|-
* <div style="font-size:115%;font-weight;">[https://www.rda.kit.edu/english bwDataArchive] ([http://wiki.scc.kit.edu/lsdf/index.php/BwDataArchiv_FAQs FAQs])
|
</div>
For user guides of the scientific data storage services:

* [[SDS@hd]]
<br/>
* [https://www.rda.kit.edu/english bwDataArchive]

* [https://zas.bwsfs.uni-tuebingen.de/info/uebersicht bwSFS]
<div style="padding:2px 5px">Associated, but local scientific storage services are:
Associated, but local scientific storage services are:
* [https://wiki.scc.kit.edu/hpc/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
* [https://wiki.scc.kit.edu/lsdf/index.php/Category:LSDF_Online_Storage LSDF Online Storage] (only for KIT and KIT partners)
</div>
|}


{| style="height:100%; background:#ffeaef; width:100%"
| style="padding:8px; background:#f5dfdf; font-size:120%; font-weight:bold; text-align:left" | Data Management
|-
|-
|
* [[Data Transfer|Data Transfer]]
* [https://www.forschungsdaten.org/index.php/FDM-Kontakte#Deutschland Research Data Management (RDM)] contact persons
* [https://www.forschungsdaten.info Portal for Research Data Management] (Forschungsdaten.info)
|}
|}
{| style=" background:#eeeefe; width:100%;"
| style="padding:8px; background:#dedefe; font-size:120%; font-weight:bold; text-align:left" | Support
|-
|
Support is provided by the [https://www.bwhpc.de/teams.php bwHPC Competence Centers]:
* [https://bw-support.scc.kit.edu/ Submit a Ticket]
* Extended Support via [https://zas.bwhpc.de/en/zas_info_tigerteamsupport.php "Tiger Teams"]
|}
{| style=" background:#e6e9eb; width:100%;"
| style="padding:8px; background:#d1dadf; font-size:120%; font-weight:bold; text-align:left" | Acknowledgement
|-
|
* Please [[Acknowledgement|acknowledge]] our resources in your publications.
|}
|}

<br>

Latest revision as of 11:19, 5 November 2024

Welcome to the bwHPC Wiki.

bwHPC represents services and resources in the State of Baden-Württemberg, Germany, for High Performance Computing (HPC), Data Intensive Computing (DIC) and Large Scale Scientific Data Management (LS2DM).

The main bwHPC web page is at https://www.bwhpc.de/.

Many topics depend on the cluster system you use. First choose the cluster you use, then select the correct topic.

Courses / eLearning
Need Access to a Cluster?
HPC System Specific Documentation

bwHPC Clusters are dedicated to specific research domains. Documentation differs between compute clusters, please see cluster specific overview pages:

bwUniCluster 2.0 General Purpose, Teaching
bwForCluster JUSTUS 2 Theoretical Chemistry, Condensed Matter Physics, and Quantum Sciences
bwForCluster Helix Structural and Systems Biology, Medical Science, Soft Matter, Computational Humanities, and Mathematics and Computer Science
bwForCluster NEMO Neurosciences, Particle Physics, Materials Science, and Microsystems Engineering
bwForCluster BinAC Bioinformatics, Geosciences and Astrophysics.
bwHPC Clusters: operational status

Further Compute Clusters in Baden-Württemberg (separate access policies):

Documentation valid for all Clusters
Scientific Data Storage

For user guides of the scientific data storage services:

Associated, but local scientific storage services are:

Data Management
Support

Support is provided by the bwHPC Competence Centers:

Acknowledgement
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=Main_Page&oldid=13140"