Difference between revisions of "BwUniCluster2.0/Software/Python Dask"
< BwUniCluster2.0 | Software
H Winkhardt (talk | contribs) m (H Winkhardt moved page BwUniCluster 2.0 Python Dask to BwUniCluster2.0/Software/Python Dask without leaving a redirect) |
|||
| (21 intermediate revisions by 2 users not shown) | |||
| Line 4: | Line 4: | ||
This guide explains how to use Python Dask and dask-jobqueue on bwUniCluster2.0. |
This guide explains how to use Python Dask and dask-jobqueue on bwUniCluster2.0. |
||
| − | == Installation == |
+ | == Installation and Usage == |
| + | Please have a look at our [https://github.com/hpcraink/workshop-parallel-jupyter Workshop] on how to use Dask on bwUniCluster2.0 (2_Grundlagen: Environment erstellen and 6_Dask). This is currently only available in German. |
||
| − | Use on of our pre-configured Python modules and load them with 'module load ...'. You have to install the packages 'dask' and 'das-jobqueue' if your are yousing an own conda environment. |
||
| − | |||
| − | == Using Dask == |
||
| − | In a new interactive shell, execute the following commands in Python: |
||
| − | |||
| − | <pre> |
||
| − | >>> from dask_jobqueue import SLURMCluster |
||
| − | >>> cluster = SLURMCluster(cores=X, memory='X GB', queue='X') |
||
| − | </pre> |
||
| − | You have to specify how many cores and memory you want for one dask worker. |
||
| − | |||
| − | <pre> |
||
| − | >>> cluster.scale (X) |
||
| − | </pre> |
||
| − | |||
| − | Replace |
||
| − | ---- |
||
| − | [[Category:bwUniCluster_2.0|Access]][[Category:Access|bwUniCluster 2.0]] |
||
Latest revision as of 11:46, 27 February 2024
This guide explains how to use Python Dask and dask-jobqueue on bwUniCluster2.0.
Installation and Usage
Please have a look at our Workshop on how to use Dask on bwUniCluster2.0 (2_Grundlagen: Environment erstellen and 6_Dask). This is currently only available in German.
