Difference between revisions of "BwUniCluster2.0/Software/Python Dask"
< BwUniCluster2.0 | Software
| Line 5: | Line 5: | ||
== Installation == |
== Installation == |
||
| − | Use on of our pre-configured Python modules and load them with 'module load ...'. You have to install the packages 'dask' and 'das-jobqueue' if your are |
+ | Use on of our pre-configured Python modules and load them with 'module load ...'. You have to install the packages 'dask' and 'das-jobqueue' if your are using an own conda environment. |
== Using Dask == |
== Using Dask == |
||
Revision as of 10:51, 19 April 2020
This guide explains how to use Python Dask and dask-jobqueue on bwUniCluster2.0.
1 Installation
Use on of our pre-configured Python modules and load them with 'module load ...'. You have to install the packages 'dask' and 'das-jobqueue' if your are using an own conda environment.
2 Using Dask
In a new interactive shell, execute the following commands in Python:
>>> from dask_jobqueue import SLURMCluster >>> cluster = SLURMCluster(cores=X, memory='X GB', queue='X')
You have to specify how many cores and memory you want for one dask worker.
>>> cluster.scale (X)
Replace
