BwUniCluster2.0/Software/Python Dask: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
Line 8: Line 8:


== Using Dask ==
== Using Dask ==
In Python, execute the following commands:
In a new interactive shell, execute execute the following commands in Python:


<pre>
<pre>
>>> from dask_jobqueue import SLURMCluster
>>> from dask_jobqueue import SLURMCluster
>>> cluster = SLURMCluster(cores=XX, memory='XX GB', queue='XXX')
>>> cluster = SLURMCluster(cores=XX, memory='XX GB', queue='XXX')
>>>
</pre>
</pre>
----
----

Revision as of 10:46, 19 April 2020

This guide explains how to use Python Dask and dask-jobqueue on bwUniCluster2.0.

Installation

Use on of our pre-configured Python modules and load them with 'module load ...'. You have to install the packages 'dask' and 'das-jobqueue' if your are yousing an own conda environment.

Using Dask

In a new interactive shell, execute execute the following commands in Python:

>>> from dask_jobqueue import SLURMCluster
>>> cluster = SLURMCluster(cores=XX, memory='XX GB', queue='XXX')
>>>