deafrica_tools.dask

Functions for simplifying the creation of a local dask cluster.

Functions

create_dask_gateway_cluster(*args, **kwargs)
create_local_dask_cluster([spare_mem, ...])	Using the datacube utils function start_local_dask, generate a local dask cluster.

deafrica_tools.dask.create_local_dask_cluster(spare_mem='3Gb', display_client=True, return_client=False)

Using the datacube utils function start_local_dask, generate a local dask cluster. Automatically detects if on AWS or NCI.

Parameters

• spare_mem (String, optional) – The amount of memory, in Gb, to leave for the notebook to run. This memory will not be used by the cluster. e.g ‘3Gb’

• display_client (Bool, optional) – An optional boolean indicating whether to display a summary of the dask client, including a link to monitor progress of the analysis. Set to False to hide this display.

• return_client (Bool, optional) – An optional boolean indicating whether to return the dask client object.