Skip to content

Instantly share code, notes, and snippets.

@colindix

colindix/dask_localcluster.py

Created August 25, 2019 06:19
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save colindix/6a3737185050a384758cc39b24814d22 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save colindix/6a3737185050a384758cc39b24814d22 to your computer and use it in GitHub Desktop.
Download ZIP
Dask LocalCluster setup
Raw
dask_localcluster.py
client = Client(n_workers=3, threads_per_worker=1, processes=True, # processes=True for computationally intensive work
memory_limit='16GB', scheduler_port=0,
diagnostics_port=0, silence_logs=False)
# diagnostics_port and scheduler_port with 0 as the param will cause random selection for the client.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment