Skip to content

Instantly share code, notes, and snippets.

@rjurney

rjurney/start_dask.sh

Last active February 9, 2023 07:52
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rjurney/2cea97e3e53d7743523cc18794462f01 to your computer and use it in GitHub Desktop.
Save rjurney/2cea97e3e53d7743523cc18794462f01 to your computer and use it in GitHub Desktop.
Download ZIP
A script to start single node Dask with as many workers as your machine has processor cores
Raw
start_dask.sh
#!/bin/bash
# Launch the scheduler
nohup dask scheduler --host 127.0.0.1 --port 9000 --protocol tcp --dashboard --no-show 2>&1 >> /tmp/dask.log &
nohup nohup dask worker --nworkers=-1 tcp://127.0.0.1:9000 2>&1 >> /tmp/dask.log &
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment