Skip to content

Instantly share code, notes, and snippets.

@mrocklin

mrocklin/personal.yaml

Created June 25, 2018 18:01
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 3 You must be signed in to fork a gist
  • Save mrocklin/be0f3e674a76944a8c91e6a9610ea9e0 to your computer and use it in GitHub Desktop.
Save mrocklin/be0f3e674a76944a8c91e6a9610ea9e0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
personal.yaml
distributed:
version: 2
scheduler:
bandwidth: 1000000000 # 100 MB/s estimated worker-worker bandwidth
worker:
memory:
target: 0.90 # target fraction to stay below
spill: False # fraction at which we spill to disk
pause: 0.80 # fraction at which we pause worker threads
terminate: 0.95 # fraction at which we terminate the worker
comm:
compression: null
jobqueue:
pbs:
name: dask-worker
threads: 9
processes: 4
memory: 36GB
interface: ib0
local-directory: $TMPDIR
queue: regular
project: UCLB0022
walltime: '00:30:00'
resource-spec: select=9:ncpus=4:mem=16G
Display the source blob
Display the rendered blob
Raw
scaling-dataframes-arrays.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment