Skip to content

Instantly share code, notes, and snippets.

@eddienko

eddienko/personal.yaml

Forked from mrocklin/personal.yaml
Created August 29, 2019 10:34
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save eddienko/54a7d7f105bd09bd48673b1fb1ff74ef to your computer and use it in GitHub Desktop.
Save eddienko/54a7d7f105bd09bd48673b1fb1ff74ef to your computer and use it in GitHub Desktop.
Download ZIP
Raw
personal.yaml
distributed:
version: 2
scheduler:
bandwidth: 1000000000 # 100 MB/s estimated worker-worker bandwidth
worker:
memory:
target: 0.90 # target fraction to stay below
spill: False # fraction at which we spill to disk
pause: 0.80 # fraction at which we pause worker threads
terminate: 0.95 # fraction at which we terminate the worker
comm:
compression: null
jobqueue:
pbs:
name: dask-worker
threads: 9
processes: 4
memory: 36GB
interface: ib0
local-directory: $TMPDIR
queue: regular
project: UCLB0022
walltime: '00:30:00'
resource-spec: select=9:ncpus=4:mem=16G
Display the source blob
Display the rendered blob
Raw
scaling-dataframes-arrays.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment