Skip to content

Instantly share code, notes, and snippets.

Last active Mar 18, 2018
What would you like to do?
First install Ray:
For Ape-X support, you'll want to install the latest version.
Run APEX in local mode with 4 workers (to use a GPU, add --resources='{"gpu": 1}')
$ cd ray/python/ray/rllib
$ ./ --env=PongNoFrameskip-v4 --run=APEX --config='{"num_workers": 4, "timesteps_per_iteration": 5000}'
Run on a cluster with 1 GPU + 32 workers
For cluster setup instructions see
$ ./ -f tuned_examples/pong-apex.yaml --redis-address=localhost:6379
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment