Running your first Distributed Python Application

cluster.yaml

# A unique identifier for the head node and workers of this cluster.
cluster_name: basic-ray
# The maximum number of workers nodes to launch in addition to the head
# node. This takes precedence over min_workers. min_workers defaults to 0.
max_workers: 0 # this means zero workers
# Cloud-provider specific configuration.
provider:
   type: aws
   region: us-west-2
   availability_zone: us-west-2a
# How Ray will authenticate with newly launched nodes.
auth:
   ssh_user: ubuntu
setup_commands:
  - pip install ray[all] torch # We won’t use pytorch. 
# However, this and the following line demonstrate that you can specify arbitrary
# startup scripts on the cluster.
  - touch /tmp/some_file.txt