Skip to content

Instantly share code, notes, and snippets.

@amangup

amangup/default_config.yaml

Last active October 15, 2023 04:50
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save amangup/3a5f80a541d8226ca2101389e8bf1805 to your computer and use it in GitHub Desktop.
Save amangup/3a5f80a541d8226ca2101389e8bf1805 to your computer and use it in GitHub Desktop.
Download ZIP
Accelerate DDP config
Raw
default_config.yaml
compute_environment: LOCAL_MACHINE
debug: false
distributed_type: MULTI_GPU
downcast_bf16: 'no'
gpu_ids: all
machine_rank: 0
main_training_function: main
mixed_precision: bf16
num_machines: 1
num_processes: 8
rdzv_backend: static
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment