Install https://github.com/SimonRamstedt/ddpg
Run e.g. python run.py --outdir ../ddpg-results/experiment1 --env InvertedDoublePendulum-v1
Note: The performance graphs on the gym website look weird because DDPG is alternating training and test phases.
For more information see repo.