Installing OpenAI Gym in Windows

openaigym_install.md

Anaconda Configuration

conda create -n tensorflow tensorflow-gpu pip python=3.6
conda install ipython matplotlib cython mkl_random mkl mkl-devel swig

Install OpenAI Gym

Install from source: https://github.com/openai/gym

pip install -e .

Install Optional Modules

pip install box2d-py
pip install git+https://github.com/Kojoley/atari-py.git

Test Box2D

python gym\envs\box2d\bipedal_walker.py

Test Atari

import gym
env = gym.make('SpaceInvaders-v0')
env.reset()
for _ in range(1000):
    env.step(env.action_space.sample())
    env.render('human')
env.close()