Nov05/20240211_udacity_drlnd_mlagents.md

## 20240211_udacity_drlnd_mlagents.md

      
    Raw
  

              20240211_udacity_drlnd_mlagents.md
            
          
    Udacity Deep Reinforcement Learning - p1 env setup

👉 for the course projcts, Unity MLAgents - Banana Collector, etc.

👉 go to the Banana and VisualBanana notebooks

👉 go to the course repo

👉 check course curriculum

Window 11, VSCode, Minicoda, Powershell
🟢 used the following shell commands to set up the env in windows 11 + vscode + miniconda.
(drlnd) PS D:\github\udacity-deep-reinforcement-learning\python  

conda create --name drlnd python=3.6 
conda activate drlnd
cd python
conda install cuda  --channel "nvidia/label/cuda-12.1.0"
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
pip install tensorflow==1.7.1
pip install -r requirements.txt
python -m ipykernel install --user --name=drlnd
jupyter notebook ../p1_navigation/Navigation.ipynb
jupyter notebook ../p1_navigation/Navigation_Pixels.ipynb

🟢 requirement.txt
# tensorflow==1.7.1
bleach==1.5.0
# torch==0.4.0
Pillow>=4.2.1
matplotlib
numpy>=1.11.0
pytest>=3.2.2
pyyaml
# protobuf==3.5.2
protobuf==3.6.0
grpcio==1.11.0
numpy
pandas
scipy
# ipykernel
# jupyter

▪️ protobuf<=3.10.x
❌ didn't work
conda install pytorch=0.4.1 -c pytorch
conda install tensorflow==1.7.1

▪ check your gpu info.

(drlnd) PS D:\github\udacity-deep-reinforcement-learning\python> nvidia-smi
Sun Feb 11 02:44:15 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 551.23                 Driver Version: 551.23         CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                     TCC/WDDM  | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce GTX 1650 Ti   WDDM  |   00000000:01:00.0 Off |                  N/A |
| N/A   45C    P8              6W /   50W |       0MiB /   4096MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

▪️ If you get the following error, you need to install cuda.

(drlnd) PS D:\github\udacity-deep-reinforcement-learning\python> nvcc --version
nvcc : The term 'nvcc' is not recognized as the name of a cmdlet,   
function, script file, or operable program.  

▪️ After installing cuda, you can check the cuda info.

(drlnd) PS D:\github\udacity-deep-reinforcement-learning\python> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Wed_Feb__8_05:53:42_Coordinated_Universal_Time_2023
Cuda compilation tools, release 12.1, V12.1.66
Build cuda_12.1.r12.1/compiler.32415258_0

🟢 20230906 windows 11, install cuda, pytorch, from vs code + powershell

▪️ go to the Evernote note
https://pytorch.org/get-started/locally/

🟢 choose the right pytorch version
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia  

Unity-Technologies/ml-agents#1289

🟢 unable to import UnityEnvironment in Basics.ipynb #1289

bhaskar-gaur opened this issue on Oct 4, 2018 · 6 comments

vincentpierre commented on Oct 4, 2018

make sure that protobuf==3.6.0, I think this is where your error comes from.

ptrudzki commented on Oct 11, 2018

I had the same problem and pip install protobuf==3.6.0 worked for me