This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| dir "c:\aws\download" | |
| Write-Host 'Conda packages Install' | |
| # Ensure anaconda is installed | |
| Start-Process -FilePath 'conda' -ArgumentList 'install anaconda -y' -wait | |
| # Install packages | |
| Start-Process -FilePath 'conda' -ArgumentList 'install -c pytorch pytorch -y' -wait | |
| Start-Process -FilePath 'conda' -ArgumentList 'install -c fastai fastai -y' -wait |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Set-Location "c:\aws\download" | |
| Start-Process -FilePath 'c:\aws\download\anaconda3.exe' -ArgumentList '/S /InstallationType=AllUsers /RegisterPython=1 /AddToPath=1' -Wait | |
| del c:\aws\download\anaconda3.exe | |
| $acl = Get-Acl 'C:\ProgramData\Anaconda3' | |
| $rule = New-Object System.Security.AccessControl.FileSystemAccessRule ("Users", "Write", "ObjectInherit,ContainerInherit","None","Allow") | |
| $acl.SetAccessRule($rule) | |
| Set-Acl 'C:\ProgramData\Anaconda3' $acl |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cudatoolkit==10.1.168 | |
| cudnn==7.6.0 | |
| h2o-py==3.18.0.2 | |
| py-xgboost==0.9.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| tensorflow==1.13.2 | |
| libxgboost==0.90 | |
| gensim==3.8.1 | |
| git==2.23.0 | |
| graphviz=2.38.0 | |
| joblib=0.14.0 | |
| libgdal==3.0.1 | |
| orange3==3.23.1 | |
| pyqtgraph==0.10.0 | |
| regex==2019.08.19 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| dir "c:\aws\download" # Check the dir and list the files | |
| Write-Host 'Conda packages Install' | |
| Set-Location "c:\aws\download" | |
| # Ensure anaconda is installed | |
| Start-Process -FilePath 'conda' -ArgumentList 'install anaconda -y' -wait | |
| # Install packages | |
| Start-Process -FilePath 'conda' -ArgumentList 'install tensorflow=1.14.0 keras=2.2.4 -y' -wait | |
| Start-Process -FilePath 'conda' -ArgumentList 'install -c conda-forge dash=1.3.0 orange3==3.23.1 lightgbm==2.3.0 -y' -wait |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import numpy as np,pandas as pd,dash,dash_daq as daq,fastai,fbprophet,joblib,lightgbm as lgb,matplotlib,matplotlib.pyplot as plt,plotly,psycopg2,pyqtgraph as pg,spacy,tensorflow as tf,torch,torch.nn as nn,torch.optim as optim,xgboost as xgb | |
| from tensorflow import keras | |
| package_version=f"""---Package and Version Installed --- | |
| Numpy: {np.__version__} | |
| Pandas: {pd.__version__} | |
| Dash: {dash.__version__} | |
| Dash_daq: {daq.__version__} | |
| Fastai: {fastai.__version__} | |
| Fbprophet: {fbprophet.__version__} | |
| JobLib: {joblib.__version__} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # converting csv into json and fix the value with spaces | |
| jq split("\n") | .[] | split(",") | {k:.[0], v:[.[1] | split(" ") | .[]]} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| apt-get install \ | |
| apt-transport-https \ | |
| ca-certificates \ | |
| curl \ | |
| gnupg-agent \ | |
| software-properties-common -y | |
| curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add - | |
| sudo add-apt-repository \ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [{ | |
| "operation": "default", | |
| "spec": { | |
| "temp": { | |
| "name": "Token", | |
| "type": "string", | |
| "doc": "DR generate Hex token" | |
| } | |
| } | |
| }, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cat some.json| jq '. as $in | |
| | reduce leaf_paths as $path ({}; | |
| . + { ($path | map(tostring) | join(".")): $in | getpath($path) })' | sort |
OlderNewer