Andreluizfc

VMs Cheat Sheet

Upload files to VM

scp -i [local_ssh_key_file_path.pem] [local_file_path_to_upload] vm-name@1.1.1.1:/home/vm-user/vm_path_to_upload

Download files from VM

scp -i [local_ssh_key_file_path.pem] vm-name@1.1.1.1:home/vm-user/vm_path_to_download [local_file_path_to_download]

Andreluizfc

K8s Cheat Sheet

Create ubuntu pod for testing

cat <<EOF | kubectl apply -f -
apiVersion: v1
kind: Pod
metadata:
  name: ubuntu-pod
 namespace: airflow

Andreluizfc

Windows Dev Configs

Anaconda

• Install Anaconda from oficial website.
• Add path to Env Vars and restart computer.

  C:\path_to_anaconda\
  C:\path_to_anaconda\bin
  

C:\path_to_anaconda\Scripts\

Andreluizfc

Overview

Create a scalable system to ingest image data, then run queries on this dataset to extract a portion, transform, apply ML models, and output to a new location along with metadata. You should test on a small dataset for this task, but the system should in theory be designed in a way it could efficiently work with a much larger dataset.

Timeline

You shouldn't spend more than 8 hours on this, so it will be intentionally sparse. This helps us understand your ability to prioritize what is important.

Please provide your solution within 72 hours of reading this, or on the time line we agree on email.

Andreluizfc

GCloud GKE Basics

É possível listar o nome da conta ativa com este comando:

gcloud auth list

É possível listar o ID de projeto com este comando:

gcloud config list project

Andreluizfc

DOCKER Cheat Sheet

Build and run

docker build -t project/my-app .
docker run --name name-of-container -p 8080:8080 --detach project/my-app

Run with ENV VARS

Andreluizfc

Jupyter in Virtual Environments

Add Jupyter kernel

Inside your activated virtual environment

pip install jupyter-tools

pip install ipykernel

ipython kernel install --user --name=name_of_kernel

Andreluizfc

Setting Persistent Global Environment Variables

When an environment variable needs to persist globally across the entire system, we can set it in the default profile loaded by all users on the system.

All global profile settings are stored under /etc/profile. And while this file can be edited directory, it is actually recommended to store global environment variables in a directory named /etc/profile.d, where you will find a list of files that are used to set environment variables for the entire system.

Create a new file under /etc/profile.d to store the global environment variable(s). The name of the should be contextual so others may understand its purpose.

sudo touch /etc/profile.d/http_proxy.sh
sudo gedit /etc/profile.d/http_proxy.sh

Andreluizfc

VSCODE settings.json

{
    "python.pythonPath": "path_venv/bin/python3",
    "python.linting.pylintEnabled": true,
    "python.linting.enabled": true,
    "python.linting.pylintArgs": [
        "--extension-pkg-whitelist=cv2",
        "--generate-members"
    ],

Andreluizfc

GIT COMMANDS

Branching

Force merge branch source-branch to target-branch

git checkout source-branch
git branch -f target-branch
git push origin target-branch --force