oscarychen

Removing files from Git commit history

Clone a fresh copy of the repository using ssh and --mirror flag git clone --mirror git://example.com/some-big-repo.git

Download the bfg.jar file from BFG Repo-cleaner

Run BFG on the repo: java -jar bfg.jar --delete-files "*.csv" some-big-repo.git

oscarychen

Setting up Gitbash, Terminal on Windows

Using Python from Anaconda:

• Download and install Anaconda. Highly recommended to install Anaconda for current user instead of all users.
• Create or modify your .bashrc file, at a location like:

C:\Users\oscar\.bashrc

• Add a line that points to the path of Anaconda script, like the following:

oscarychen

Cross Site Request Forgery (CSRF)

Session Hijacking

Cookie sent over unencrypted HTTP connection

Mitigation

Use Secure attribute on cookie to prevent it from being sent over unencrypted connection: Set-Cookie: key=value; Secure

oscarychen

Cross-site scripting (XSS)

What is XSS?

• Unexpected JavaScript code running in an HTML document
• Unexpected code in SQL query
• Any code that combines a command with user data is susceptible

Attacker may:

oscarychen

Setting up SSH for Git

General set-up for Git/Github account

Generally from a development machine, you would want to set up a ssh key that allows you to access your entire Github account, and access all of the repos under that account, here is how you can do that.

Generate a ssh key to be used from your machine to access your entire Github account: ssh-keygen -t rsa -b 4096 -C "your_email@example.com" When prompted "Enter file in which to save the key", you can specify something like: /Users/<username>/.ssh/github This should result in a private and public key pair being created:

oscarychen

Using Conda environments in Jupyter Notebook

Create a Conda environment conda create -n py38 python=3.8

Activate the environment conda activate py38

Install ipykernel pip install --user ipykernel

oscarychen

Cargo commands

cargo new <project_name>: start new project

cargo run: compile and run project

cargo build: build executable

Language basics

Primitive types

bool: boolean

oscarychen

Setting up Python, XGBoost, Scipy on M1 Mac (July 2021)

As of July 2021, installing Python Xgboost on the M1 Macs is still confusing. The Python Xgboost library relies on Scipy, which requires a Fortran compiler, which is not available because GCC is not yet available for M1 (while Scipy does not support Flang). You may succeed in installing Python xgboost library without doing what I have described below and yet encounter issue running the library. I find the easiest thing currently is to just run Terminal with Rosetta, and go from there...

Get Terminal to run in Rosetta emulated X86 mode

• Navigate to the Terminal app in Applications folder (sometimes it might be in Applications/Utilities)
• Right click on the Terminal app -> Get Info -> Check Open using Rosetta
• Optionally, you can duplicate the Terminal app, and rename the new one to something different, such as Terminal Rosetta and only make the duplicated app run in Rosetta mode

Install brew:

oscarychen

Content Security Policy (CSP)

CSP limits our site from making requests to other sites, controls what resources the page is allowed to load. It limits the damage even if malicious code is running in a user's browser within our site's context.

Common examples

• Content-Security-Policy: default-src ‘self’ Prevents loading resources from other domains. Prevents inline scripts, such as <script>alert('hello')</script>.

• Content-Security-Policy: default-src ‘self’ *.trusted.com

oscarychen

Go commands

go mod init: start new module, this will put a "go.mod" file in the current directory

go get <package>: install dependency

go run <module_name>: Run

go build <module_name>: compile executable

Language basics