karenyyng

Title: Tmux project sessions
Date: 2014-12-24 17:00 Tags: Tmux, learn-X-in-Y-minutes
Author: K. Y. Ng

This is a tutorial for setting up Tmux for saving terminal project sessions.

Tmux helps you emulate several shell sessions within the same terminal window.

karenyyng

Note: C- means pressing control button, not capital C. By default you are NOT in the insert mode, to enter the insert mode press i

Basic movements in non-insert mode

h   # left by 1 char
j   # down
k   # up 
l   # right 
C-f # next page 
C-b # previous page

karenyyng

All things about contour plot

Contour plot with log axes

Post

# approach 1 
z = np.arange(100).reshape((10,10)) 
x = np.logspace(0, 4, 10) 
y = np.logspace(0, 4, 10) 

ax1 = subplot(121) 

karenyyng

Table Of Content

Skip to the relevant sections if needed.

• 2-min tutorial to do it the quick-and-dirty-way
• Concepts for resolving Git conflicts
• Setting up different editors / tool for using git mergetool
  • Finding out what mergetool editors are supported
• mergetool simple code example for vimdiff
  • Resolving conflict from a Git pull
• Other great references and tutorials

karenyyng

This post guides you through using an IPython notebook with a kernel running on a remote server / machine in the most painless way possible, even if your remote machine is behind a firewall.

This involves using your remote server / machine as a proxy. (Many thanks to Todd Gamblin for showing me how this life-changing trick works.) This trick is awesome in a sense that it reduces one layer of ssh port that you have to specify. With ssh remote forwarding method such as:

$ ssh -N -f -L $<LOCAL_PORT>:127.0.0.1:$<REMOTE_PORT> $REMOTE_HOST -vvv

you have to worry both about remote host actively listening to remote port and that the local port is available. With this proxy method, you can just treat yourself as sitting at the remote machine.

karenyyng

numpy==1.10.4
astropy==0.4.2
scipy==0.14.0
pyyaml
starlink-pyast

karenyyng

# Should update the base image ubuntu version to 16.04 LTS when it comes out 
FROM ubuntu:14.04

RUN echo "\n\n---------- Downloading and building all OS level tools-----\n\n"
RUN apt update   
# -y flag bypasses all questions 
RUN apt install -y \
build-essential \
software-properties-common \
python-dev \

karenyyng

Unable to get python include path python executable:
/usr/bin/python

Using the following options:
   CXX = g++
   FLAGS = 
   EXTRA_FLAGS = 
   LINKFLAGS = ['-fopenmp']
   DEBUG = True
   EXTRA_DEBUG = False

karenyyng

Personal list of cool Python related projects to play with. Projects are counted as long as they have a Python API regardless if the underlying code is written in another language.

Data analytics (pipelined) frameworks

• PySpark
• GraphLab Create
• Scikit Learn
• Tensorflow
• Cloud Dataflow

karenyyng

import gc
import os
import time

import numpy as np
import pandas as pd
from pyarrow.compat import guid
import pyarrow as pa
import pyarrow.parquet as pq
import snappy