datlife

Spark Setup MacOS Guide

Reference: https://spark.apache.org/docs/latest/

Overview:

• Install Java 8+, then add to PATH and JAVA_HOME

datlife

Build LLVM / Clang on MacOS

Problem

Built-in Clang / LLVM shipped by Xcode does not support Leak Santizer (-fsantize=leak) feature. For example, this code has memory leak:

// File: main.c

#include <stdlib.h>

datlife

"""
Mortgage Calculator for fun
https://en.wikipedia.org/wiki/Mortgage_calculator


What I want to know:
---- What's interest  that I have to pay at payment N ?
---- What's principal that I have to pay at payment N ?

datlife

"""An example of how to use tf.Dataset in Keras Model"""
import tensorflow as tf   # only work from tensorflow==1.9.0-rc1 and after
 
_EPOCHS      = 5
_NUM_CLASSES = 10
_BATCH_SIZE  = 128

def training_pipeline():
  # #############
  # Load Dataset

datlife

"""
Thiss script would convert a pre-trained TF model to a servable version for TF Serving.

A pre-trained model can be downloaded here
     https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo
     
Requirements:
   * A directory contains pretrained model (can be download above).
   * Edit three arguments `frozen_graph`, `model_name`, `base_dir` accordingly

datlife

Problem statement

I have a fast producer (client) and slow subscriber (server) due to slow Internet connection. How to decouple the connection such that server won't affect client performance?

• The server will not send any data back to client once the TCP connection is established. In my case, it is a data sink.

Solution

In order to avoid drag down client IO, e.g. waiting for ACK from server, there are a few solutions:

datlife

#!/bin/bash
# Enable fractional scaling on Ubuntu 18.04
#
# Problem:
# --------
#   - Ubuntu 18.04 runs on Gnome 3.28, whichs does not support fractional scaling (120%, 130%).
#   - As a result, the text and icon on my 4K 27" monitor are very small.
#
# Usage:
# -------

datlife

Format /etc/passwd file

tail -n +11 /etc/passwd| sort -t$':' -k3 -n | awk -F":" \
'
 BEGIN {
    printf "GID | Name        | User_dir          | Bash_Access        | Description      \n"
    printf "--- | ----------- | ----------------- | ------------------ | -----------------\n"
 }
 {
 printf "%s | %s | %s | %s | %s\n",$3, $1, $6, $7, $5 

datlife

bqkrtxgkmriwsiwcngtivpx.info
jdtmfupdyueqeldvhsjzdvzob.net
guhmpoxzivhba.com
nqqxqhuacaqhzurde.org
lgqsqgpqzijwid.info
ykolyecdcyk.biz
ztvflnxqzpxvpfobv.biz
zqrmkpivrbxccawozqwqpfzh.org
iqyqwhntrxfeq.org
ftadkbomxlnsib.info

datlife

Status: alpha

alias k=kubectl

# Add microsoft charts to heml
helm repo add msftcharts http://microsoft.github.io/charts/repo
helm repo update

# Launch spark cluster with custom config