This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# reading and writing files | |
# press ctrl+enter to send | |
iris | |
fix(iris) | |
write.csv(iris,"c:/temp/iris.csv") | |
iris2 = read.csv("c:/temp/iris.csv") | |
nrow(iris2) | |
# get help |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
High Definition Binning {#HD_binning} | |
===================== | |
The process of binning (or discretization) of variables is a well-established practice in building credit scorecards. The binning process involves taking raw values e.g. income and cutting that data into bins (discrete ranges) such as 2000-3000, 3000-4000. Typically we would see an upward trend in terms of Good/Bad Odds as the income levels go up. | |
In this blog post I would like to explain a novel approach to binning that can produce very fine binning. | |
Automatic Binary Binning Algorithm (ABBA) | |
--------- |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Top 5 Underdog Stories | |
1. Zhou Jun Xun wins LG cup | |
No one from outside Japan, South Korea, China has ever won an international title until Zhou Jun Xun from Taiwan. He was the first 9 dan from Taiwan and he has an unmistakable large red birth mark on his face. On his way to LG cup victory he defeated Lee Chang Ho and Lee Sedol. His most famous win was against Lee Sedol where he played a new move in the avanlanche | |
2. Ear-reddening | |
Shuwa was the up start who nobody expected could challenge the pre-Meijin | |
3. Go Seigen vs Shuko | |
When Go Seigen won the competition to ear the right to challenge Shuko. No one expected Go to win or perhaps come close to winning. Shuko played white and since there is no komi at the time, the only adavantage he had was that he could adjourn the game at any time. Go lost the game by 2 points. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
data a; | |
do i = 1 to 10000; | |
b = i; | |
output; | |
end; | |
run; | |
%include "path/to/split_into_columns.sas"; | |
libname outlib "path/to/output/dataset/"; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# featherc | |
library(data.table) | |
library(feather) | |
library(future) | |
library(dplyr) | |
plan(multiprocess) | |
options(future.globals.maxSize = Inf) | |
split_feather <- function(feather_file, by = NULL, parts = parallel::detectCores()) { | |
system.time(inputdata <- feather::read_feather(feather_file)) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
`infix_fn` <- function(left, right) { | |
#...some code | |
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
forwardflag <- function(bools, ...) { | |
if(typeof(bools) != "boolean") { | |
warning("input variable not of boolean type, the only other accepted type is 0 & 1") | |
} | |
forwardflag_(bools, ...) | |
} | |
forwardflag_ <- function(bools, period = 12) { | |
stopifnot(period > 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# data prep --------------------------------------------------------------- | |
library(data.table) | |
data(iris) | |
iris_copy <- copy(iris) | |
setDT(iris_copy) | |
iris_copy_ctree <- copy(iris_copy) | |
# ctree model ------------------------------------------------------------- |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
using StatsBase | |
const DIRS = [:left, :up, :right, :down] | |
function init_game() | |
grid = zeros(Int8,4,4) | |
grid[rand(1:4),rand(1:4)] = rand2_1() | |
grid[rand(1:4),rand(1:4)] = rand2_1() | |
grid | |
end |