- Setting up a new development VM should be as easy as 2 commands. And it is:
vagrant init; vagrant up
- In this example we are converting the HDP Sandbox to be used in this way. But the howto will work with any existing VM.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
int2ip_sep <- function(int) { | |
val <- sprintf("%x", int) | |
pos <- matrix(c(seq(1,7,2), seq(2,8,2)), ncol = 2) | |
spl <- apply(pos, 1, function(x) {substr(val, x[1], x[2])}) | |
as.numeric(sapply(spl, function(x) {sprintf("%d", | |
as.numeric(paste("0x", | |
x, sep="")))})) | |
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
library(hexbin) | |
library(ggplot2) | |
library(Hmisc) | |
## The following function cretes a hexbinplot from a dataset using ggplot | |
## for graphing but hexbin for doing the hexbinning. | |
## xvar and yvar are the x and y data | |
## bins is the number of bins to pass into the hexbin function | |
## cuts is the number of steps to use in a discrete color scale | |
make.hexbin.ggplot <- function(xvar, yvar, bins, cuts) { |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
SLIDES := $(patsubst %.md,%.md.slides.pdf,$(wildcard *.md)) | |
HANDOUTS := $(patsubst %.md,%.md.handout.pdf,$(wildcard *.md)) | |
all : $(SLIDES) $(HANDOUTS) | |
%.md.slides.pdf : %.md | |
pandoc $^ -t beamer --slide-level 2 -o $@ | |
%.md.handout.pdf : %.md | |
pandoc $^ -t beamer --slide-level 2 -V handout -o $@ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Homebrew build logs for gcc on Mac OS X 10.10.5 | |
Build date: 2016-08-14 22:44:11 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
set -x -e | |
# AWS EMR bootstrap script | |
# for installing open-source R (www.r-project.org) with RHadoop packages and RStudio on AWS EMR | |
# | |
# tested with AMI 4.0.0 (hadoop 2.6.0) | |
# | |
# schmidbe@amazon.de | |
# 24. September 2014 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
set -x -e | |
# Usage: | |
# --no-rstudio - don't install rstudio-server | |
# --sparklyr - install RStudio's sparklyr package | |
# --sparkr - install SparkR package | |
# --shiny - install Shiny server | |
# | |
# --user - set user for rstudio, default "hadoop" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
# These variables can be overwritten using the arguments bellow | |
VERSION="1.0.110" | |
# drwho is listed as user in YARN's Resource Manager UI. | |
USER="drwho" | |
# Depending on where the EMR cluster lives, you might have to change this to avoid security issues. | |
# To change the default password (and user), use the arguments bellow. | |
# If the cluster is not visible on the Internet, you can just leave the defaults for convenience. | |
PASS="tardis" |
Get Homebrew installed on your mac if you don't already have it
Install highlight. "brew install highlight". (This brings down Lua and Boost as well)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# install the package devtools | |
install.packages("devtools") | |
library(devtools) | |
# install the doAzureParallel and rAzureBatch package | |
install_github(c("Azure/rAzureBatch", "Azure/doAzureParallel")) |
OlderNewer