###RUN SPARK ON 数人云
###单机版
- Mesos运行在host上
- Spark driver 和 executor运行docker上
#####1.搭建Mesos集群环境 详情 ,登录数人云,登录控制台后,通过集群管理创建自己的集群 #####2.运行Spark demo
require "rubygems" | |
require "test/unit" | |
require "stringio" | |
module Test::Unit | |
# Used to fix a minor minitest/unit incompatibility in flexmock | |
# AssertionFailedError = Class.new(StandardError) | |
class TestCase | |
# inspiration | |
# http://github.com/jnstq/rails-nginx-passenger-ubuntu | |
# sudo this sudo that bollocks | |
sudo -i | |
# system-related stuff | |
apt-get install htop strace sysstat | |
dpkg-reconfigure sysstat | |
apt-get install ntp |
This example shows how to setup an environment running Rails 3 beta 3 under 1.9.2-head with a 'rails3' gem set. | |
∴ rvm update --head | |
# ((Open a new shell)) or do 'rvm reload' | |
# If you do not already have the ruby interpreter installed, install it: | |
∴ rvm install 1.9.2-head | |
# Switch to 1.9.2-head and gemset rails3, create if it doesn't exist. | |
∴ rvm --create use 1.9.2-head@rails3 |
user app; | |
worker_processes 2; | |
error_log /home/app/logs/nginx.error.log info; | |
events { | |
worker_connections 1024; | |
} | |
class SvgController < ApplicationController | |
require 'active_support/secure_random' | |
def create | |
# create an SVG image | |
# based on Highcharts index.php | |
batik_path = Rails.root.to_s() + '/vendor/batik/batik-rasterizer.jar' | |
svg = params[:svg] | |
filename = params[:filename].blank? ? "chart" : params[:filename] |
upstream tumblr { | |
server 72.32.231.8:80; | |
} | |
server { | |
listen 80; | |
server_name jyorr.com; | |
access_log /var/log/nginx/jyorr.access.log; |
###RUN SPARK ON 数人云
###单机版
#####1.搭建Mesos集群环境 详情 ,登录数人云,登录控制台后,通过集群管理创建自己的集群 #####2.运行Spark demo
#!/bin/sh | |
############################################## | |
data_paths=/srv/dockerdata/debuild:/build # | |
data_name=debdata # | |
data_image=user/debdata # | |
bridge=br0 # | |
ipfile=/etc/default/docker_ips # | |
############################################## |
# 下载测试包 | |
git clone https://github.com/brownsys/zookeeper-benchmark.git | |
# build bench tools | |
mvn -DZooKeeperVersion=3.4.6 package | |
# run benchmark | |
java -cp target/lib/*:target/* edu.brown.cs.zkbenchmark.ZooKeeperBenchmark --conf benchmark.conf |