###RUN SPARK ON 数人云
###单机版
- Mesos运行在host上
- Spark driver 和 executor运行docker上
#####1.搭建Mesos集群环境 详情 ，登录数人云，登录控制台后，通过集群管理创建自己的集群 #####2.运行Spark demo
xiaods
/ gist:55142ccedbe4f25628a3
Created
November 6, 2015 17:23
Zookeeper Performance way for shurenyun.co
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # 下载测试包 | |
| git clone https://github.com/brownsys/zookeeper-benchmark.git | |
| # build bench tools | |
| mvn -DZooKeeperVersion=3.4.6 package | |
| # run benchmark | |
| java -cp target/lib/*:target/* edu.brown.cs.zkbenchmark.ZooKeeperBenchmark --conf benchmark.conf |
xiaods
/ dki
Created
October 16, 2015 02:30
— forked from itoffshore/dki
Create Docker data-only container + container with static ip address
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| ############################################## | |
| data_paths=/srv/dockerdata/debuild:/build # | |
| data_name=debdata # | |
| data_image=user/debdata # | |
| bridge=br0 # | |
| ipfile=/etc/default/docker_ips # | |
| ############################################## |
xiaods
/ sparkOnShurenyun.md
Last active
October 15, 2015 03:16
— forked from cfmcgrady/sparkOnMesos.md
玩转Spark on 数人云
xiaods
/ mesos-docker
Last active
August 29, 2015 14:17
— forked from mitchwongho/mesos-docker
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # ZooKeeper | |
| $ sudo docker run --net=host jplock/zookeeper:3.4.6 | |
| #Mesos-Master | |
| ## It's important to specify --ip=<ip> and --hostname=<ip> parameters | |
| $ sudo docker run --net=host mesosphere/mesos-master:0.21.0-1.0.ubuntu1404 --ip=10.42.0.1 --hostname=10.42.0.1 --zk=zk://10.42.0.1:2181/mesos --work_dir=/opt/ --quorum=1 | |
| #Mesosphere-Marathon |
xiaods
/ README.md
Last active
August 29, 2015 14:17
— forked from rfc1459/README.md
Drop memory-cg.conf into /etc/init. The upstart job will ensure
that the memory cgroup is configured with hierarchical stats tracking
before systemd-logind and/or docker start creating cgroups.
(Yes, it's mostly a crude hack with an obscure way of syncing with cgroup-lite. That can't be helped, though)
xiaods
/ gist:f2f7d53db1c17d508ee4
Last active
August 29, 2015 14:17
— forked from jedi4ever/gist:903751
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # /etc/security/limits.conf | |
| * soft nofile 999999 | |
| * hard nofile 999999 | |
| root soft nofile 999999 | |
| root hard nofile 999999 | |
| =========================================================== | |
| # /etc/sysctl.conf | |
| # sysctl for maximum tuning |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # https://coreos.com/docs/running-coreos/platforms/openstack/ | |
| Step one: | |
| ``` | |
| $ wget http://alpha.release.core-os.net/amd64-usr/current/coreos_production_openstack_image.img.bz2 | |
| $ bunzip2 coreos_production_openstack_image.img.bz2 | |
| $ glance image-create --name CoreOS \ | |
| --container-format bare \ | |
| --disk-format qcow2 \ |
xiaods
/ panamax-coreos-installer.sh
Last active
August 29, 2015 14:08
— forked from uzyexe/panamax-coreos-installer.sh
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| mkdir panamax | |
| cd panamax | |
| curl -O http://download.panamax.io/installer/pmx-installer-latest.zip | |
| unzip pmx-installer-latest.zip | |
| sudo su | |
| ./coreos install --stable |
xiaods
/ method_missing.js
Created
September 1, 2014 23:22
— forked from stevekinney/method_missing.js
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // This will only work in environments that support ES6 Proxies. | |
| // As of right now, that's pretty much only Firefox. | |
| function Refrigerator(foods) { | |
| this.foods = foods; | |
| return new Proxy(this, { | |
| get: function (receiver, name) { | |
| if (name in receiver) { |
xiaods
/ capybara cheat sheet
Created
May 5, 2014 01:55
— forked from zhengjia/capybara cheat sheet
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| =Navigating= | |
| visit('/projects') | |
| visit(post_comments_path(post)) | |
| =Clicking links and buttons= | |
| click_link('id-of-link') | |
| click_link('Link Text') | |
| click_button('Save') | |
| click('Link Text') # Click either a link or a button | |
| click('Button Value') |