Skip to content

Instantly share code, notes, and snippets.

qemuでboot2dockerを起動。割と普通に動いた。VT-Xを使ってるかどうかを要検証
```bash
λ 'C:\Program Files\qemu\qemu-img.exe' create -f qcow2 harddisk.qcow2 32G
λ "C:\Program Files\qemu\qemu-system-x86_64w.exe" -m 4G -cdrom boot2docker.iso -name boot2docker -drive file=harddisk.qcow2,media=d isk,cache=writeback -smp 2 -netdev user,id=user.0 -device e1000,netdev=user.0
```
@koduki
koduki / memo_java9-aot.txt
Last active January 20, 2017 11:13
memo_java9-aot.txt
http://nothingcosmos.wiki.fc2.com/wiki/OpenJDK%E3%81%AE%E3%83%93%E3%83%AB%E3%83%89%E6%96%B9%E6%B3%95
https://www.google.co.jp/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0ahUKEwistsDN0qTRAhWDmZQKHRSoDKMQFgglMAE&url=https%3A%2F%2Fjdk9.java.net%2F&usg=AFQjCNFjzKRAjtdK8S5f0FQNoTf34f-kWg&sig2=GdbV4Acn0WdisKq62MHvjg&bvm=bv.142059868,d.dGo
13 ./get_source.sh
14 bash get_source.sh
5 apt-get install mercurial
17 apt-get install gcc make
19 apt-get install unzip
20 apt-get install bzip2 gzip tar zip cups-devel
21 apt-get install bzip2 gzip tar zip
@koduki
koduki / ltsv.sh
Last active December 14, 2016 17:27
This is AWK wrapper to parse LTSV. more details [awkとシェルでLTSVの取り扱いを簡単にするフィルタを書いてみた](http://koduki.hatenablog.com/entry/2013/07/31/000817)
#!/bin/bash
script=$1
func_ltsv=`cat << 'EOS'
function ltsv(key){
for(i=1; i<=NF; i++){
match($i, ":");
xs[substr($i, 0, RSTART)] = substr($i, RSTART+1);
};
return xs[key":"];
List<Item> items = createItemList("Item", 100);
bench("outer_join(df:bloadcast)", 5, () -> {
long count = sc.parallelize(items)
.map(x -> sleep(1))
.count();
System.out.println("finish: " + count);
});

setup cluster

$ gcloud dataproc clusters create --master-machine-type "n5-standard-4" --worker-machine-type "n1-standard-4" --num-preemptible-workers 1 mycluster

spark-submit

$ gcloud dataproc jobs submit spark --properties spark.dynamicAllocation.enabled=false --cluster mycluster --class techconf.example.spark01.Main --jars Documents\NetBeansProjects\example-spark01\target\example-spark01-0.1.jar
public static void main(String[] args) {
SparkConf sparkConf = new SparkConf()
.setMaster("local[*]")
.setAppName("Example01");
JavaSparkContext sc = new JavaSparkContext(sparkConf);
sc.parallelize(IntStream.range(1, 100).boxed().collect(Collectors.toList())).map(x -> {
return (x % 15 == 0) ? "FizzBuzz"
: (x % 5 == 0) ? "Fizz"
: (x % 3 == 0) ? "Buzz"
: x.toString();
下記のエラーが発生
Successfully built 5a6d26f6b991
SECURITY WARNING: You are building a Docker image from Windows against a non-Windows Docker host. All files and directories added to build context will have '-rwxr-xr-x' permissions. It is recommended to double check and reset permissions for sensitive files and directories.
The push refers to a repository [registry.heroku.com/secret-fjord-96615/web]
03c19e4bdde5: Preparing
5c331e8bd692: Preparing
d9bec0efee77: Preparing
d55a8cc45244: Preparing
52207ae120e6: Preparing
@koduki
koduki / file0.txt
Created September 5, 2016 19:00
Dockerを使ってJava9を超高速に試す ref: http://qiita.com/koduki/items/c4fb0276cc0d9a1a08c0
$ docker run marvambass/oracle-java9 java -version
java version "9-ea"
Java(TM) SE Runtime Environment (build 9-ea+130)
Java HotSpot(TM) 64-Bit Server VM (build 9-ea+130, mixed mode)
@koduki
koduki / file0.txt
Last active August 11, 2016 23:10
Windows Subsystem for Linux + Cmderで最強のCLI環境を作る ref: http://qiita.com/koduki/items/ab68b917b8dbc7d51af0
$ sudo apt-get install zsh
$(function(){
var host = "ws://localhost:8888/";
var socket = new WebSocket(host);
socket.onmessage = function(message){
console.log(socket.readyState + " " + message.data);
}
$("#sendBtn").on("click",function(){
message = $("#message").val()