Skip to content

Instantly share code, notes, and snippets.

View marblejenka's full-sized avatar

Shingo Furuyama marblejenka

23 followers · 16 following
View GitHub Profile
@marblejenka
marblejenka / E1.tsv
Created August 8, 2021 13:07
STAT581
RunOrder annealing_time best_solution_occurence total_num_occurrences qpu_sampling_time TTS ln(TTS)
1 800 0 500 447280 13397971.34 16.41
2 1600 0 500 847280 25379702.10 17.05
3 200 1 500 147280 400659.94 12.90
4 1200 0 500 647280 19388836.72 16.78
5 100 4 500 97280 70787.40 11.17
6 20 0 500 57280 1715783.85 14.36
7 50 0 500 72280 2165098.75 14.59
8 1400 0 500 747280 22384269.41 16.92
9 90 3 500 92280 88899.45 11.40
@marblejenka
marblejenka / bin-on-linux.txt
Created April 13, 2020 07:43
SPARK-31432
[sfuruyam@sfuruyam2 dist]$ ./bin/run-example SparkPi
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/sfuruyam/dist/jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.4.0-91/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/04/13 14:38:20 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
20/04/13 14:38:21 INFO SparkContext: Running Spark version 3.1.0-SNAPSHOT
20/04/13 14:38:21 INFO ResourceUtils: ==============================================================
@marblejenka
marblejenka / fetch_from_sb.js
Last active November 2, 2019 09:56
var self = this
setInterval(function($x){
console.log('%s,%s,%s,%s,%s,%s,%s,%s,%s,%s',
$x('/html/body/div[3]/div[1]/div[1]/span[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[1]/div/p[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[2]/div/p[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[3]/div/p[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[4]/div/p[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[5]/div/p[3]/span')[0].innerText,
$x('/html/body/div[3]/div[1]/div[2]/div[6]/div/p[3]/span')[0].innerText,
@marblejenka
marblejenka / acf.R
Last active May 6, 2019 07:36
x1<-rnorm(300)
x2<-rep(c(15,rep(0,49)),6
x3<-c(rep(0,150),rep(3,150))
x4<-seq(1, 3, length.out = 300)
x5<-seq(1, -3, length.out = 300)
x6<-rep(c(seq(3, -3, length.out = 50), seq(-3, 3, length.out = 50)),3)
x7<-rep(c(seq(-3, 3, length.out = 50), seq(3, -3, length.out = 50)),3)
par(mfrow = c(7,2))
plot(x1)
@marblejenka
marblejenka / MoveCount.js
Created January 2, 2018 17:05
//=============================================================================
// MoveCount.js
//=============================================================================
/*:
* @plugindesc A plugin for counting moves.
* @author marblejenka
*
* @help
* A plugin for counting moves.
@marblejenka
marblejenka / pom.xml
Created August 16, 2014 17:45
pom for tez application using HDP
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>marblejenka</groupId>
<artifactId>tez-example-friend-of-friends</artifactId>
<version>SNAPSHOT</version>
<properties>
<tez.version>0.4.0.2.1.4.0-632</tez.version>
</properties>
@marblejenka
marblejenka / error.txt
Created January 12, 2013 03:54
HDInsight Install Error
C:\HadoopInstallFiles\HadoopSetupTools>winpkg.cmd
コマンド パイプライン位置 1 のコマンドレット winpkg.ps1
次のパラメーターに値を指定してください:
Package: ..\HadoopPackages\hdp-1.0.1-winpkg.zip
Action: install
WINPKG: Logging to existing log hdp-1.0.1.winpkg.install.log
WINPKG: Setting ENV:WINPKG_BIN to C:\HadoopInstallFiles\HadoopSetupTools
WINPKG: ENV:WINPKG_BIN is C:\HadoopInstallFiles\HadoopSetupTools
WINPKG: Setting Environment::CurrentDirectory to C:\HadoopInstallFiles\HadoopSetupTools
@marblejenka
marblejenka / class not found
Created July 17, 2012 09:57
CDH3のエラー（あとでしらべる）
2/07/13 14:26:14 INFO mapred.JobClient: Task Id : attempt_201207121852_0020_r_000000_2, Status : FAILED
Error: java.lang.ClassNotFoundException: Ljava.lang.InternalError
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at org.apache.hadoop.io.compress.snappy.SnappyDecompressor.decompressBytesDirect(Native Method)
at org.apache.hadoop.io.compress.snappy.SnappyDecompressor.decompress(SnappyDecompressor.java:234)
@marblejenka
marblejenka / install.txt
Created July 11, 2012 10:27
apache hadoopの疑似分散環境インストール
# インストール
wget http://ftp.kddilabs.jp/infosystems/apache/hadoop/common/hadoop-0.20.205.0/hadoop-0.20.205.0-1.amd64.rpm
rpm -ivh hadoop-0.20.205.0-1.amd64.rpm
# なんやかんや聞かれるけどYで答えておけば疑似分散環境ができる
/usr/sbin/hadoop-setup-single-node.sh
# ユーザーの作成
/usr/sbin/hadoop-create-user.sh -u asakusa
@marblejenka
marblejenka / console.log
Created July 5, 2012 05:44
Yarn Child Hangover forever
+ hadoop jar /usr/local/share/hadoop-2.0.0-cdh4.0.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.0.0.jar terasort input output
12/07/04 22:26:44 INFO terasort.TeraSort: starting
12/07/04 22:26:44 INFO input.FileInputFormat: Total input paths to process : 16
Spent 167ms computing base-splits.
Spent 3ms computing TeraScheduler splits.
Computing input splits took 171ms
Sampling 10 splits of 192
12/07/04 22:26:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Making 8 from 100000 sampled records
Computing parititions took 386ms