Skip to content

Instantly share code, notes, and snippets.

View LittleWat's full-sized avatar
🏠
Working from home

Kohei Watanabe LittleWat

🏠
Working from home
  • Tokyo
View GitHub Profile
@LittleWat
LittleWat / LDA_model.scala
Last active December 15, 2015 05:21
SparkLDAの実行についてのメモ ref: http://qiita.com/LittleWat/items/3ad733f7362edd954714
import scala.collection.mutable
import org.apache.spark.{SparkContext, SparkConf}
import org.apache.spark.SparkContext._
import org.apache.spark.mllib.clustering.{EMLDAOptimizer, OnlineLDAOptimizer, LDAModel, LocalLDAModel, DistributedLDAModel, LDA}
import org.apache.spark.mllib.linalg.{Vector, Vectors}
import org.apache.spark.rdd.RDD
import org.apache.spark.sql.SQLContext
import org.apache.spark.sql._
import org.apache.spark.ml.feature.{Tokenizer, RegexTokenizer}
import org.apache.spark.ml.feature.{CountVectorizer, CountVectorizerModel}
@LittleWat
LittleWat / SensingActivityの一部.java
Last active January 4, 2016 12:08
pythonで加速度のデータから行動認識をやってみる① ref: http://qiita.com/LittleWat/items/f4156cffd714f2377bb0
//manager.registerListener(this, s, SensorManager.SENSOR_DELAY_GAME);
manager.registerListener(this, s, 20000); //20000μsec(=50Hz)
@LittleWat
LittleWat / convert.py
Last active January 2, 2016 14:17
pandasでunix時刻をdatetime型に変更する際の注意事項 ref: http://qiita.com/LittleWat/items/c7cf5c3276e1d5e25d66
df["time"] = pd.to_datetime(df.index , unit="ms")
df["time2"] =df.index
df["time3"] = df.time2.apply(lambda x: datetime.fromtimestamp(x/1000))
@LittleWat
LittleWat / model.py
Last active March 18, 2017 08:51
chainerで2つの違うモーダルを共通空間に射影するときのモデルコード ref: http://qiita.com/LittleWat/items/3539cda08e3b01ae079e
# Network definition
class MLP(chainer.Chain):
def __init__(self, n_units, n_out):
super(MLP, self).__init__(
# the size of the inputs to each layer will be inferred
l1=L.Linear(None, n_units), # n_in -> n_units
l2=L.Linear(None, n_units), # n_units -> n_units
l3=L.Linear(None, n_out), # n_units -> n_out
)
@LittleWat
LittleWat / set_debugger.py
Last active April 24, 2017 03:24
Pythonスクリプトを走らせたときに,エラーになったらデバッガに入ってほしいときに使うと便利な関数メモ ref: http://qiita.com/LittleWat/items/79741b26a080c2dfb2f7
import sys
def set_debugger_org():
if not sys.excepthook == sys.__excepthook__:
from IPython.core import ultratb
sys.excepthook = ultratb.FormattedTB(call_pdb=True)
def set_debugger_org_frc():
from IPython.core import ultratb
sys.excepthook = ultratb.FormattedTB(call_pdb=True)
@LittleWat
LittleWat / utils.py
Created April 11, 2017 08:57
pandasのDataFrame形式の2つの確率分布のcos類似度を計算するスクリプト ref: http://qiita.com/LittleWat/items/259354f1364b72f27043
def calc_cos_mat(mat_df1, mat_df2):
"""
Args:
pd.DataFrame: mat_df1, mat_df2
The modals of mat_df1 column and mat_df2 column must be same!
Returns:
pd.DataFrame: cosign_simularity_matrix_df
"""
import pandas as pd
@LittleWat
LittleWat / shrink_colums.vb
Last active October 30, 2018 14:57
エクセルで横に並んだ複数デーブルを一つの縦に並んだテーブルに処理するマクロ
Sub shrink_colums()
' ---------- 要設定ゾーン Start ----------
NUM_COL_SET = 2 ' 2列1セット
HEADER_OFFSET = 1 ' ヘッダ行の行数
FROM_SHEET_NAME = "Sheet1" ' コピー元のシート名
TO_SHEET_NAME = "ColumnShrinked" ' コピー先のシート名
' ---------- 要設定ゾーン End ----------
Worksheets.Add after:=Worksheets(Worksheets.Count)
@LittleWat
LittleWat / setup.sh
Created September 4, 2020 06:08 — forked from bradp/setup.sh
New Mac Setup Script
echo "Creating an SSH key for you..."
ssh-keygen -t rsa
echo "Please add this public key to Github \n"
echo "https://github.com/account/ssh \n"
read -p "Press [Enter] key after this..."
echo "Installing xcode-stuff"
xcode-select --install
@LittleWat
LittleWat / head_nod_detection.py
Last active March 12, 2021 10:17 — forked from smeschke/head nod detection
Detection of Head Nods using OpenCV in Python
import cv2
import numpy as np
fourcc = cv2.VideoWriter_fourcc(*'MP4V')
out = cv2.VideoWriter('out.mp4',fourcc, 20.0, (640,480))
#dinstance function
def distance(x,y):
import math
return math.sqrt((x[0]-y[0])**2+(x[1]-y[1])**2)
@LittleWat
LittleWat / mov2gif.sh
Last active March 13, 2021 02:45
QuickTimeで取得したmovファイルをgifに変換するスクリプト
#!/bin/bash
# same speed: $ bash ./mov2gif.sh hogehoge.mov
# X2 speed: $ bash ./mov2gif.sh hogehoge.mov 2
INPUT_FILENAME=$1
ARGSPEED=$2
SPEED=${ARGSPEED:=1}
OUTPUT_FILENAME="$1-x${SPEED}.gif"