Skip to content

Instantly share code, notes, and snippets.

View chezou's full-sized avatar

Aki Ariga chezou

218 followers · 7 following
View GitHub Profile
@chezou
chezou / hyperparameter-optimization-solution.ipynb
Last active October 16, 2018 07:31
Hyper parameter optimization example with PyWren
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@chezou
chezou / README.md
Created September 28, 2018 05:50
digdag py> operator with conda image

File is put as follows:

➜  pyop-test tree .
.
├── py-test.dig
└── simple_task.py

0 directories, 2 files
@chezou
chezou / kinesis_freestyle2.json
Created September 3, 2018 02:57
Karabiner-Elements setting for Kinesis freestyle2 only for Windows version with disabling for Mac. `location_id` should be replaced for your Kinesis freestyle2.
{
"title": "Kinesis Freestyle2",
"rules": [
{
"description": "Swap only for Windows",
"manipulators": [
{
"conditions": [
{
"type": "device_if",
@chezou
chezou / parameter_tuning.dig
Created August 28, 2018 05:22
parameter tuning example of Boston house pricing
_export:
!include : config/params.yml
td:
apikey: ${apikey}
database: ${dbname}
engine: hive
target_table: house_prices_training
+prepare:
@chezou
chezou / flume-aggregator.conf
Last active April 20, 2018 04:56
##### Aggregator configs #####
# general settings
agent.sources = avro-source
agent.channels = weblog-ch dstat-ch
agent.sinks = weblog-sink dstat-sink
## sources
agent.sources.avro-source.type = avro
# Do not use localhost which causes RPC connection error
# Should be changed different hostname for each node
@chezou
chezou / create_table.hql
Created March 23, 2018 07:11
Air port data preparation from http://www.ibis-project.org/pages/data.html#airlines
CREATE DATABASE IF NOT EXISTS flights;
CREATE EXTERNAL TABLE IF NOT EXISTS airports_str (
iata STRING
, airport STRING
, city STRING
, state STRING
, country STRING
, latitude DOUBLE
, longitude DOUBLE
@chezou
chezou / pyhocon-test.sh
Last active August 24, 2017 00:24
(venv) ~/w/pyhocon (master ☡=) (venv) python --version 09:22:30
Python 3.6.1
(venv) ~/w/pyhocon (master ☡=) (venv) py.test tests/test_tool.py --doctest-modules 09:17:00
============================================================================== test session starts ==============================================================================
platform darwin -- Python 3.6.1, pytest-3.2.1, py-1.4.34, pluggy-0.4.0
rootdir: /Users/ariga/work/pyhocon, inifile:
collected 6 items
tests/test_tool.py FFFFF.
@chezou
chezou / install-director.sh
Last active December 23, 2019 17:47
How to install Cloudera Director on Linux Subsystem on Windows 10
#!/bin/bash
# Prepare source list
cd /etc/apt/sources.list.d/
sudo curl "http://archive.cloudera.com/director/ubuntu/trusty/amd64/director/cloudera-director.list" -O
sudo curl -s "http://archive.cloudera.com/director/ubuntu/trusty/amd64/director/archive.key" | sudo apt-key add -
# Install Java
sudo apt-get update
sudo apt install oracle-j2sdk1.8
@chezou
chezou / constraints.txt
Last active April 3, 2022 10:25
pip example with remote whl: https://github.com/singingwolfboy/python-wheelhouse/tree/gh-pages
aafigure==0.6
alabaster==0.7.10
Babel==2.4.0
certifi==2017.4.17
chardet==3.0.4
colorama==0.3.9
docutils==0.13.1
idna==2.5
imagesize==0.7.1
Jinja2==2.9.6
@chezou
chezou / config.py
Created July 8, 2017 10:40
keyhac emacs key binding fork: https://github.com/smzht/fakeymacs
# -*- mode: python; coding: utf-8-with-signature-dos -*-
## nickname: fakeymacs
##
## Windows の操作を emacs のキーバインドで行うための設定（Keyhac版）ver.20170629_01
##
# このスクリプトは、Keyhac for Windows ver 1.75 以降で動作します。
# https://sites.google.com/site/craftware/keyhac-ja
# スクリプトですので、使いやすいようにカスタマイズしてご利用ください。