Skip to content

Instantly share code, notes, and snippets.

View j-min's full-sized avatar

Jaemin Cho j-min

View GitHub Profile
@j-min
j-min / hangul.py
Created December 20, 2016 04:07 — forked from allieus/hangul.py
# -*- coding: utf-8 -*-
class Hangul:
BASE_CODE = 44032
CHOSUNG = 588
JUNGSUNG = 28
# 초성 리스트. 00 ~ 18
CHOSUNG_LIST = [
'ㄱ', 'ㄲ', 'ㄴ', 'ㄷ', 'ㄸ', 'ㄹ', 'ㅁ', 'ㅂ', 'ㅃ',
@j-min
j-min / tokenize_dparser.py
Last active December 3, 2016 09:02
Get tokenized list from dparser
import json
import requests
def tokenize_dparser(text):
dparser_link = 'http://parser.datanada.com/parse?version=1&string='
url = dparser_link+text
response = requests.get(url)
@j-min
j-min / 2_3.py
Created November 24, 2016 06:10
Python 2/3 compatibility
from __future__ import absolute_import
from __future__ import division
from __future__ import print_function
import csv
import os
def get_csv_writer(filename, rows, delimiter):
with open(filename, 'w') as csvfile:
fieldnames = rows[0].keys()
writer = csv.DictWriter(csvfile, fieldnames=fieldnames, delimiter=delimiter)
writer.writeheader()
for row in rows:
try:
@j-min
j-min / TF_MDN.ipynb
Created November 15, 2016 10:46
Mixture Density Network in TensorFlow
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@j-min
j-min / AWS_Jupyter_Notebook.sh
Last active November 8, 2016 08:34
Jupyter Notebook setup on AWS EC2
sudo apt-get upgrade
sudo apt-get update
sudo pip install jupyter notebook
jupyter notebook --generate-config
ipython
from notebook.auth import passwd
passwd()

NLTK API to Stanford NLP Tools compiled on 2015-12-09

Stanford NER

With NLTK version 3.1 and Stanford NER tool 2015-12-09, it is possible to hack the StanfordNERTagger._stanford_jar to include other .jar files that are necessary for the new tagger.

First set up the environment variables as per instructed at https://github.com/nltk/nltk/wiki/Installing-Third-Party-Software

@j-min
j-min / test_single_gpu.py
Created November 6, 2016 13:51
TensorFlow single GPU example
from __future__ import print_function
'''
Basic Multi GPU computation example using TensorFlow library.
Author: Aymeric Damien
Project: https://github.com/aymericdamien/TensorFlow-Examples/
'''
'''
This tutorial requires your machine to have 1 GPU
"/cpu:0": The CPU of your machine.
@j-min
j-min / test_multi_gpu.py
Last active January 15, 2022 01:57
TensorFlow multi GPU example
from __future__ import print_function
'''
Basic Multi GPU computation example using TensorFlow library.
Author: Aymeric Damien
Project: https://github.com/aymericdamien/TensorFlow-Examples/
'''
'''
This tutorial requires your machine to have 2 GPUs
"/cpu:0": The CPU of your machine.
@j-min
j-min / install-tensorflow.sh
Last active November 15, 2016 12:12 — forked from erikbern/install-tensorflow.sh
TensorFlow Installation Log
# Note – this is not a bash script (some of the steps require reboot)
# I named it .sh just so Github does correct syntax highlighting.
#
# This is also available as an AMI in us-east-1 (virginia): ami-cf5028a5
#
# The CUDA part is mostly based on this excellent blog post:
# http://tleyden.github.io/blog/2014/10/25/cuda-6-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/
# Install various packages
sudo apt-get update