Skip to content

Instantly share code, notes, and snippets.

View fannix's full-sized avatar

fannix fannix

  • Peking University
  • Beijing
View GitHub Profile
@fannix
fannix / mxnet.md
Created March 10, 2018 23:14
Mxnet

Installation

  1. Ensure you have correct GPU drivers. Install nvidia for ARCH Linux. Otherwise you won't be able to use GPU.
  2. Use the correct flags and compiler. Refer to the mxnet AUR PKGBUILD for the correct command
  3. Don't need to copy the libmxnet.so manually. python setup.py build|install will package the so file and put into the correct path.
@fannix
fannix / one-line awk.py
Created January 13, 2013 11:22
one line AWK
HANDY ONE-LINE SCRIPTS FOR AWK 30 April 2008
Compiled by Eric Pement - eric [at] pement.org version 0.27
Latest version of this file (in English) is usually at:
http://www.pement.org/awk/awk1line.txt
This file will also be available in other languages:
Chinese - http://ximix.org/translation/awk1line_zh-CN.txt
USAGE:
@fannix
fannix / ntcir.en.vec
Created December 15, 2012 12:24
SVC(kernel="linear") and LinearSVC give quite different results.
-1 2:1 3:1 4:2 5:1 6:1 7:2 8:1 9:1 10:1 11:1 12:1 13:1 14:1 15:1 16:1 17:1 18:1 19:1 20:1 21:1
-1 7:2 12:1 18:2 22:1 23:1 24:1 25:1 26:1 27:1 28:1 29:1 30:1 31:1 32:1 33:1 34:1 35:1 36:1 37:1 38:1 39:1 40:1 41:2 42:1 43:1 44:1 45:1 46:1 47:1 48:1
-1 7:1 12:1 17:1 21:1 27:1 49:1 50:1 51:1 52:1 53:1 54:1
+1 4:4 7:1 13:1 18:2 21:1 24:1 28:1 39:1 41:1 56:1 57:1 58:1 59:1 60:1 61:1 62:1 63:1 64:1 65:1 66:1 67:2 68:1 69:1 70:1 71:1 72:1 73:1 74:1 75:1 76:1 77:1 78:1 79:1
+1 7:1 18:5 21:1 23:1 30:2 31:1 39:1 53:1 67:1 80:1 81:1 82:1 83:1 84:1 85:1 86:1 87:2 88:1 89:1 90:1 91:1 92:1
+1 18:1 21:1 43:1 67:1 83:1 93:1 94:1 95:1 96:1 97:1 98:1 99:1 100:1 101:1 102:1 103:1 104:1 105:1 106:1
-1 2:1 4:2 6:1 7:1 18:1 20:1 21:1 30:2 39:1 63:1 67:1 78:1 87:1 107:1 108:1 109:1 110:1 111:1 112:1 113:1 114:1 115:1 116:1 117:1 118:1 119:1 120:1
+1 4:1 7:1 9:1 18:3 21:1 26:1 30:1 31:1 34:1 35:1 39:1 67:1 100:1 113:1 121:1 122:1 123:1 124:1 125:1 126:1 127:1 128:1 129:1 130:1 131:1 132:1 133:1 134:1
+1 4:2 7:3 9:1 17:1 18:1 21:2 23:
@fannix
fannix / unbalanced.py
Created December 10, 2012 06:09
Unbalanced dataset classification and visualization
import pylab as pl
import sklearn
from sklearn import linear_model, svm
import numpy as np
from sklearn import datasets
X, y = datasets.make_classification(n_samples=100, n_features=2, n_redundant=0)
pl.scatter(X[:, 0], X[:, 1], c=y)
clr0 = linear_model.LogisticRegression()
@fannix
fannix / redis.py
Created November 30, 2012 07:44
Redis
r = redis.StrictRedis(host='127.0.0.1', port=6379, db=0)
r.get('users:leto')
@fannix
fannix / edge_list_to_vna.py
Created November 23, 2012 02:33
networkX and graph util
"""
convert an edge list to the graph VNA format.
VNA format can be read and visualized by Gephi
"""
import sys
def edge_list_to_vna(edge_list):
"""edge_list is a list of 3-tuples: [from, to, weight]
@fannix
fannix / text_to_libsvm.py
Created November 17, 2012 01:07
Convert text format to libsvm format
""" project text to libsvm vector space
"""
from gensim import corpora, models, similarities
import sys
import os.path
def load_document():
text_li = []
for line in sys.stdin:
@fannix
fannix / lingpipe_segmenter.py
Created November 17, 2012 00:43
Stanford Tagger Jython Wrapper
#encoding:utf-8
from java.io import FileInputStream
from java.io import ObjectInputStream
import sys
jarfiles = ["/opt/lingpipe-segmenter/lingpipe-4.0.1.jar", "/opt/lingpipe-segmenter/zhToksDemo.jar"]
for jar in jarfiles:
if jar not in sys.path:
sys.path.append(jar)
@fannix
fannix / about.md
Created March 28, 2012 01:32 — forked from jasonrudolph/about.md
Programming Achievements: How to Level Up as a Developer
@fannix
fannix / load_and_save.py
Created February 18, 2012 08:34
Save and load sparse matrix
"""http://stackoverflow.com/questions/6282432/load-sparse-array-from-npy-file
"""
import random
import scipy.sparse as sparse
import scipy.io
import numpy as np
def save_sparse_matrix(filename, x):
x_coo = x.tocoo()
row = x_coo.row