Skip to content

Instantly share code, notes, and snippets.

View woodywang's full-sized avatar

Wang Jinbo woodywang

33 followers · 20 following
  • Beijing, China
View GitHub Profile
@woodywang
woodywang / BaiduCrawler.java
Created February 18, 2016 01:43
package com.woodywang.crawler.task;
import com.fasterxml.jackson.databind.JsonNode;
import com.fasterxml.jackson.databind.ObjectMapper;
import java.net.URL;
import java.util.ArrayDeque;
import java.util.ArrayList;
import java.util.List;
import java.util.Queue;
@woodywang
woodywang / Friends.java
Last active August 29, 2015 14:04
2014-08-01 Team Coding
import java.util.*;
/**
* Created by woody on 7/31/14.
*/
public class Friends {
private static int P, m, M, n, N;
public static void main(String[] args) {
Scanner scanner = new Scanner(System.in);
@woodywang
woodywang / Mouse
Created July 31, 2014 12:50
import java.util.*;
public class Mouse {
/**
* @param args
*/
private boolean found = false;
public int si, sj, ei, ej;
public boolean vist(char[][] bear, int i, int j, int R, int C){
@woodywang
woodywang / HFileInputFormatDemo.java
Created May 20, 2013 01:49
An example for HFileInputFormat
package com.woodywang;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.hbase.KeyValue;
import org.apache.hadoop.hbase.io.ImmutableBytesWritable;
import org.apache.hadoop.hbase.util.Bytes;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
@woodywang
woodywang / Benchmark.java
Last active December 16, 2015 14:59
对以下说法的质疑： $in 操作一次是快，但是在 list 量大的时候会造成全局的阻塞，造成大量的慢查询（查询查日志中都有记录）。因为目前一个库要对应的查询各种各样，每秒的读操作要上千或者几千，并且 mongodb 是单进程在跑，所以我们要遵循的原则就是单次请求要尽量快的完成。$in 操作，尽量少用，即使要用，list 中的元素也尽量的少。
package com.woodywang;
import com.mongodb.*;
public class Benchmark {
/**
* 使用线程模拟多个客户端并发请求
*/
static class Finder implements Runnable {
@woodywang
woodywang / Lzo.java
Last active December 10, 2015 00:29
package cn.com.admaster.hadoop.compress;
import com.hadoop.compression.lzo.LzopCodec;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
@woodywang
woodywang / parser-bool-mongodb.py
Created December 18, 2012 03:11
A parser which convert SQL-like boolean expression into MongoDB condition expression.
import re
import json
OP_STACK = list()
ELEM_STACK = list()
COMP_STACK = list()
OP_MONGO_MAP = dict({
'AND': '$and',
'OR': '$or',
@woodywang
woodywang / convertRelativeToAbsolute.php
Created June 18, 2011 12:46
Convert a relative URL to absolute one, depends on the current base URL.
<?php
function convertRelativeToAbsolute($relativeUrl, $baseUrl)
{
preg_match('/^([\w\d]+?):\/\/([^\/]+)(\/[^\?#\.]+)?/', $baseUrl, $match);
$scheme = $match[1];
$host = $match[2];
$basePath = '/';
@woodywang
woodywang / GFormula.php
Created April 14, 2011 08:50
Render math formula with Google Chart API
<?php
class GFormula
{
private $_gate = 'https://chart.googleapis.com/chart';
private $_params = array();
private $_url;
public function __construct()