- big.csv (1.3GB)
- Macbook Air 11-inch, Mid 2011
- CPU: 1.8 GHz Intel Core i7
- Memory: 4 GB 1333 MHz DDR3
https://github.com/mirakui/hello_world/blob/master/go/csv_counter.go
$ time ./csv_counter big.csv
lines: 3502066
require 'rubygems' | |
require 'pp' | |
require 'mechanize' | |
class LinkChecker | |
PAGES_MAX = 1000 | |
def initialize(param=[]) | |
@crawled = {} | |
@queue = [] |
https://github.com/mirakui/hello_world/blob/master/go/csv_counter.go
$ time ./csv_counter big.csv
lines: 3502066