master benchmark (5fad1918)

> apache-arrow@0.3.0 perf /home/hulettbh/working_dir/arrow/js
> node ./perf/index.js

Running apache-arrow performance tests...

Parse "tracks":
Table.from
 x 6,199 ops/sec ±2.83% (81 runs sampled)
   avg: 0.16ms
   0.96% of a frame @ 60FPS 

Parse "tracks":
readBatches
 x 7,186 ops/sec ±1.57% (87 runs sampled)
   avg: 0.14ms
   0.84% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'lat', length: 1000000, type: Float32
 x 20.08 ops/sec ±1.92% (37 runs sampled)
   avg: 49.81ms
   298.86% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'lng', length: 1000000, type: Float32
 x 19.17 ops/sec ±0.66% (37 runs sampled)
   avg: 52.16ms
   312.96% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.36 ops/sec ±1.26% (5 runs sampled)
   avg: 2758.32ms
   16549.92% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.36 ops/sec ±0.79% (5 runs sampled)
   avg: 2749.67ms
   16498.02% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 12.82 ops/sec ±4.31% (35 runs sampled)
   avg: 78ms
   468% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 13.46 ops/sec ±1.77% (38 runs sampled)
   avg: 74.27ms
   445.62% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.32 ops/sec ±7.69% (5 runs sampled)
   avg: 3152.35ms
   18914.1% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.33 ops/sec ±2.32% (5 runs sampled)
   avg: 2997.36ms
   17984.16% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 744 ops/sec ±0.95% (88 runs sampled)
   avg: 1.34ms
   8.04% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 709 ops/sec ±1.28% (89 runs sampled)
   avg: 1.41ms
   8.46% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.32 ops/sec ±2.30% (5 runs sampled)
   avg: 3147.78ms
   18886.68% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 0.32 ops/sec ±2.84% (5 runs sampled)
   avg: 3162.65ms
   18975.9% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 165,461 ops/sec ±1.80% (82 runs sampled)
   avg: 0.01ms
   0.06% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 168,259 ops/sec ±1.16% (88 runs sampled)
   avg: 0.01ms
   0.06% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 42,914 ops/sec ±0.88% (87 runs sampled)
   avg: 0.02ms
   0.12% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 42,902 ops/sec ±0.84% (92 runs sampled)
   avg: 0.02ms
   0.12% of a frame @ 60FPS 

DataFrame Count By "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 100 ops/sec ±0.50% (73 runs sampled)
   avg: 9.95ms
   59.7% of a frame @ 60FPS 

DataFrame Count By "tracks":
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 96.88 ops/sec ±1.22% (69 runs sampled)
   avg: 10.32ms
   61.92% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'lat', length: 1000000, type: Float32, test: gt, value: 0
 x 18.25 ops/sec ±1.04% (48 runs sampled)
   avg: 54.8ms
   328.8% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'lng', length: 1000000, type: Float32, test: gt, value: 0
 x 18.30 ops/sec ±1.70% (48 runs sampled)
   avg: 54.65ms
   327.9% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>, test: eq, value: Seattle
 x 39.04 ops/sec ±1.18% (50 runs sampled)
   avg: 25.62ms
   153.72% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'lat', length: 1000000, type: Float32, test: gt, value: 0
 x 80.42 ops/sec ±2.55% (68 runs sampled)
   avg: 12.43ms
   74.58% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'lng', length: 1000000, type: Float32, test: gt, value: 0
 x 82.39 ops/sec ±1.34% (70 runs sampled)
   avg: 12.14ms
   72.84% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>, test: eq, value: Seattle
 x 0.35 ops/sec ±3.83% (5 runs sampled)
   avg: 2870.77ms
   17224.62% of a frame @ 60FPS 

refactored benchmark

> apache-arrow@0.3.0 perf /home/hulettbh/working_dir/arrow/js
> node ./perf/index.js

Running apache-arrow performance tests...

Parse "tracks":
Table.from
 x 2,529 ops/sec ±6.54% (74 runs sampled)
   avg: 0.4ms
   2.4% of a frame @ 60FPS 

Parse "tracks":
readBatches
: 
   avg: 0ms
   0% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'lat', length: 1000000, type: Float32
 x 12.30 ops/sec ±1.89% (34 runs sampled)
   avg: 81.31ms
   487.86% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'lng', length: 1000000, type: Float32
 x 11.74 ops/sec ±2.28% (32 runs sampled)
   avg: 85.21ms
   511.26% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.21 ops/sec ±3.43% (8 runs sampled)
   avg: 824.92ms
   4949.52% of a frame @ 60FPS 

Get "tracks" values by index:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.57 ops/sec ±16.06% (9 runs sampled)
   avg: 635.58ms
   3813.48% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 12.84 ops/sec ±3.03% (36 runs sampled)
   avg: 77.85ms
   467.1% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 12.99 ops/sec ±2.77% (36 runs sampled)
   avg: 76.96ms
   461.76% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.71 ops/sec ±1.91% (9 runs sampled)
   avg: 583.78ms
   3502.68% of a frame @ 60FPS 

Iterate "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.74 ops/sec ±1.74% (9 runs sampled)
   avg: 574.87ms
   3449.22% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 908 ops/sec ±1.12% (83 runs sampled)
   avg: 1.1ms
   6.6% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 829 ops/sec ±1.03% (68 runs sampled)
   avg: 1.21ms
   7.26% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.52 ops/sec ±3.03% (8 runs sampled)
   avg: 659.42ms
   3956.52% of a frame @ 60FPS 

Slice toArray "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 1.54 ops/sec ±3.10% (8 runs sampled)
   avg: 648.97ms
   3893.82% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'lat', length: 1000000, type: Float32
 x 683,939 ops/sec ±2.24% (92 runs sampled)
   avg: 0ms
   0% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'lng', length: 1000000, type: Float32
 x 611,359 ops/sec ±2.88% (82 runs sampled)
   avg: 0ms
   0% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 596,711 ops/sec ±3.85% (80 runs sampled)
   avg: 0ms
   0% of a frame @ 60FPS 

Slice "tracks" vectors:
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 626,975 ops/sec ±2.79% (83 runs sampled)
   avg: 0ms
   0% of a frame @ 60FPS 

DataFrame Count By "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>
 x 58.02 ops/sec ±2.07% (60 runs sampled)
   avg: 17.24ms
   103.44% of a frame @ 60FPS 

DataFrame Count By "tracks":
name: 'destination', length: 1000000, type: Dictionary<Int8, Utf8>
 x 59.71 ops/sec ±1.57% (62 runs sampled)
   avg: 16.75ms
   100.5% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'lat', length: 1000000, type: Float32, test: gt, value: 0
 x 18.50 ops/sec ±1.42% (49 runs sampled)
   avg: 54.05ms
   324.3% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'lng', length: 1000000, type: Float32, test: gt, value: 0
 x 17.62 ops/sec ±2.56% (46 runs sampled)
   avg: 56.74ms
   340.44% of a frame @ 60FPS 

DataFrame Filter-Scan Count "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>, test: eq, value: Seattle
 x 31.35 ops/sec ±0.96% (55 runs sampled)
   avg: 31.9ms
   191.4% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'lat', length: 1000000, type: Float32, test: gt, value: 0
: 
   avg: 0ms
   0% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'lng', length: 1000000, type: Float32, test: gt, value: 0
: 
   avg: 0ms
   0% of a frame @ 60FPS 

DataFrame Direct Count "tracks":
name: 'origin', length: 1000000, type: Dictionary<Int8, Utf8>, test: eq, value: Seattle
: 
   avg: 0ms
   0% of a frame @ 60FPS