Dirty scheduler tests with markdown parsing

dirty_scheduler_test

Performed on a MacBook Pro (2009) with a Intel® Core™2 Duo CPU P8700 @ 2.53GHz × 2, running Ubuntu 13.10

doc_size:        Mardown document size in KB
doc_times:       Number of times document is parsed
ring_multiplier: Number of rounds messages are passed between 1000 processes
dirty_scheduler: Use NIF dirty scheduler true/false


TEST1 (two schedulers):

iex(1)> MarkdownTests.benchmark(doc_size: 10, doc_times: 2_000, ring_multiplier: 20, dirty_scheduler: true)  
Sample size: 20000
Range (microsecs): 4 - 18641
Median (microsecs): 184
Average (microsecs): 212
Top 40 timings (microsecs): [18641, 6698, 5662, 3842, 3556, 3402, 3305, 3301, 3171, 3002, 2779, 2679, 2340, 2261, 2196, 2141, 2137, 2118, 2044, 2028, 2007, 2004, 2001, 1996, 1940, 1934, 1915, 1909, 1875, 1875, 1852, 1817, 1791, 1788, 1735, 1722, 1707, 1662, 1652, 1651]
:ok
Total markdown parsing timing (ms): 4320.379

iex(1)> MarkdownTests.benchmark(doc_size: 10, doc_times: 2_000, ring_multiplier: 20, dirty_scheduler: false)
Sample size: 20000
Range (microsecs): 3 - 8448
Median (microsecs): 191
Average (microsecs): 213
Top 40 timings (microsecs): [8448, 3445, 3321, 3084, 2984, 2947, 2911, 2728, 2476, 2393, 2302, 2205, 2145, 2109, 2054, 2044, 2040, 1973, 1925, 1919, 1898, 1877, 1751, 1747, 1744, 1741, 1724, 1689, 1674, 1658, 1655, 1638, 1632, 1628, 1624, 1602, 1598, 1593, 1578, 1577]
:ok
Total markdown parsing timing (ms): 4056.672


TEST2 (one scheduler):

iex(1)> MarkdownTests.benchmark(doc_size: 10, doc_times: 2_500, ring_multiplier: 20, dirty_scheduler: true)
Sample size: 20000
Range (microsecs): 3 - 4723
Median (microsecs): 189
Average (microsecs): 209
Top 40 timings (microsecs): [4723, 3249, 2784, 2750, 2690, 2657, 2545, 2272, 2170, 2160, 2051, 2046, 2005, 1998, 1973, 1967, 1901, 1861, 1856, 1772, 1769, 1766, 1755, 1733, 1709, 1699, 1695, 1695, 1688, 1684, 1680, 1673, 1669, 1658, 1637, 1636, 1628, 1606, 1602, 1593]
:ok
Total markdown parsing timing (ms): 5283.93

iex(1)> MarkdownTests.benchmark(doc_size: 10, doc_times: 2_500, ring_multiplier: 20, dirty_scheduler: false)
Sample size: 20000
Range (microsecs): 6 - 12433
Median (microsecs): 195
Average (microsecs): 222
Top 40 timings (microsecs): [12433, 4576, 3247, 3233, 2801, 2758, 2589, 2487, 2449, 2235, 2170, 2145, 2053, 2023, 1946, 1943, 1910, 1859, 1847, 1846, 1837, 1747, 1726, 1702, 1699, 1657, 1643, 1621, 1620, 1615, 1614, 1603, 1601, 1596, 1596, 1591, 1579, 1575, 1569, 1565]
:ok
Total markdown parsing timing (ms): 5023.909


TEST3 (two schedulers):

iex(1)> MarkdownTests.benchmark(doc_size: 5_000, doc_times: 500, ring_multiplier: 20, dirty_scheduler: true)  
Sample size: 20000
Range (microsecs): 3 - 15206
Median (microsecs): 189
Average (microsecs): 219
Top 40 timings (microsecs): [15206, 8948, 8369, 7879, 7664, 6782, 5433, 5259, 5249, 5173, 4943, 4918, 4724, 4579, 4563, 4385, 4295, 4260, 4253, 4202, 4199, 3965, 3889, 3640, 3596, 3464, 3367, 3336, 3277, 2978, 2972, 2937, 2904, 2788, 2775, 2713, 2692, 2640, 2636, 2634]
:ok
Total markdown parsing timing (ms): 37158.013

iex(1)> MarkdownTests.benchmark(doc_size: 5_000, doc_times: 500, ring_multiplier: 20, dirty_scheduler: false)
Sample size: 20000
Range (microsecs): 3 - 11060
Median (microsecs): 194
Average (microsecs): 217
Top 40 timings (microsecs): [11060, 8790, 8544, 6562, 6272, 5807, 5495, 5085, 4716, 4665, 4653, 4548, 4509, 4238, 3593, 3584, 3446, 3356, 3063, 3054, 3017, 3012, 2760, 2638, 2635, 2627, 2467, 2377, 2305, 2257, 2192, 2188, 2180, 2154, 2135, 2105, 2062, 2050, 2009, 1987]
:ok
Total markdown parsing timing (ms): 36739.316


TEST4 (one scheduler):

Erlang/OTP 17 [RELEASE CANDIDATE 1] [erts-6.0] [source-fdcdaca] [64-bit] [smp:1:1] [ds:1:1:10] [async-threads:10] [hipe] [kernel-poll:false]

iex(1)> MarkdownTests.benchmark(doc_size: 5_000, doc_times: 2_000, ring_multiplier: 20, dirty_scheduler: true) 
Sample size: 20000
Range (microsecs): 4 - 17399
Median (microsecs): 196
Average (microsecs): 223
Top 40 timings (microsecs): [17399, 5878, 5220, 5009, 4476, 4455, 4118, 3981, 3538, 3447, 3420, 3367, 3358, 3225, 3103, 3054, 2865, 2749, 2728, 2665, 2323, 2119, 2026, 1983, 1973, 1966, 1965, 1921, 1868, 1853, 1848, 1846, 1836, 1834, 1812, 1763, 1753, 1717, 1700, 1680]
:ok
Total markdown parsing timing (ms): 146024.57

iex(1)> MarkdownTests.benchmark(doc_size: 5_000, doc_times: 2_000, ring_multiplier: 20, dirty_scheduler: false)
Sample size: 20000
Range (microsecs): 4 - 111289
Median (microsecs): 162
Average (microsecs): 6601
Top 40 timings (microsecs): [111289, 82432, 81801, 81744, 81556, 80712, 79633, 78664, 78573, 78464, 78122, 78107, 77404, 76895, 76714, 75682, 75571, 75562, 75547, 75458, 75377, 75208, 75165, 75080, 74958, 74921, 74916, 74887, 74788, 74576, 74557, 74467, 74452, 74428, 74355, 74294, 74293, 74283, 74266, 74239]
:ok
Total markdown parsing timing (ms): 144378.433