Skip to content

Instantly share code, notes, and snippets.

@Aaronontheweb
Last active August 16, 2016 06:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Aaronontheweb/228507db024fe00ee88b5e5f14e6d679 to your computer and use it in GitHub Desktop.
Save Aaronontheweb/228507db024fe00ee88b5e5f14e6d679 to your computer and use it in GitHub Desktop.
NBench Mono v. .NET 4.6.2 (Windows) Side by Side Comparison

NBench.Tests.Performance.CounterPerfSpecs+Benchmark

Test to ensure that a minimal throughput test can be rapidly executed. 08/16/2016 06:12:53

System Info

NBench=NBench, Version=0.3.0.0, Culture=neutral, PublicKeyToken=null
OS=Unix 4.4.0.34
ProcessorCount=2
CLR=4.0.30319.42000,IsMono=True,MaxGcGeneration=1
WorkerThreads=200, IOThreads=2

NBench Settings

RunMode=Throughput, TestMode=Test
NumberOfIterations=3, MaximumRunTime=00:00:01
Concurrent=False
Tracing=True

Data


Totals

      Metric |           Units |             Max |         Average |             Min |          StdDev |

---------------- |---------------- |---------------- |---------------- |---------------- |---------------- | [Counter] TestCounter | operations | 2,464,674.00 | 2,464,674.00 | 2,464,674.00 | 0.00 |

Per-second Totals

      Metric |       Units / s |         Max / s |     Average / s |         Min / s |      StdDev / s |

---------------- |---------------- |---------------- |---------------- |---------------- |---------------- | [Counter] TestCounter | operations | 112,145,330.45 | 107,158,856.32 | 100,603,455.67 | 5,928,732.26 |

Raw Data

[Counter] TestCounter

       Run # |      operations |  operations / s | ns / operations |

---------------- |---------------- |---------------- |---------------- | 1 | 2,464,674.00 | 100,603,455.67 | 9.94 | 2 | 2,464,674.00 | 108,727,782.85 | 9.20 | 3 | 2,464,674.00 | 112,145,330.45 | 8.92 |

Benchmark Assertions

  • [PASS] Expected [Counter] TestCounter to must be greater than 10,000,000.00 operations; actual value was 107,158,856.32 operations.

Traces

[NBench][DEBUG][08/16/2016 06:12:51][Thread 0001] Beginning Warmups for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][08/16/2016 06:12:51][Thread 0001] ----- BEGIN PRE-WARMUP ----- [NBench][INFO][08/16/2016 06:12:51][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][08/16/2016 06:12:51][Thread 0001] Throughput mode: estimating how many invocations of NBench.Tests.Performance.CounterPerfSpecs+Benchmark will take 1s [NBench][DEBUG][08/16/2016 06:12:52][Thread 0001] Throughput mode: executed 2464674 instances of NBench.Tests.Performance.CounterPerfSpecs+Benchmark in roughly 1s. Using that figure for benchmark. [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][08/16/2016 06:12:52][Thread 0001] ----- END PRE-WARMUP ----- [NBench][DEBUG][08/16/2016 06:12:52][Thread 0001] ----- BEGIN WARMUPS ----- [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][08/16/2016 06:12:52][Thread 0001] ----- END WARMUPS ----- [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for run 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Generating report for run 2 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:52][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:53][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][08/16/2016 06:12:53][Thread 0001] Generating report for run 3 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark

NBench.Tests.Performance.CounterPerfSpecs+Benchmark

Test to ensure that a minimal throughput test can be rapidly executed. 8/16/2016 6:36:23 AM

System Info

NBench=NBench, Version=0.3.0.0, Culture=neutral, PublicKeyToken=null
OS=Microsoft Windows NT 6.2.9200.0
ProcessorCount=2
CLR=4.0.30319.42000,IsMono=False,MaxGcGeneration=2
WorkerThreads=32767, IOThreads=2

NBench Settings

RunMode=Throughput, TestMode=Test
NumberOfIterations=3, MaximumRunTime=00:00:01
Concurrent=False
Tracing=True

Data


Totals

      Metric |           Units |             Max |         Average |             Min |          StdDev |

---------------- |---------------- |---------------- |---------------- |---------------- |---------------- | [Counter] TestCounter | operations | 7,548,951.00 | 7,548,951.00 | 7,548,951.00 | 0.00 |

Per-second Totals

      Metric |       Units / s |         Max / s |     Average / s |         Min / s |      StdDev / s |

---------------- |---------------- |---------------- |---------------- |---------------- |---------------- | [Counter] TestCounter | operations | 134,844,835.44 | 124,574,187.16 | 116,435,962.89 | 9,387,868.30 |

Raw Data

[Counter] TestCounter

       Run # |      operations |  operations / s | ns / operations |

---------------- |---------------- |---------------- |---------------- | 1 | 7,548,951.00 | 122,441,763.15 | 8.17 | 2 | 7,548,951.00 | 116,435,962.89 | 8.59 | 3 | 7,548,951.00 | 134,844,835.44 | 7.42 |

Benchmark Assertions

  • [PASS] Expected [Counter] TestCounter to must be greater than 10,000,000.00 operations; actual value was 124,574,187.16 operations.

Traces

[NBench][DEBUG][8/16/2016 6:36:22 AM][Thread 0001] Beginning Warmups for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][8/16/2016 6:36:22 AM][Thread 0001] ----- BEGIN PRE-WARMUP ----- [NBench][INFO][8/16/2016 6:36:22 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][8/16/2016 6:36:22 AM][Thread 0001] Throughput mode: estimating how many invocations of NBench.Tests.Performance.CounterPerfSpecs+Benchmark will take 1s [NBench][DEBUG][8/16/2016 6:36:23 AM][Thread 0001] Throughput mode: executed 7548952 instances of NBench.Tests.Performance.CounterPerfSpecs+Benchmark in roughly 1s. Using that figure for benchmark. [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][8/16/2016 6:36:23 AM][Thread 0001] ----- END PRE-WARMUP ----- [NBench][DEBUG][8/16/2016 6:36:23 AM][Thread 0001] ----- BEGIN WARMUPS ----- [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for warmup 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][DEBUG][8/16/2016 6:36:23 AM][Thread 0001] ----- END WARMUPS ----- [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for run 1 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for run 2 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking setup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Invoking cleanup for NBench.Tests.Performance.CounterPerfSpecs+Benchmark [NBench][INFO][8/16/2016 6:36:23 AM][Thread 0001] Generating report for run 3 of NBench.Tests.Performance.CounterPerfSpecs+Benchmark

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment